2024-09-21T00:02:39.554 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T00:02:39.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T00:02:39.668 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/recovery-fs} email: pdonnell@redhat.com first_in_suite: false job_id: '7913313' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGhgZvdcakU3o56mSJUEl/prpKiBqYnRKnGGg2HduLB7AKbD5MgpK0UCuc1nIYX6cJEn80+IPSPXWzSlzMXfxQ0= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBuM9HNNchwsX3NLJD0jS1AffATkP57Awv8xApXsr4cxXA6Of5uNaZkA4QKd79jpQ6Q7slHwdVShlMSlUBLRbuo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_fs teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T00:02:39.668 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T00:02:39.669 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T00:02:39.669 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T00:02:39.670 INFO:teuthology.task.internal:Checking packages... 2024-09-21T00:02:39.691 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T00:02:39.691 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:02:39.691 INFO:teuthology.packaging:ref: None 2024-09-21T00:02:39.691 INFO:teuthology.packaging:tag: None 2024-09-21T00:02:39.691 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:02:39.691 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:02:39.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:02:39.829 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T00:02:39.830 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T00:02:39.859 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T00:02:39.859 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T00:02:39.899 INFO:teuthology.task.internal:Saving configuration 2024-09-21T00:02:39.917 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T00:02:39.944 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T00:02:39.962 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 23:57:42.226855', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGhgZvdcakU3o56mSJUEl/prpKiBqYnRKnGGg2HduLB7AKbD5MgpK0UCuc1nIYX6cJEn80+IPSPXWzSlzMXfxQ0='} 2024-09-21T00:02:39.983 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 23:57:42.224928', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBuM9HNNchwsX3NLJD0jS1AffATkP57Awv8xApXsr4cxXA6Of5uNaZkA4QKd79jpQ6Q7slHwdVShlMSlUBLRbuo='} 2024-09-21T00:02:39.983 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T00:02:39.994 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-21T00:02:39.994 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-21T00:02:39.994 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T00:02:40.091 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3ec7108160>, signals=[15]) 2024-09-21T00:02:40.091 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T00:02:40.115 INFO:teuthology.task.internal:Opening connections... 2024-09-21T00:02:40.115 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:02:40.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:02:40.194 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:02:40.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:02:40.269 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T00:02:40.280 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-09-21T00:02:40.298 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-09-21T00:02:40.298 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-09-21T00:02:40.356 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:02:40.357 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:02:40.358 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-09-21T00:02:40.373 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-09-21T00:02:40.391 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-09-21T00:02:40.391 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-09-21T00:02:40.449 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-09-21T00:02:40.449 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-09-21T00:02:40.449 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:02:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:02:40.451 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-09-21T00:02:40.472 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T00:02:40.510 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T00:02:40.550 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T00:02:40.550 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:02:40.553 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:02:40.570 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T00:02:40.583 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T00:02:40.583 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:02:40.610 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:02:40.688 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T00:02:40.758 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T00:02:40.774 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T00:02:40.775 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-21T00:02:40.775 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-21T00:02:40.775 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:02:40.776 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:02:40.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:02:40.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:02:40.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-21T00:02:40.794 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-21T00:02:40.955 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T00:02:40.956 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T00:02:40.956 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-09-21T00:02:40.972 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T00:02:40.972 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T00:02:40.973 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-21T00:02:40.974 INFO:teuthology.orchestra.run.smithi083.stdout:5.14.0-503.el9.x86_64 2024-09-21T00:02:40.974 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T00:02:40.974 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T00:02:40.974 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum upgrade -y linux-firmware 2024-09-21T00:02:40.992 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-503.el9.x86_64 2024-09-21T00:02:40.992 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T00:02:40.992 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T00:02:40.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum upgrade -y linux-firmware 2024-09-21T00:02:44.477 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-21T00:02:44.695 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.3 MB 00:02 2024-09-21T00:02:46.244 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-21T00:02:46.871 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-21T00:02:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-21T00:02:52.513 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-21T00:02:53.495 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-21T00:02:54.291 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T00:02:54.307 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-21T00:02:55.443 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-21T00:02:59.730 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-09-21T00:03:00.799 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-21T00:03:01.754 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-21T00:03:01.760 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-21T00:03:01.760 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-21T00:03:01.760 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-21T00:03:01.760 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-09-21T00:03:01.760 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-21T00:03:01.760 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:03:01.760 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-21T00:03:01.760 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-21T00:03:01.760 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 1 Package 2024-09-21T00:03:01.760 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:03:01.761 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 388 M 2024-09-21T00:03:01.761 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-21T00:03:02.772 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-09-21T00:03:02.781 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-21T00:03:02.781 INFO:teuthology.orchestra.run.smithi083.stdout: Package Architecture Version Repository Size 2024-09-21T00:03:02.781 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-21T00:03:02.781 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2024-09-21T00:03:02.782 INFO:teuthology.orchestra.run.smithi083.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-21T00:03:02.782 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:03:02.782 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-09-21T00:03:02.782 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-21T00:03:02.782 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 1 Package 2024-09-21T00:03:02.782 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:03:02.782 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 388 M 2024-09-21T00:03:02.782 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-09-21T00:03:07.739 INFO:teuthology.orchestra.run.smithi142.stdout:linux-firmware-20240905-146.el9.noarch.rpm 66 MB/s | 388 MB 00:05 2024-09-21T00:03:07.739 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:03:07.739 INFO:teuthology.orchestra.run.smithi142.stdout:Total 65 MB/s | 388 MB 00:05 2024-09-21T00:03:10.859 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-21T00:03:11.018 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-21T00:03:11.018 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-21T00:03:14.303 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-21T00:03:14.304 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-21T00:03:15.625 INFO:teuthology.orchestra.run.smithi083.stdout:linux-firmware-20240905-146.el9.noarch.rpm 31 MB/s | 388 MB 00:12 2024-09-21T00:03:15.626 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:03:15.626 INFO:teuthology.orchestra.run.smithi083.stdout:Total 30 MB/s | 388 MB 00:12 2024-09-21T00:03:18.744 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-09-21T00:03:18.915 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-09-21T00:03:18.915 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-09-21T00:03:22.238 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-09-21T00:03:22.239 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-09-21T00:03:23.482 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-21T00:03:24.195 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T00:03:24.284 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T00:03:24.910 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T00:03:24.910 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T00:03:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T00:03:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:03:25.652 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-09-21T00:03:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-21T00:03:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:03:25.652 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-21T00:03:25.998 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-21T00:03:25.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T00:03:26.147 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-21T00:03:26.148 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-21T00:03:26.151 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2024-09-21T00:03:31.653 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-09-21T00:03:32.419 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T00:03:32.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21 00:03:32 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-21T00:03:32.467 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2024-09-21 00:03:32-- 2024-09-21T00:03:32.467 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 6.3s 2024-09-21T00:03:32.467 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 343M in 6.0s (57.2 MB/s) 2024-09-21T00:03:32.470 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-21T00:03:32.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-21T00:03:32.500 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T00:03:33.166 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T00:03:33.166 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T00:03:33.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T00:03:33.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:03:33.918 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2024-09-21T00:03:33.918 INFO:teuthology.orchestra.run.smithi083.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-21T00:03:33.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:03:33.918 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-09-21T00:03:34.259 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T00:03:34.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T00:03:34.403 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-21T00:03:34.404 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-21T00:03:34.406 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi083.front.sepia.ceph.com to complete... 2024-09-21T00:03:34.537 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying... ######################################## 2024-09-21T00:03:34.671 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing... ######################################## 2024-09-21T00:03:34.732 INFO:teuthology.orchestra.run.smithi142.stdout:Updating / installing... 2024-09-21T00:03:40.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21 00:03:40 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-21T00:03:40.705 INFO:teuthology.orchestra.run.smithi083.stderr:FINISHED --2024-09-21 00:03:40-- 2024-09-21T00:03:40.705 INFO:teuthology.orchestra.run.smithi083.stderr:Total wall clock time: 6.3s 2024-09-21T00:03:40.705 INFO:teuthology.orchestra.run.smithi083.stderr:Downloaded: 1 files, 343M in 6.0s (57.3 MB/s) 2024-09-21T00:03:40.711 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T00:03:40.711 DEBUG:teuthology.orchestra.run.smithi083:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-21T00:03:42.706 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-21T00:03:42.770 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying... ######################################## 2024-09-21T00:03:42.919 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing... ######################################## 2024-09-21T00:03:42.977 INFO:teuthology.orchestra.run.smithi083.stdout:Updating / installing... 2024-09-21T00:03:50.948 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-21T00:04:22.395 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-21T00:04:22.396 DEBUG:teuthology.orchestra.run.smithi142:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-21T00:04:22.492 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:22.492 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:22.492 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:22.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:22.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-21T00:04:22.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-21T00:04:22.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-21T00:04:22.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-21T00:04:22.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-21T00:04:22.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T00:04:22.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-21T00:04:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T00:04:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T00:04:22.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T00:04:22.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T00:04:22.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-21T00:04:22.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T00:04:22.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T00:04:22.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T00:04:22.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T00:04:22.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T00:04:22.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T00:04:22.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T00:04:22.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T00:04:22.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T00:04:22.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T00:04:22.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T00:04:22.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T00:04:22.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T00:04:22.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T00:04:22.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T00:04:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-21T00:04:22.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T00:04:22.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-21T00:04:22.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-21T00:04:22.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-21T00:04:22.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T00:04:22.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-21T00:04:22.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-21T00:04:22.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T00:04:22.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T00:04:22.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-21T00:04:22.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-21T00:04:22.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-21T00:04:22.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T00:04:22.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T00:04:22.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-21T00:04:22.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T00:04:22.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-21T00:04:22.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T00:04:22.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T00:04:22.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T00:04:22.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T00:04:22.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T00:04:22.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T00:04:22.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T00:04:22.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-21T00:04:22.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T00:04:22.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T00:04:22.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T00:04:22.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T00:04:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-21T00:04:22.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T00:04:22.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T00:04:22.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T00:04:22.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T00:04:22.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T00:04:22.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T00:04:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T00:04:22.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T00:04:22.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T00:04:22.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T00:04:22.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T00:04:22.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T00:04:22.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T00:04:22.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-21T00:04:22.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-21T00:04:22.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T00:04:22.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T00:04:22.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T00:04:22.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T00:04:22.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T00:04:22.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T00:04:22.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T00:04:22.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-21T00:04:22.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-21T00:04:22.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T00:04:22.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T00:04:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T00:04:22.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-21T00:04:22.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-21T00:04:22.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-21T00:04:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-21T00:04:22.549 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T00:04:22.550 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-21T00:04:22.551 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T00:04:22.552 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T00:04:22.553 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T00:04:22.554 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T00:04:22.555 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T00:04:22.556 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T00:04:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T00:04:22.558 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T00:04:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T00:04:22.560 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-21T00:04:22.561 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-21T00:04:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T00:04:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T00:04:22.564 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T00:04:22.565 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-21T00:04:22.565 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-21T00:04:22.565 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T00:04:22.565 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-21T00:04:22.565 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-21T00:04:22.565 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T00:04:22.565 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T00:04:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T00:04:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T00:04:22.568 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T00:04:22.569 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T00:04:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T00:04:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T00:04:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T00:04:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T00:04:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T00:04:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T00:04:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T00:04:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T00:04:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T00:04:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T00:04:22.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T00:04:22.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T00:04:22.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T00:04:22.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T00:04:22.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T00:04:22.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T00:04:22.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T00:04:22.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T00:04:22.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T00:04:22.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-21T00:04:22.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T00:04:22.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-21T00:04:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T00:04:22.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-21T00:04:22.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-21T00:04:22.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T00:04:22.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-21T00:04:22.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T00:04:22.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T00:04:22.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T00:04:22.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-21T00:04:22.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-21T00:04:22.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-21T00:04:22.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T00:04:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T00:04:22.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-21T00:04:22.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T00:04:22.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-21T00:04:22.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T00:04:22.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-21T00:04:22.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T00:04:22.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T00:04:22.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T00:04:22.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T00:04:22.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-21T00:04:22.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T00:04:22.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-21T00:04:22.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T00:04:22.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T00:04:22.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T00:04:22.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T00:04:22.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T00:04:22.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T00:04:22.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T00:04:22.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T00:04:22.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T00:04:22.582 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T00:04:22.582 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T00:04:22.582 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-21T00:04:22.582 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T00:04:22.582 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T00:04:22.582 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T00:04:22.582 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T00:04:22.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-21T00:04:22.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T00:04:22.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-21T00:04:22.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-21T00:04:22.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T00:04:22.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-21T00:04:22.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T00:04:22.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T00:04:22.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T00:04:22.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T00:04:22.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T00:04:22.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T00:04:22.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-21T00:04:22.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T00:04:22.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-21T00:04:22.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-21T00:04:22.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-21T00:04:22.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T00:04:22.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T00:04:22.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T00:04:22.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T00:04:22.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T00:04:22.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T00:04:22.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T00:04:22.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T00:04:22.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T00:04:22.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T00:04:22.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T00:04:22.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T00:04:22.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T00:04:22.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T00:04:22.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T00:04:22.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T00:04:22.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T00:04:22.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T00:04:22.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-21T00:04:22.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-21T00:04:22.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T00:04:22.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T00:04:22.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T00:04:22.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T00:04:22.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-21T00:04:22.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-21T00:04:22.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T00:04:22.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T00:04:22.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-21T00:04:22.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T00:04:22.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-21T00:04:22.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-21T00:04:22.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T00:04:22.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-21T00:04:22.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T00:04:22.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-21T00:04:22.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T00:04:22.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T00:04:22.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T00:04:22.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T00:04:22.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T00:04:22.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-21T00:04:22.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-21T00:04:22.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T00:04:22.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T00:04:22.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T00:04:22.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T00:04:22.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-21T00:04:22.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T00:04:22.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-21T00:04:22.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T00:04:22.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T00:04:22.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-21T00:04:22.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T00:04:22.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T00:04:22.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T00:04:22.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T00:04:22.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T00:04:22.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T00:04:22.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T00:04:22.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T00:04:22.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T00:04:22.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T00:04:22.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-21T00:04:22.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T00:04:22.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T00:04:22.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T00:04:22.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T00:04:22.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T00:04:22.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T00:04:22.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T00:04:22.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-21T00:04:22.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T00:04:22.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-21T00:04:22.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T00:04:22.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T00:04:22.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T00:04:22.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T00:04:22.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T00:04:22.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T00:04:22.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T00:04:22.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T00:04:22.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T00:04:22.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T00:04:22.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T00:04:22.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T00:04:22.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T00:04:22.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T00:04:22.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T00:04:22.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T00:04:22.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T00:04:22.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T00:04:22.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T00:04:22.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T00:04:22.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T00:04:22.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T00:04:22.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T00:04:22.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T00:04:22.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T00:04:22.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T00:04:22.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T00:04:22.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T00:04:22.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T00:04:22.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T00:04:22.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T00:04:22.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T00:04:22.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T00:04:22.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T00:04:22.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T00:04:22.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T00:04:22.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T00:04:22.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T00:04:22.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T00:04:22.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T00:04:22.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T00:04:22.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T00:04:22.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T00:04:22.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T00:04:22.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T00:04:22.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-21T00:04:22.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T00:04:22.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T00:04:22.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T00:04:22.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T00:04:22.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T00:04:22.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T00:04:22.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T00:04:22.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T00:04:22.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T00:04:22.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T00:04:22.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T00:04:22.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T00:04:22.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T00:04:22.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T00:04:22.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T00:04:22.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-21T00:04:22.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T00:04:22.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T00:04:22.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T00:04:22.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-21T00:04:22.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-21T00:04:22.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T00:04:22.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T00:04:22.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T00:04:22.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T00:04:22.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-21T00:04:22.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T00:04:22.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T00:04:22.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T00:04:22.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T00:04:22.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-21T00:04:22.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-21T00:04:22.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T00:04:22.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T00:04:22.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T00:04:22.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-21T00:04:22.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-21T00:04:22.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-21T00:04:22.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-21T00:04:22.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-21T00:04:22.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-21T00:04:22.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-21T00:04:22.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-21T00:04:22.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-21T00:04:22.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-21T00:04:22.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T00:04:22.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T00:04:22.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-21T00:04:22.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T00:04:22.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T00:04:22.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T00:04:22.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T00:04:22.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T00:04:22.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T00:04:22.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T00:04:22.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T00:04:22.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T00:04:22.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T00:04:22.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T00:04:22.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T00:04:22.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-21T00:04:22.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T00:04:22.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T00:04:22.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T00:04:22.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T00:04:22.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T00:04:22.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T00:04:22.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T00:04:22.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T00:04:22.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T00:04:22.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T00:04:22.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T00:04:22.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T00:04:22.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T00:04:22.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T00:04:22.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T00:04:22.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T00:04:22.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T00:04:22.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T00:04:22.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T00:04:22.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T00:04:22.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T00:04:22.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T00:04:22.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T00:04:22.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T00:04:22.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T00:04:22.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T00:04:22.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-21T00:04:22.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-21T00:04:22.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T00:04:22.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T00:04:22.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T00:04:22.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-21T00:04:22.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T00:04:22.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T00:04:22.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-21T00:04:22.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T00:04:22.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-21T00:04:22.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-21T00:04:22.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T00:04:22.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-21T00:04:22.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T00:04:22.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-21T00:04:22.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T00:04:22.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T00:04:22.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-21T00:04:22.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T00:04:22.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-21T00:04:22.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T00:04:22.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-21T00:04:22.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T00:04:22.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-21T00:04:22.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T00:04:22.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-21T00:04:22.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T00:04:22.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-21T00:04:22.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T00:04:22.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-21T00:04:22.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-21T00:04:22.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-21T00:04:22.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T00:04:22.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-21T00:04:22.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-21T00:04:22.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T00:04:22.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-21T00:04:22.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-21T00:04:22.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T00:04:22.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-21T00:04:22.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-21T00:04:22.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T00:04:22.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-21T00:04:22.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T00:04:22.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-21T00:04:22.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T00:04:22.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-21T00:04:22.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T00:04:22.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-21T00:04:22.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T00:04:22.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-21T00:04:22.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T00:04:22.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-21T00:04:22.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T00:04:22.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-21T00:04:22.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T00:04:22.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-21T00:04:22.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-21T00:04:22.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T00:04:22.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-21T00:04:22.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T00:04:22.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-21T00:04:22.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T00:04:22.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T00:04:22.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T00:04:22.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T00:04:22.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-21T00:04:22.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T00:04:22.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T00:04:22.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-21T00:04:22.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T00:04:22.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-21T00:04:22.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T00:04:22.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-21T00:04:22.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T00:04:22.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T00:04:22.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T00:04:22.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T00:04:22.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T00:04:22.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T00:04:22.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T00:04:22.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T00:04:22.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T00:04:22.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T00:04:22.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T00:04:22.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T00:04:22.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T00:04:22.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T00:04:22.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T00:04:22.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T00:04:22.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T00:04:22.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T00:04:22.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T00:04:22.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T00:04:22.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T00:04:22.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T00:04:22.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T00:04:22.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T00:04:22.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T00:04:22.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T00:04:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T00:04:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T00:04:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T00:04:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T00:04:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T00:04:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T00:04:22.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T00:04:22.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T00:04:22.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T00:04:22.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T00:04:22.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T00:04:22.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T00:04:22.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T00:04:22.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T00:04:22.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T00:04:22.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T00:04:22.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T00:04:22.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T00:04:22.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T00:04:22.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T00:04:22.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T00:04:22.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T00:04:22.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T00:04:22.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T00:04:22.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-21T00:04:22.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-21T00:04:22.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T00:04:22.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T00:04:22.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T00:04:22.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T00:04:22.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T00:04:22.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T00:04:22.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T00:04:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-21T00:04:22.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T00:04:22.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T00:04:22.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T00:04:22.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T00:04:22.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T00:04:22.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T00:04:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T00:04:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T00:04:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T00:04:22.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T00:04:22.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T00:04:22.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T00:04:22.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T00:04:22.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T00:04:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T00:04:22.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T00:04:22.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T00:04:22.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T00:04:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T00:04:22.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T00:04:22.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T00:04:22.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T00:04:22.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T00:04:22.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-21T00:04:22.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-21T00:04:22.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T00:04:22.671 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:22.671 DEBUG:teuthology.orchestra.run.smithi142:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-21T00:04:22.695 INFO:teuthology.orchestra.run.smithi142.stdout:postinstall scriptlet (using /bin/sh): 2024-09-21T00:04:22.695 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T00:04:22.695 INFO:teuthology.orchestra.run.smithi142.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T00:04:22.695 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-09-21T00:04:22.695 INFO:teuthology.orchestra.run.smithi142.stdout:for file in vmlinuz System.map config; do 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout: fi 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout:done 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-21T00:04:22.696 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T00:04:22.697 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:22.697 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-09-21T00:04:22.697 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-09-21T00:04:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-09-21T00:04:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-09-21T00:04:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-09-21T00:04:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 82.el9 2024-09-21T00:04:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-09-21T00:04:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T00:04:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-09-21T00:04:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8274670 2024-09-21T00:04:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-09-21T00:04:22.775 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:04:22.776 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T00:04:22.777 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T00:04:22.777 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:22.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T00:04:23.409 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-09-21T00:04:24.834 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T00:04:24.851 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-09-21T00:04:24.853 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-09-21T00:04:24.869 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.FLzvWDA1uc 2024-09-21T00:04:24.869 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FLzvWDA1uc 2024-09-21T00:04:24.940 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.FLzvWDA1uc 2024-09-21T00:04:25.082 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.FLzvWDA1uc is 6KB 2024-09-21T00:04:25.131 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.FLzvWDA1uc 2024-09-21T00:04:25.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T00:04:25.215 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T00:04:25.215 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T00:04:25.215 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T00:04:25.215 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-21T00:04:25.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:25.368 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-09-21T00:04:31.635 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-21T00:04:31.636 DEBUG:teuthology.orchestra.run.smithi083:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-21T00:04:31.717 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T00:04:31.718 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T00:04:31.719 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T00:04:31.720 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T00:04:31.721 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T00:04:31.722 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-21T00:04:31.723 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T00:04:31.724 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T00:04:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T00:04:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T00:04:31.727 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-21T00:04:31.728 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T00:04:31.729 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T00:04:31.730 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-21T00:04:31.731 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-21T00:04:31.732 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T00:04:31.733 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T00:04:31.734 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T00:04:31.735 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T00:04:31.735 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T00:04:31.735 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T00:04:31.735 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T00:04:31.735 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T00:04:31.735 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T00:04:31.735 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T00:04:31.735 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T00:04:31.735 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T00:04:31.735 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T00:04:31.736 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T00:04:31.737 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T00:04:31.738 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T00:04:31.739 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-21T00:04:31.740 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T00:04:31.741 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T00:04:31.742 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T00:04:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T00:04:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T00:04:31.745 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T00:04:31.745 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T00:04:31.745 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T00:04:31.745 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T00:04:31.745 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T00:04:31.745 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T00:04:31.745 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T00:04:31.745 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T00:04:31.745 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T00:04:31.745 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T00:04:31.746 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T00:04:31.747 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T00:04:31.748 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T00:04:31.749 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-21T00:04:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T00:04:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T00:04:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T00:04:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T00:04:31.754 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T00:04:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-21T00:04:31.756 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T00:04:31.757 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T00:04:31.758 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T00:04:31.759 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T00:04:31.760 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T00:04:31.761 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-21T00:04:31.762 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T00:04:31.763 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-21T00:04:31.764 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T00:04:31.765 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T00:04:31.766 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T00:04:31.766 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T00:04:31.766 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-21T00:04:31.766 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T00:04:31.766 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-21T00:04:31.766 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T00:04:31.766 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-21T00:04:31.766 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T00:04:31.766 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T00:04:31.767 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-21T00:04:31.768 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T00:04:31.768 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-21T00:04:31.768 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T00:04:31.768 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T00:04:31.768 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T00:04:31.769 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-21T00:04:31.770 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-21T00:04:31.771 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T00:04:31.772 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T00:04:31.773 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-21T00:04:31.774 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T00:04:31.775 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-21T00:04:31.776 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-21T00:04:31.777 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-21T00:04:31.778 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-21T00:04:31.779 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T00:04:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-21T00:04:31.781 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T00:04:31.782 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T00:04:31.782 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T00:04:31.782 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T00:04:31.782 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T00:04:31.782 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T00:04:31.782 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T00:04:31.782 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T00:04:31.782 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T00:04:31.782 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T00:04:31.782 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-21T00:04:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-21T00:04:31.784 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-21T00:04:31.786 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T00:04:31.787 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T00:04:31.788 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T00:04:31.789 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T00:04:31.790 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T00:04:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T00:04:31.792 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T00:04:31.793 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-21T00:04:31.794 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T00:04:31.795 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T00:04:31.796 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T00:04:31.797 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T00:04:31.798 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-21T00:04:31.799 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T00:04:31.800 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T00:04:31.801 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-21T00:04:31.802 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-21T00:04:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T00:04:31.804 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T00:04:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T00:04:31.806 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T00:04:31.807 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T00:04:31.808 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T00:04:31.809 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T00:04:31.810 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T00:04:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T00:04:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T00:04:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T00:04:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T00:04:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T00:04:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T00:04:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-21T00:04:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T00:04:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T00:04:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T00:04:31.812 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-21T00:04:31.812 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-21T00:04:31.812 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T00:04:31.812 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T00:04:31.812 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T00:04:31.812 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T00:04:31.812 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-21T00:04:31.812 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T00:04:31.812 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T00:04:31.812 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T00:04:31.813 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T00:04:31.813 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-21T00:04:31.814 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-21T00:04:31.815 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T00:04:31.816 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T00:04:31.817 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T00:04:31.818 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-21T00:04:31.819 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T00:04:31.820 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T00:04:31.821 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T00:04:31.822 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T00:04:31.823 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T00:04:31.824 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T00:04:31.825 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T00:04:31.827 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-21T00:04:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T00:04:31.829 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T00:04:31.830 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T00:04:31.831 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T00:04:31.832 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T00:04:31.833 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T00:04:31.834 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T00:04:31.835 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T00:04:31.836 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T00:04:31.836 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T00:04:31.836 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T00:04:31.836 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T00:04:31.836 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T00:04:31.836 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T00:04:31.836 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T00:04:31.837 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T00:04:31.837 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T00:04:31.837 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T00:04:31.837 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T00:04:31.837 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T00:04:31.837 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T00:04:31.837 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-21T00:04:31.837 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T00:04:31.838 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T00:04:31.838 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-21T00:04:31.838 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T00:04:31.838 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-21T00:04:31.838 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-21T00:04:31.838 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T00:04:31.838 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T00:04:31.839 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T00:04:31.840 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T00:04:31.841 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T00:04:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T00:04:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T00:04:31.844 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T00:04:31.845 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T00:04:31.846 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T00:04:31.847 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T00:04:31.848 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T00:04:31.849 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T00:04:31.850 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T00:04:31.851 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T00:04:31.852 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T00:04:31.853 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T00:04:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T00:04:31.855 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T00:04:31.856 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T00:04:31.857 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T00:04:31.858 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T00:04:31.859 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T00:04:31.860 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T00:04:31.861 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T00:04:31.862 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T00:04:31.863 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T00:04:31.864 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T00:04:31.865 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-21T00:04:31.866 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T00:04:31.870 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:31.871 DEBUG:teuthology.orchestra.run.smithi083:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-21T00:04:31.894 INFO:teuthology.orchestra.run.smithi083.stdout:postinstall scriptlet (using /bin/sh): 2024-09-21T00:04:31.894 INFO:teuthology.orchestra.run.smithi083.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T00:04:31.895 INFO:teuthology.orchestra.run.smithi083.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T00:04:31.895 INFO:teuthology.orchestra.run.smithi083.stdout:fi 2024-09-21T00:04:31.895 INFO:teuthology.orchestra.run.smithi083.stdout:for file in vmlinuz System.map config; do 2024-09-21T00:04:31.895 INFO:teuthology.orchestra.run.smithi083.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-21T00:04:31.895 INFO:teuthology.orchestra.run.smithi083.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T00:04:31.895 INFO:teuthology.orchestra.run.smithi083.stdout: fi 2024-09-21T00:04:31.895 INFO:teuthology.orchestra.run.smithi083.stdout:done 2024-09-21T00:04:31.895 INFO:teuthology.orchestra.run.smithi083.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-21T00:04:31.895 INFO:teuthology.orchestra.run.smithi083.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-21T00:04:31.895 INFO:teuthology.orchestra.run.smithi083.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T00:04:31.896 INFO:teuthology.orchestra.run.smithi083.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T00:04:31.896 INFO:teuthology.orchestra.run.smithi083.stdout:fi 2024-09-21T00:04:31.896 INFO:teuthology.orchestra.run.smithi083.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-21T00:04:31.896 INFO:teuthology.orchestra.run.smithi083.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:31.896 INFO:teuthology.orchestra.run.smithi083.stdout:fi 2024-09-21T00:04:31.896 INFO:teuthology.orchestra.run.smithi083.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-21T00:04:31.896 INFO:teuthology.orchestra.run.smithi083.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T00:04:31.896 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:31.896 INFO:teuthology.orchestra.run.smithi083.stdout:fi 2024-09-21T00:04:31.898 DEBUG:teuthology.orchestra.run.smithi083:> sudo rpm -qi grub2-tools 2024-09-21T00:04:31.971 INFO:teuthology.orchestra.run.smithi083.stdout:Name : grub2-tools 2024-09-21T00:04:31.971 INFO:teuthology.orchestra.run.smithi083.stdout:Epoch : 1 2024-09-21T00:04:31.971 INFO:teuthology.orchestra.run.smithi083.stdout:Version : 2.06 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Release : 82.el9 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: x86_64 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Group : Unspecified 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Size : 8274670 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:License : GPLv3+ 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Packager : builder@centos.org 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:Vendor : CentOS 2024-09-21T00:04:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T00:04:31.973 INFO:teuthology.orchestra.run.smithi083.stdout:Summary : Support tools for GRUB. 2024-09-21T00:04:31.973 INFO:teuthology.orchestra.run.smithi083.stdout:Description : 2024-09-21T00:04:31.973 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:04:31.973 INFO:teuthology.orchestra.run.smithi083.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T00:04:31.973 INFO:teuthology.orchestra.run.smithi083.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T00:04:31.973 INFO:teuthology.orchestra.run.smithi083.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T00:04:31.973 INFO:teuthology.orchestra.run.smithi083.stdout:hardware devices. 2024-09-21T00:04:31.973 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:04:31.973 INFO:teuthology.orchestra.run.smithi083.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T00:04:31.974 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T00:04:31.974 INFO:teuthology.task.kernel:Updating grub on smithi083 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:31.974 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T00:04:32.566 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2024-09-21T00:04:33.925 INFO:teuthology.orchestra.run.smithi083.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T00:04:33.959 INFO:teuthology.orchestra.run.smithi083.stderr:done 2024-09-21T00:04:33.962 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-09-21T00:04:33.977 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.uQT997KwZ7 2024-09-21T00:04:33.977 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uQT997KwZ7 2024-09-21T00:04:34.046 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.uQT997KwZ7 2024-09-21T00:04:34.180 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.uQT997KwZ7 is 6KB 2024-09-21T00:04:34.228 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.uQT997KwZ7 2024-09-21T00:04:34.243 DEBUG:teuthology.orchestra.run.smithi083:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T00:04:34.305 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T00:04:34.306 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T00:04:34.306 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T00:04:34.306 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-21T00:04:34.307 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:04:34.463 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2024-09-21T00:04:55.390 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-21T00:04:55.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T00:04:55.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:05:04.470 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T00:05:04.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T00:05:04.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:05:29.967 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-21T00:05:38.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T00:05:38.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:05:57.359 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-21T00:06:04.481 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T00:06:09.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T00:06:09.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:06:10.349 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-21T00:06:10.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T00:06:10.884 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T00:06:10.884 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-21T00:06:10.919 INFO:teuthology.orchestra.run.smithi142.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:06:10.919 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:06:10.919 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T00:06:10.919 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T00:06:11.920 DEBUG:teuthology.parallel:result is None 2024-09-21T00:06:13.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T00:06:13.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:06:17.010 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-09-21T00:06:17.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T00:06:17.637 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T00:06:17.637 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-09-21T00:06:17.670 INFO:teuthology.orchestra.run.smithi083.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:06:17.671 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T00:06:17.671 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T00:06:17.671 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T00:06:18.673 DEBUG:teuthology.parallel:result is None 2024-09-21T00:06:18.674 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T00:06:18.683 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T00:06:18.683 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:06:18.689 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:06:18.726 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T00:06:18.745 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T00:06:18.851 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T00:06:18.852 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:06:18.856 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:06:18.910 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T00:06:18.939 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T00:06:18.939 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:06:18.943 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:06:19.120 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:06:19.143 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:06:19.191 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:06:19.237 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:06:19.240 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T00:06:19.269 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T00:06:19.269 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:06:19.273 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:06:19.329 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T00:06:19.342 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T00:06:19.342 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:06:19.346 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:06:19.380 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:06:19.480 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:06:19.554 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:06:19.615 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:06:19.694 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:06:19.694 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:06:19.777 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:06:19.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:06:19.927 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:06:19.986 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:06:20.060 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:06:20.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:06:20.114 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2024-09-21T00:06:20.117 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-09-21T00:06:20.208 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:06:20.238 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:06:20.450 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T00:06:20.456 INFO:teuthology.task.internal:Starting timer... 2024-09-21T00:06:20.456 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T00:06:20.522 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T00:06:20.606 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2024-09-21T00:06:20.689 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: 2024-09-21T00:06:20.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-09-21T00:06:20.794 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-09-21T00:06:20.798 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T00:06:20.798 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2024-09-21T00:06:20.846 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2024-09-21T00:06:20.846 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-09-21T00:06:20.890 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-09-21T00:06:20.890 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi083.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-09-21T00:06:20.890 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T00:06:20.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:06:20.949 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T00:06:21.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:06:21.007 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T00:06:21.007 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:06:21.114 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:06:21.191 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T00:06:21.206 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T00:06:22.525 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T00:06:22.625 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T00:06:22.636 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T00:06:22.637 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi083.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T00:11:04.583 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi083.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-09-21T00:11:04.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T00:11:04.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:11:04.674 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-09-21T00:11:04.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T00:11:04.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T00:11:04.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:11:04.865 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-21T00:11:04.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T00:11:04.985 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T00:11:05.070 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T00:11:05.070 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:11:05.071 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:11:05.075 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:11:05.075 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:11:05.132 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:11:05.136 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:11:05.161 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:11:05.166 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:11:05.212 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2024-09-21T00:11:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-09-21T00:11:05.235 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2024-09-21T00:11:05.242 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-09-21T00:11:05.264 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:11:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:11:05.294 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:11:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:11:05.390 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:11:05.396 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:11:05.396 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-09-21T00:11:05.396 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:11:05.396 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:11:05.397 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:11:05.397 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:11:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:11:05.416 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:11:05.417 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-21T00:11:05.417 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:11:05.417 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:11:05.417 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:11:05.417 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:11:05.418 INFO:teuthology.run_tasks:Running task install... 2024-09-21T00:11:05.450 DEBUG:teuthology.task.install:project ceph 2024-09-21T00:11:05.450 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T00:11:05.450 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T00:11:05.451 INFO:teuthology.task.install:Using flavor: default 2024-09-21T00:11:05.456 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T00:11:05.456 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T00:11:05.457 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:11:05.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:11:05.459 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:11:05.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:11:05.610 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:11:05.611 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:11:05.612 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:11:05.612 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:11:05.720 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:11:05.720 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:11:05.720 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:11:05.729 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:11:05.729 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:11:05.729 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:11:05.777 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:11:05.778 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:11:05.784 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:11:05.784 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:11:05.874 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:11:05.895 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:11:05.974 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:11:05.975 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:11:06.030 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2024-09-21T00:11:06.031 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-09-21T00:11:06.033 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2024-09-21T00:11:06.035 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-09-21T00:11:06.297 INFO:teuthology.orchestra.run.smithi083.stdout:45 files removed 2024-09-21T00:11:06.310 INFO:teuthology.orchestra.run.smithi142.stdout:45 files removed 2024-09-21T00:11:06.331 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:11:06.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:11:07.009 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 293 kB/s | 84 kB 00:00 2024-09-21T00:11:07.052 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 271 kB/s | 84 kB 00:00 2024-09-21T00:11:07.310 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T00:11:07.353 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T00:11:07.594 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T00:11:07.637 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T00:11:08.970 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.3 MB 00:01 2024-09-21T00:11:09.336 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-21T00:11:11.176 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-21T00:11:13.720 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 20 MB 00:03 2024-09-21T00:11:15.691 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T00:11:17.489 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-21T00:11:18.387 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T00:11:18.502 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-21T00:11:19.972 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-21T00:11:20.826 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-21T00:11:24.782 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-09-21T00:11:27.107 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T00:11:27.164 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:11:27.165 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:11:27.179 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:11:27.180 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:11:27.181 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:11:27.182 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:11:27.184 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:11:27.187 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:11:27.188 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:11:27.255 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-21T00:11:27.279 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:11:27.280 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:11:27.281 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:11:27.282 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:11:27.283 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:11:27.284 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:11:27.285 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:11:27.286 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:11:27.287 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:11:27.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:11:27.289 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:11:27.290 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-21T00:11:27.291 INFO:teuthology.orchestra.run.smithi142.stdout:Install 149 Packages 2024-09-21T00:11:27.292 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 8 Packages 2024-09-21T00:11:27.292 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:11:27.292 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 228 M 2024-09-21T00:11:27.292 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-21T00:11:27.942 INFO:teuthology.orchestra.run.smithi142.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-21T00:11:28.109 INFO:teuthology.orchestra.run.smithi142.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 5.1 MB/s | 873 kB 00:00 2024-09-21T00:11:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T00:11:28.376 INFO:teuthology.orchestra.run.smithi142.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 9.8 MB/s | 5.5 MB 00:00 2024-09-21T00:11:28.435 INFO:teuthology.orchestra.run.smithi142.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 8.8 MB/s | 2.3 MB 00:00 2024-09-21T00:11:28.547 INFO:teuthology.orchestra.run.smithi142.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 8.9 MB/s | 1.5 MB 00:00 2024-09-21T00:11:28.836 INFO:teuthology.orchestra.run.smithi142.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-21T00:11:29.119 INFO:teuthology.orchestra.run.smithi142.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 15 MB/s | 20 MB 00:01 2024-09-21T00:11:29.161 INFO:teuthology.orchestra.run.smithi142.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 610 kB/s | 25 kB 00:00 2024-09-21T00:11:29.446 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:11:29.447 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:11:29.461 INFO:teuthology.orchestra.run.smithi083.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:11:29.462 INFO:teuthology.orchestra.run.smithi083.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:11:29.463 INFO:teuthology.orchestra.run.smithi083.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:11:29.464 INFO:teuthology.orchestra.run.smithi083.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:11:29.466 INFO:teuthology.orchestra.run.smithi083.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:11:29.469 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:11:29.470 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:11:29.536 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-09-21T00:11:29.537 INFO:teuthology.orchestra.run.smithi142.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 15 MB/s | 10 MB 00:00 2024-09-21T00:11:29.557 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-09-21T00:11:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2024-09-21T00:11:29.557 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-09-21T00:11:29.557 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-09-21T00:11:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:11:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:11:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:11:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:11:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:11:29.557 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:11:29.558 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:11:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:11:29.560 INFO:teuthology.orchestra.run.smithi083.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:11:29.561 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:11:29.562 INFO:teuthology.orchestra.run.smithi083.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:11:29.563 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:11:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:11:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:11:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:11:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:11:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:11:29.564 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:11:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:11:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:11:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:11:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:11:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:11:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:11:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:11:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:11:29.565 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:11:29.566 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:11:29.566 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:11:29.566 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:11:29.566 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:11:29.566 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:11:29.566 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:11:29.566 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:11:29.566 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:11:29.566 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:11:29.566 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:11:29.567 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:11:29.568 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:11:29.569 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:11:29.569 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:11:29.569 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:11:29.569 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:11:29.569 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:11:29.569 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:11:29.569 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:11:29.570 INFO:teuthology.orchestra.run.smithi083.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout:Installing weak dependencies: 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout:Install 149 Packages 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 8 Packages 2024-09-21T00:11:29.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:11:29.572 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 228 M 2024-09-21T00:11:29.572 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-09-21T00:11:29.753 INFO:teuthology.orchestra.run.smithi142.stdout:(11/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 15 MB/s | 18 MB 00:01 2024-09-21T00:11:29.778 INFO:teuthology.orchestra.run.smithi142.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 934 kB/s | 226 kB 00:00 2024-09-21T00:11:29.804 INFO:teuthology.orchestra.run.smithi142.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 540 kB/s | 27 kB 00:00 2024-09-21T00:11:29.829 INFO:teuthology.orchestra.run.smithi142.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 632 kB/s | 32 kB 00:00 2024-09-21T00:11:29.863 INFO:teuthology.orchestra.run.smithi142.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 13 MB/s | 766 kB 00:00 2024-09-21T00:11:29.888 INFO:teuthology.orchestra.run.smithi142.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.7 MB/s | 158 kB 00:00 2024-09-21T00:11:29.922 INFO:teuthology.orchestra.run.smithi142.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T00:11:29.955 INFO:teuthology.orchestra.run.smithi142.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T00:11:30.014 INFO:teuthology.orchestra.run.smithi142.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 776 kB/s | 45 kB 00:00 2024-09-21T00:11:30.114 INFO:teuthology.orchestra.run.smithi142.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.5 MB/s | 148 kB 00:00 2024-09-21T00:11:30.198 INFO:teuthology.orchestra.run.smithi142.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.3 MB 00:00 2024-09-21T00:11:30.223 INFO:teuthology.orchestra.run.smithi142.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.5 MB/s | 161 kB 00:00 2024-09-21T00:11:30.257 INFO:teuthology.orchestra.run.smithi142.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T00:11:30.258 INFO:teuthology.orchestra.run.smithi083.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 45 kB/s | 6.6 kB 00:00 2024-09-21T00:11:30.282 INFO:teuthology.orchestra.run.smithi142.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T00:11:30.307 INFO:teuthology.orchestra.run.smithi142.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T00:11:30.333 INFO:teuthology.orchestra.run.smithi142.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T00:11:30.400 INFO:teuthology.orchestra.run.smithi142.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T00:11:30.508 INFO:teuthology.orchestra.run.smithi142.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 15 MB/s | 3.1 MB 00:00 2024-09-21T00:11:30.534 INFO:teuthology.orchestra.run.smithi142.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 256 kB/s | 34 kB 00:00 2024-09-21T00:11:30.534 INFO:teuthology.orchestra.run.smithi083.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.1 MB/s | 873 kB 00:00 2024-09-21T00:11:30.559 INFO:teuthology.orchestra.run.smithi142.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T00:11:30.617 INFO:teuthology.orchestra.run.smithi083.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T00:11:31.109 INFO:teuthology.orchestra.run.smithi142.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-09-21T00:11:31.217 INFO:teuthology.orchestra.run.smithi142.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.6 MB/s | 292 kB 00:00 2024-09-21T00:11:31.309 INFO:teuthology.orchestra.run.smithi142.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 539 kB/s | 49 kB 00:00 2024-09-21T00:11:31.434 INFO:teuthology.orchestra.run.smithi083.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 2.3 MB 00:00 2024-09-21T00:11:31.460 INFO:teuthology.orchestra.run.smithi142.stdout:(34/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T00:11:31.477 INFO:teuthology.orchestra.run.smithi142.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 99 kB/s | 16 kB 00:00 2024-09-21T00:11:31.526 INFO:teuthology.orchestra.run.smithi083.stdout:(5/157): ceph-base-19.3.0-5120.g18432218.el9.x8 3.9 MB/s | 5.5 MB 00:01 2024-09-21T00:11:31.726 INFO:teuthology.orchestra.run.smithi083.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 5.2 MB/s | 1.5 MB 00:00 2024-09-21T00:11:31.854 INFO:teuthology.orchestra.run.smithi142.stdout:(36/157): ceph-test-19.3.0-5120.g18432218.el9.x 15 MB/s | 40 MB 00:02 2024-09-21T00:11:31.886 INFO:teuthology.orchestra.run.smithi142.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 671 kB/s | 285 kB 00:00 2024-09-21T00:11:31.919 INFO:teuthology.orchestra.run.smithi142.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 1.7 MB/s | 784 kB 00:00 2024-09-21T00:11:31.945 INFO:teuthology.orchestra.run.smithi142.stdout:(39/157): cephfs-top-19.3.0-5120.g18432218.el9. 200 kB/s | 18 kB 00:00 2024-09-21T00:11:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-09-21T00:11:32.095 INFO:teuthology.orchestra.run.smithi142.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T00:11:32.120 INFO:teuthology.orchestra.run.smithi142.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-21T00:11:32.154 INFO:teuthology.orchestra.run.smithi142.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-09-21T00:11:32.179 INFO:teuthology.orchestra.run.smithi142.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T00:11:32.204 INFO:teuthology.orchestra.run.smithi142.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T00:11:32.230 INFO:teuthology.orchestra.run.smithi142.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T00:11:32.255 INFO:teuthology.orchestra.run.smithi142.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T00:11:32.260 INFO:teuthology.orchestra.run.smithi083.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 6.8 MB/s | 5.0 MB 00:00 2024-09-21T00:11:32.297 INFO:teuthology.orchestra.run.smithi142.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-21T00:11:32.406 INFO:teuthology.orchestra.run.smithi142.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 989 kB/s | 107 kB 00:00 2024-09-21T00:11:32.464 INFO:teuthology.orchestra.run.smithi142.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 373 kB/s | 22 kB 00:00 2024-09-21T00:11:32.523 INFO:teuthology.orchestra.run.smithi142.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-21T00:11:32.573 INFO:teuthology.orchestra.run.smithi142.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 657 kB/s | 33 kB 00:00 2024-09-21T00:11:32.598 INFO:teuthology.orchestra.run.smithi142.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-21T00:11:32.649 INFO:teuthology.orchestra.run.smithi142.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-21T00:11:32.682 INFO:teuthology.orchestra.run.smithi142.stdout:(55/157): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-09-21T00:11:32.707 INFO:teuthology.orchestra.run.smithi142.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-21T00:11:32.766 INFO:teuthology.orchestra.run.smithi142.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-21T00:11:32.783 INFO:teuthology.orchestra.run.smithi142.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-21T00:11:32.817 INFO:teuthology.orchestra.run.smithi142.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-21T00:11:32.984 INFO:teuthology.orchestra.run.smithi142.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-21T00:11:33.042 INFO:teuthology.orchestra.run.smithi142.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 2.5 MB/s | 581 kB 00:00 2024-09-21T00:11:33.067 INFO:teuthology.orchestra.run.smithi142.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 294 kB/s | 24 kB 00:00 2024-09-21T00:11:33.124 INFO:teuthology.orchestra.run.smithi142.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 586 kB/s | 47 kB 00:00 2024-09-21T00:11:33.210 INFO:teuthology.orchestra.run.smithi142.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-21T00:11:33.235 INFO:teuthology.orchestra.run.smithi142.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-21T00:11:33.260 INFO:teuthology.orchestra.run.smithi142.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-21T00:11:33.369 INFO:teuthology.orchestra.run.smithi142.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.8 MB/s | 3.0 MB 00:00 2024-09-21T00:11:33.711 INFO:teuthology.orchestra.run.smithi142.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 4.6 MB/s | 1.6 MB 00:00 2024-09-21T00:11:33.911 INFO:teuthology.orchestra.run.smithi142.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-09-21T00:11:33.978 INFO:teuthology.orchestra.run.smithi142.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T00:11:34.282 INFO:teuthology.orchestra.run.smithi142.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-09-21T00:11:34.293 INFO:teuthology.orchestra.run.smithi083.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 4.8 MB/s | 20 MB 00:04 2024-09-21T00:11:34.368 INFO:teuthology.orchestra.run.smithi083.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 338 kB/s | 25 kB 00:00 2024-09-21T00:11:34.437 INFO:teuthology.orchestra.run.smithi142.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.1 MB/s | 4.9 MB 00:01 2024-09-21T00:11:34.487 INFO:teuthology.orchestra.run.smithi142.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T00:11:34.502 INFO:teuthology.orchestra.run.smithi083.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 4.6 MB/s | 10 MB 00:02 2024-09-21T00:11:34.529 INFO:teuthology.orchestra.run.smithi142.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 4.1 MB/s | 1.0 MB 00:00 2024-09-21T00:11:34.586 INFO:teuthology.orchestra.run.smithi083.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.7 MB/s | 226 kB 00:00 2024-09-21T00:11:34.612 INFO:teuthology.orchestra.run.smithi142.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 736 kB/s | 61 kB 00:00 2024-09-21T00:11:34.636 INFO:teuthology.orchestra.run.smithi083.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 542 kB/s | 27 kB 00:00 2024-09-21T00:11:34.687 INFO:teuthology.orchestra.run.smithi083.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 635 kB/s | 32 kB 00:00 2024-09-21T00:11:34.704 INFO:teuthology.orchestra.run.smithi142.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-21T00:11:34.805 INFO:teuthology.orchestra.run.smithi142.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-21T00:11:34.829 INFO:teuthology.orchestra.run.smithi083.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 5.3 MB/s | 766 kB 00:00 2024-09-21T00:11:34.863 INFO:teuthology.orchestra.run.smithi142.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-21T00:11:34.879 INFO:teuthology.orchestra.run.smithi083.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T00:11:34.922 INFO:teuthology.orchestra.run.smithi142.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-09-21T00:11:34.929 INFO:teuthology.orchestra.run.smithi083.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T00:11:34.980 INFO:teuthology.orchestra.run.smithi142.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T00:11:35.013 INFO:teuthology.orchestra.run.smithi083.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 6.0 MB/s | 507 kB 00:00 2024-09-21T00:11:35.064 INFO:teuthology.orchestra.run.smithi142.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 418 kB/s | 35 kB 00:00 2024-09-21T00:11:35.239 INFO:teuthology.orchestra.run.smithi142.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-09-21T00:11:35.323 INFO:teuthology.orchestra.run.smithi142.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.0 MB/s | 250 kB 00:00 2024-09-21T00:11:35.425 INFO:teuthology.orchestra.run.smithi142.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.1 MB/s | 222 kB 00:00 2024-09-21T00:11:35.484 INFO:teuthology.orchestra.run.smithi142.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T00:11:35.534 INFO:teuthology.orchestra.run.smithi142.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 850 kB/s | 42 kB 00:00 2024-09-21T00:11:35.651 INFO:teuthology.orchestra.run.smithi142.stdout:(87/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-21T00:11:35.677 INFO:teuthology.orchestra.run.smithi142.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 269 kB 00:00 2024-09-21T00:11:35.702 INFO:teuthology.orchestra.run.smithi142.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T00:11:35.752 INFO:teuthology.orchestra.run.smithi142.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T00:11:35.763 INFO:teuthology.orchestra.run.smithi083.stdout:(18/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 4.4 MB/s | 18 MB 00:04 2024-09-21T00:11:35.811 INFO:teuthology.orchestra.run.smithi142.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-21T00:11:35.836 INFO:teuthology.orchestra.run.smithi142.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 642 kB/s | 54 kB 00:00 2024-09-21T00:11:35.839 INFO:teuthology.orchestra.run.smithi083.stdout:(19/157): librgw2-19.3.0-5120.g18432218.el9.x86 6.4 MB/s | 5.3 MB 00:00 2024-09-21T00:11:35.855 INFO:teuthology.orchestra.run.smithi083.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 492 kB/s | 45 kB 00:00 2024-09-21T00:11:35.886 INFO:teuthology.orchestra.run.smithi142.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 836 kB/s | 42 kB 00:00 2024-09-21T00:11:35.914 INFO:teuthology.orchestra.run.smithi083.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T00:11:35.947 INFO:teuthology.orchestra.run.smithi083.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.7 MB/s | 161 kB 00:00 2024-09-21T00:11:35.953 INFO:teuthology.orchestra.run.smithi142.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.7 MB/s | 5.1 MB 00:00 2024-09-21T00:11:35.978 INFO:teuthology.orchestra.run.smithi142.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-09-21T00:11:36.006 INFO:teuthology.orchestra.run.smithi083.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 3.4 MB/s | 321 kB 00:00 2024-09-21T00:11:36.012 INFO:teuthology.orchestra.run.smithi142.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T00:11:36.037 INFO:teuthology.orchestra.run.smithi142.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 616 kB/s | 36 kB 00:00 2024-09-21T00:11:36.056 INFO:teuthology.orchestra.run.smithi083.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 2.8 MB/s | 307 kB 00:00 2024-09-21T00:11:36.062 INFO:teuthology.orchestra.run.smithi142.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-09-21T00:11:36.090 INFO:teuthology.orchestra.run.smithi083.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.2 MB/s | 99 kB 00:00 2024-09-21T00:11:36.113 INFO:teuthology.orchestra.run.smithi142.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T00:11:36.115 INFO:teuthology.orchestra.run.smithi083.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T00:11:36.138 INFO:teuthology.orchestra.run.smithi142.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-21T00:11:36.175 INFO:teuthology.orchestra.run.smithi083.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-21T00:11:36.180 INFO:teuthology.orchestra.run.smithi142.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-21T00:11:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 957 kB/s | 64 kB 00:00 2024-09-21T00:11:36.224 INFO:teuthology.orchestra.run.smithi083.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 691 kB/s | 34 kB 00:00 2024-09-21T00:11:36.230 INFO:teuthology.orchestra.run.smithi142.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-21T00:11:36.283 INFO:teuthology.orchestra.run.smithi083.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T00:11:36.467 INFO:teuthology.orchestra.run.smithi083.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 8.3 MB/s | 3.1 MB 00:00 2024-09-21T00:11:36.497 INFO:teuthology.orchestra.run.smithi142.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-09-21T00:11:36.581 INFO:teuthology.orchestra.run.smithi142.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.5 MB/s | 548 kB 00:00 2024-09-21T00:11:36.631 INFO:teuthology.orchestra.run.smithi142.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T00:11:36.640 INFO:teuthology.orchestra.run.smithi142.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 791 kB/s | 19 kB 00:00 2024-09-21T00:11:36.798 INFO:teuthology.orchestra.run.smithi142.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-21T00:11:36.823 INFO:teuthology.orchestra.run.smithi142.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T00:11:36.849 INFO:teuthology.orchestra.run.smithi142.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T00:11:36.866 INFO:teuthology.orchestra.run.smithi142.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-21T00:11:36.891 INFO:teuthology.orchestra.run.smithi142.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T00:11:36.950 INFO:teuthology.orchestra.run.smithi142.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T00:11:36.983 INFO:teuthology.orchestra.run.smithi142.stdout:(114/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-21T00:11:37.034 INFO:teuthology.orchestra.run.smithi142.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-21T00:11:37.059 INFO:teuthology.orchestra.run.smithi142.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-21T00:11:37.084 INFO:teuthology.orchestra.run.smithi142.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 432 kB/s | 43 kB 00:00 2024-09-21T00:11:37.110 INFO:teuthology.orchestra.run.smithi142.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-21T00:11:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T00:11:37.177 INFO:teuthology.orchestra.run.smithi142.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T00:11:37.202 INFO:teuthology.orchestra.run.smithi142.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-21T00:11:37.225 INFO:teuthology.orchestra.run.smithi083.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 9.7 MB/s | 7.4 MB 00:00 2024-09-21T00:11:37.227 INFO:teuthology.orchestra.run.smithi142.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T00:11:37.261 INFO:teuthology.orchestra.run.smithi142.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-21T00:11:37.292 INFO:teuthology.orchestra.run.smithi083.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T00:11:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-09-21T00:11:37.343 INFO:teuthology.orchestra.run.smithi083.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 992 kB/s | 49 kB 00:00 2024-09-21T00:11:37.353 INFO:teuthology.orchestra.run.smithi142.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 359 kB/s | 18 kB 00:00 2024-09-21T00:11:37.387 INFO:teuthology.orchestra.run.smithi142.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 700 kB/s | 23 kB 00:00 2024-09-21T00:11:37.401 INFO:teuthology.orchestra.run.smithi083.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 283 kB/s | 16 kB 00:00 2024-09-21T00:11:37.412 INFO:teuthology.orchestra.run.smithi142.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-21T00:11:37.437 INFO:teuthology.orchestra.run.smithi142.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 798 kB/s | 20 kB 00:00 2024-09-21T00:11:37.460 INFO:teuthology.orchestra.run.smithi083.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T00:11:37.488 INFO:teuthology.orchestra.run.smithi142.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.1 MB/s | 2.0 MB 00:00 2024-09-21T00:11:37.505 INFO:teuthology.orchestra.run.smithi142.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T00:11:37.539 INFO:teuthology.orchestra.run.smithi142.stdout:(131/157): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-09-21T00:11:37.564 INFO:teuthology.orchestra.run.smithi142.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-21T00:11:37.589 INFO:teuthology.orchestra.run.smithi142.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T00:11:37.594 INFO:teuthology.orchestra.run.smithi083.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 5.7 MB/s | 784 kB 00:00 2024-09-21T00:11:37.614 INFO:teuthology.orchestra.run.smithi142.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-21T00:11:37.639 INFO:teuthology.orchestra.run.smithi142.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-21T00:11:37.652 INFO:teuthology.orchestra.run.smithi083.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 317 kB/s | 18 kB 00:00 2024-09-21T00:11:37.698 INFO:teuthology.orchestra.run.smithi142.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-09-21T00:11:37.732 INFO:teuthology.orchestra.run.smithi142.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 308 kB/s | 28 kB 00:00 2024-09-21T00:11:37.757 INFO:teuthology.orchestra.run.smithi142.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 523 kB/s | 31 kB 00:00 2024-09-21T00:11:37.782 INFO:teuthology.orchestra.run.smithi142.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T00:11:37.786 INFO:teuthology.orchestra.run.smithi083.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 599 kB/s | 80 kB 00:00 2024-09-21T00:11:37.807 INFO:teuthology.orchestra.run.smithi142.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T00:11:37.833 INFO:teuthology.orchestra.run.smithi142.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T00:11:37.859 INFO:teuthology.orchestra.run.smithi142.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T00:11:37.884 INFO:teuthology.orchestra.run.smithi142.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2024-09-21T00:11:37.909 INFO:teuthology.orchestra.run.smithi142.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T00:11:37.934 INFO:teuthology.orchestra.run.smithi142.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-21T00:11:37.968 INFO:teuthology.orchestra.run.smithi142.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-21T00:11:37.993 INFO:teuthology.orchestra.run.smithi142.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-21T00:11:38.076 INFO:teuthology.orchestra.run.smithi142.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T00:11:38.087 INFO:teuthology.orchestra.run.smithi083.stdout:(39/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-21T00:11:38.270 INFO:teuthology.orchestra.run.smithi083.stdout:(40/157): ceph-mgr-dashboard-19.3.0-5120.g18432 7.1 MB/s | 14 MB 00:01 2024-09-21T00:11:38.294 INFO:teuthology.orchestra.run.smithi142.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 11 MB/s | 3.4 MB 00:00 2024-09-21T00:11:38.295 INFO:teuthology.orchestra.run.smithi083.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 918 kB/s | 191 kB 00:00 2024-09-21T00:11:38.403 INFO:teuthology.orchestra.run.smithi142.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.7 MB/s | 3.2 MB 00:00 2024-09-21T00:11:38.438 INFO:teuthology.orchestra.run.smithi083.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-21T00:11:38.488 INFO:teuthology.orchestra.run.smithi083.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T00:11:38.571 INFO:teuthology.orchestra.run.smithi083.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-21T00:11:38.586 INFO:teuthology.orchestra.run.smithi142.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 8.0 MB/s | 2.3 MB 00:00 2024-09-21T00:11:38.637 INFO:teuthology.orchestra.run.smithi142.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 825 kB/s | 41 kB 00:00 2024-09-21T00:11:38.686 INFO:teuthology.orchestra.run.smithi142.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-21T00:11:38.728 INFO:teuthology.orchestra.run.smithi142.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.6 MB/s | 1.8 MB 00:00 2024-09-21T00:11:38.771 INFO:teuthology.orchestra.run.smithi142.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-21T00:11:38.912 INFO:teuthology.orchestra.run.smithi142.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-09-21T00:11:38.938 INFO:teuthology.orchestra.run.smithi083.stdout:(45/157): ceph-test-19.3.0-5120.g18432218.el9.x 8.7 MB/s | 40 MB 00:04 2024-09-21T00:11:38.980 INFO:teuthology.orchestra.run.smithi083.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 1.8 MB/s | 1.2 MB 00:00 2024-09-21T00:11:39.006 INFO:teuthology.orchestra.run.smithi083.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 288 kB/s | 125 kB 00:00 2024-09-21T00:11:39.106 INFO:teuthology.orchestra.run.smithi083.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-09-21T00:11:39.207 INFO:teuthology.orchestra.run.smithi083.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-21T00:11:39.232 INFO:teuthology.orchestra.run.smithi083.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 854 kB/s | 107 kB 00:00 2024-09-21T00:11:39.257 INFO:teuthology.orchestra.run.smithi083.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-21T00:11:39.299 INFO:teuthology.orchestra.run.smithi083.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-21T00:11:39.324 INFO:teuthology.orchestra.run.smithi083.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 491 kB/s | 33 kB 00:00 2024-09-21T00:11:39.350 INFO:teuthology.orchestra.run.smithi083.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T00:11:39.383 INFO:teuthology.orchestra.run.smithi083.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-21T00:11:39.408 INFO:teuthology.orchestra.run.smithi083.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-09-21T00:11:39.450 INFO:teuthology.orchestra.run.smithi083.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-21T00:11:39.476 INFO:teuthology.orchestra.run.smithi083.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.8 MB/s | 171 kB 00:00 2024-09-21T00:11:39.501 INFO:teuthology.orchestra.run.smithi083.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-21T00:11:39.576 INFO:teuthology.orchestra.run.smithi083.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-21T00:11:39.610 INFO:teuthology.orchestra.run.smithi083.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-21T00:11:39.629 INFO:teuthology.orchestra.run.smithi142.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.3 MB/s | 16 MB 00:03 2024-09-21T00:11:39.635 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:11:39.635 INFO:teuthology.orchestra.run.smithi083.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 420 kB/s | 24 kB 00:00 2024-09-21T00:11:39.635 INFO:teuthology.orchestra.run.smithi142.stdout:Total 18 MB/s | 228 MB 00:12 2024-09-21T00:11:39.661 INFO:teuthology.orchestra.run.smithi083.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-21T00:11:39.703 INFO:teuthology.orchestra.run.smithi083.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 188 kB 00:00 2024-09-21T00:11:39.736 INFO:teuthology.orchestra.run.smithi083.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-21T00:11:39.753 INFO:teuthology.orchestra.run.smithi083.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-21T00:11:39.887 INFO:teuthology.orchestra.run.smithi083.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-21T00:11:39.962 INFO:teuthology.orchestra.run.smithi083.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T00:11:40.012 INFO:teuthology.orchestra.run.smithi083.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 18 MB/s | 910 kB 00:00 2024-09-21T00:11:40.055 INFO:teuthology.orchestra.run.smithi083.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 3.2 MB/s | 137 kB 00:00 2024-09-21T00:11:40.197 INFO:teuthology.orchestra.run.smithi083.stdout:(71/157): postgresql-server-13.16-1.el9.x86_64. 41 MB/s | 5.8 MB 00:00 2024-09-21T00:11:40.263 INFO:teuthology.orchestra.run.smithi083.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-21T00:11:40.305 INFO:teuthology.orchestra.run.smithi083.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-21T00:11:40.431 INFO:teuthology.orchestra.run.smithi083.stdout:(74/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-09-21T00:11:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:(75/157): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-09-21T00:11:40.539 INFO:teuthology.orchestra.run.smithi083.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 566 kB/s | 61 kB 00:00 2024-09-21T00:11:40.573 INFO:teuthology.orchestra.run.smithi083.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-21T00:11:40.598 INFO:teuthology.orchestra.run.smithi083.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T00:11:40.624 INFO:teuthology.orchestra.run.smithi083.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-21T00:11:40.649 INFO:teuthology.orchestra.run.smithi083.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-21T00:11:40.674 INFO:teuthology.orchestra.run.smithi083.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T00:11:40.700 INFO:teuthology.orchestra.run.smithi083.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-21T00:11:40.808 INFO:teuthology.orchestra.run.smithi083.stdout:(83/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.6 MB/s | 4.9 MB 00:01 2024-09-21T00:11:40.834 INFO:teuthology.orchestra.run.smithi083.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-21T00:11:40.869 INFO:teuthology.orchestra.run.smithi083.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T00:11:40.892 INFO:teuthology.orchestra.run.smithi083.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T00:11:40.918 INFO:teuthology.orchestra.run.smithi083.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-21T00:11:40.943 INFO:teuthology.orchestra.run.smithi083.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T00:11:40.968 INFO:teuthology.orchestra.run.smithi083.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T00:11:40.994 INFO:teuthology.orchestra.run.smithi083.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T00:11:41.027 INFO:teuthology.orchestra.run.smithi083.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 867 kB/s | 51 kB 00:00 2024-09-21T00:11:41.053 INFO:teuthology.orchestra.run.smithi083.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 916 kB/s | 54 kB 00:00 2024-09-21T00:11:41.161 INFO:teuthology.orchestra.run.smithi083.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-09-21T00:11:41.187 INFO:teuthology.orchestra.run.smithi083.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 312 kB/s | 42 kB 00:00 2024-09-21T00:11:41.212 INFO:teuthology.orchestra.run.smithi083.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-21T00:11:41.246 INFO:teuthology.orchestra.run.smithi083.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T00:11:41.271 INFO:teuthology.orchestra.run.smithi083.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-21T00:11:41.296 INFO:teuthology.orchestra.run.smithi083.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-21T00:11:41.321 INFO:teuthology.orchestra.run.smithi083.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T00:11:41.347 INFO:teuthology.orchestra.run.smithi083.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T00:11:41.372 INFO:teuthology.orchestra.run.smithi083.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T00:11:41.397 INFO:teuthology.orchestra.run.smithi083.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T00:11:41.423 INFO:teuthology.orchestra.run.smithi083.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-21T00:11:41.757 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-21T00:11:41.784 INFO:teuthology.orchestra.run.smithi083.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-21T00:11:41.801 INFO:teuthology.orchestra.run.smithi083.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 55 kB/s | 22 kB 00:00 2024-09-21T00:11:41.860 INFO:teuthology.orchestra.run.smithi083.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-21T00:11:41.876 INFO:teuthology.orchestra.run.smithi083.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-21T00:11:41.902 INFO:teuthology.orchestra.run.smithi083.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-21T00:11:41.927 INFO:teuthology.orchestra.run.smithi083.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T00:11:41.943 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-21T00:11:41.943 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-21T00:11:41.944 INFO:teuthology.orchestra.run.smithi083.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.8 MB/s | 49 kB 00:00 2024-09-21T00:11:41.969 INFO:teuthology.orchestra.run.smithi083.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T00:11:42.003 INFO:teuthology.orchestra.run.smithi083.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-21T00:11:42.053 INFO:teuthology.orchestra.run.smithi083.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T00:11:42.104 INFO:teuthology.orchestra.run.smithi083.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-21T00:11:42.129 INFO:teuthology.orchestra.run.smithi083.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T00:11:42.154 INFO:teuthology.orchestra.run.smithi083.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T00:11:42.179 INFO:teuthology.orchestra.run.smithi083.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-09-21T00:11:42.221 INFO:teuthology.orchestra.run.smithi083.stdout:(118/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-21T00:11:42.255 INFO:teuthology.orchestra.run.smithi083.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-21T00:11:42.297 INFO:teuthology.orchestra.run.smithi083.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.5 MB/s | 303 kB 00:00 2024-09-21T00:11:42.339 INFO:teuthology.orchestra.run.smithi083.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-21T00:11:42.373 INFO:teuthology.orchestra.run.smithi083.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-21T00:11:42.473 INFO:teuthology.orchestra.run.smithi083.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2024-09-21T00:11:42.498 INFO:teuthology.orchestra.run.smithi083.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T00:11:42.532 INFO:teuthology.orchestra.run.smithi083.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 910 kB/s | 144 kB 00:00 2024-09-21T00:11:42.557 INFO:teuthology.orchestra.run.smithi083.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-09-21T00:11:42.583 INFO:teuthology.orchestra.run.smithi083.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-21T00:11:42.608 INFO:teuthology.orchestra.run.smithi083.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2024-09-21T00:11:42.641 INFO:teuthology.orchestra.run.smithi083.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 337 kB/s | 20 kB 00:00 2024-09-21T00:11:42.667 INFO:teuthology.orchestra.run.smithi083.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T00:11:42.701 INFO:teuthology.orchestra.run.smithi083.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-21T00:11:42.717 INFO:teuthology.orchestra.run.smithi083.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-21T00:11:42.751 INFO:teuthology.orchestra.run.smithi083.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T00:11:42.784 INFO:teuthology.orchestra.run.smithi083.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-21T00:11:42.810 INFO:teuthology.orchestra.run.smithi083.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2024-09-21T00:11:42.835 INFO:teuthology.orchestra.run.smithi083.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T00:11:42.860 INFO:teuthology.orchestra.run.smithi083.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T00:11:42.877 INFO:teuthology.orchestra.run.smithi083.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-09-21T00:11:42.894 INFO:teuthology.orchestra.run.smithi083.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-21T00:11:42.920 INFO:teuthology.orchestra.run.smithi083.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-21T00:11:42.937 INFO:teuthology.orchestra.run.smithi083.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 852 kB/s | 36 kB 00:00 2024-09-21T00:11:42.962 INFO:teuthology.orchestra.run.smithi083.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-21T00:11:42.988 INFO:teuthology.orchestra.run.smithi083.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T00:11:43.013 INFO:teuthology.orchestra.run.smithi083.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T00:11:43.038 INFO:teuthology.orchestra.run.smithi083.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 795 kB/s | 20 kB 00:00 2024-09-21T00:11:43.080 INFO:teuthology.orchestra.run.smithi083.stdout:(146/157): python3-grpcio-1.46.7-10.el9.x86_64. 2.8 MB/s | 2.0 MB 00:00 2024-09-21T00:11:43.106 INFO:teuthology.orchestra.run.smithi083.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-21T00:11:43.131 INFO:teuthology.orchestra.run.smithi083.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-21T00:11:43.181 INFO:teuthology.orchestra.run.smithi083.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T00:11:43.465 INFO:teuthology.orchestra.run.smithi083.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 9.4 MB/s | 3.4 MB 00:00 2024-09-21T00:11:43.674 INFO:teuthology.orchestra.run.smithi083.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 5.8 MB/s | 3.2 MB 00:00 2024-09-21T00:11:43.799 INFO:teuthology.orchestra.run.smithi083.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 328 kB/s | 41 kB 00:00 2024-09-21T00:11:43.907 INFO:teuthology.orchestra.run.smithi083.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.1 MB/s | 1.8 MB 00:00 2024-09-21T00:11:43.933 INFO:teuthology.orchestra.run.smithi083.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.8 MB/s | 249 kB 00:00 2024-09-21T00:11:43.983 INFO:teuthology.orchestra.run.smithi083.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.9 MB/s | 2.3 MB 00:00 2024-09-21T00:11:44.275 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-21T00:11:44.276 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-21T00:11:44.325 INFO:teuthology.orchestra.run.smithi083.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 1.4 MB 00:00 2024-09-21T00:11:44.592 INFO:teuthology.orchestra.run.smithi083.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 2.4 MB 00:00 2024-09-21T00:11:44.597 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:11:44.597 INFO:teuthology.orchestra.run.smithi083.stdout:Total 15 MB/s | 228 MB 00:15 2024-09-21T00:11:46.668 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-09-21T00:11:46.855 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-09-21T00:11:46.855 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-09-21T00:11:49.312 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-09-21T00:11:49.312 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-09-21T00:11:51.308 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-21T00:11:51.467 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:11:51.521 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:11:51.582 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:11:51.627 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:11:51.659 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:11:51.713 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:11:52.107 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:11:52.242 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:11:52.400 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:11:52.427 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:11:52.575 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:11:52.639 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:11:52.853 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:11:52.914 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:11:52.940 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:11:53.092 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:11:53.125 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:11:53.200 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:11:53.226 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:11:53.265 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:11:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:11:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:11:53.905 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:11:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:11:54.133 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:11:54.449 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:11:54.581 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:11:54.623 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:11:54.692 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:11:54.774 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:11:54.828 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:11:54.867 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:11:54.930 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:11:54.968 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:11:55.002 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:11:55.107 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:11:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:11:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:11:55.254 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:11:55.347 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:11:55.384 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:11:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:11:55.464 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:11:55.553 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:11:55.608 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:11:55.698 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:11:55.856 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:11:55.928 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:11:56.225 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-09-21T00:11:56.364 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:11:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:11:56.487 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:11:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:11:56.559 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:11:56.564 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:11:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:11:56.660 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:11:56.842 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:11:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:11:57.070 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:11:57.114 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:11:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:11:57.167 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:11:57.256 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:11:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:11:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:11:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:11:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:11:57.440 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:11:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:11:57.543 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:11:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:11:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:11:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:11:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:11:57.753 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:11:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:11:57.795 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:11:57.853 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:11:57.884 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:11:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:11:57.905 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:11:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:11:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:11:57.989 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:11:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:11:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:11:58.160 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:11:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:11:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:11:58.252 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:11:58.370 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:11:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:11:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:11:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:11:58.509 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:11:58.540 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:11:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:11:58.648 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:11:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:11:58.807 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:11:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:11:58.848 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:11:58.917 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:11:58.960 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:11:59.001 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:11:59.040 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:11:59.077 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:11:59.112 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:11:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:11:59.145 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:11:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:11:59.221 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:11:59.253 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:11:59.295 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:11:59.340 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:11:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:11:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:11:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:11:59.441 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:11:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:11:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:11:59.563 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:11:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:11:59.637 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:11:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:11:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:11:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:11:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:11:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:11:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:12:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:12:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:12:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:12:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:12:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:12:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:12:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:12:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:12:00.536 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:12:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:12:00.589 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:12:00.624 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:12:00.736 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:12:00.797 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:12:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:12:00.954 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:12:00.992 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:12:01.201 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:12:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:12:01.264 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:12:01.301 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:12:01.346 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:12:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:12:01.389 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:12:01.428 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:12:01.480 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:12:01.650 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:12:01.899 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:12:02.036 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:12:02.104 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:12:02.179 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:12:02.187 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:12:02.228 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:12:02.265 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:12:02.319 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:12:02.323 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:12:02.364 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:12:02.410 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:12:02.460 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:12:02.630 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:12:02.676 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:12:02.719 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:12:02.834 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:12:02.877 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:12:02.920 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:12:02.949 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:12:02.973 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:12:03.108 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:12:03.266 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:12:03.315 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:12:03.352 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:12:03.386 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:12:03.429 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:12:03.468 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:12:03.506 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:12:03.540 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:12:03.573 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:12:03.642 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:12:03.699 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:12:03.798 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:12:03.857 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:12:03.869 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:12:03.895 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:12:03.968 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:12:04.004 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:12:04.015 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:12:04.037 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:12:04.074 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:12:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:12:04.449 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:12:04.570 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:12:04.630 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:12:04.678 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:12:04.951 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:12:05.001 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:12:05.035 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:12:05.146 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:12:05.210 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:12:05.221 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:12:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:12:05.262 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:12:05.359 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:12:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:12:05.406 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:12:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:12:05.639 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:12:05.678 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:12:05.772 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:12:06.569 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:12:06.717 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:12:07.953 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:12:08.020 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:12:08.263 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:12:08.366 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:12:08.402 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:12:08.436 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:12:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:12:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:12:08.801 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:12:08.839 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:12:08.878 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:12:08.878 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:12:08.878 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:12:08.878 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:12:08.937 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:12:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:12:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:12:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:12:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:12:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:12:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:12:12.628 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:12:12.668 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:12:13.341 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:12:13.404 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:12:13.530 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:12:13.530 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:12:13.530 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:12:13.530 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:13.590 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:12:21.397 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:12:21.397 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-09-21T00:12:21.397 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-09-21T00:12:21.397 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-09-21T00:12:21.398 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-09-21T00:12:21.398 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-09-21T00:12:21.398 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-09-21T00:12:21.398 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-09-21T00:12:21.398 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:21.600 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:12:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:12:21.637 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:21.637 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:12:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:23.312 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:12:23.371 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:12:23.371 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:23.371 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:12:23.371 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:12:23.371 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:12:23.371 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:23.613 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:12:23.664 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:12:23.664 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:23.664 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:12:23.664 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:12:23.665 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:12:23.665 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:24.188 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:12:24.239 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:12:24.239 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:24.239 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:12:24.239 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:12:24.239 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:12:24.240 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:24.363 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:12:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:12:24.487 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:12:24.720 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:12:24.783 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:12:24.869 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:12:24.976 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:12:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:12:25.208 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:12:25.273 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:12:25.299 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:12:25.812 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:12:25.840 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:12:25.882 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:12:25.962 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:12:26.021 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:12:26.355 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:12:26.355 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2024-09-21T00:12:26.355 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2024-09-21T00:12:26.355 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2024-09-21T00:12:26.355 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2024-09-21T00:12:26.355 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2024-09-21T00:12:26.355 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /root 2024-09-21T00:12:26.355 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2024-09-21T00:12:26.355 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:26.568 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:12:26.604 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:12:26.604 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:26.604 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:12:26.604 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:28.295 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:12:28.353 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:12:28.353 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:28.353 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:12:28.353 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:12:28.353 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:12:28.353 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:28.596 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:12:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:12:28.647 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:28.647 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:12:28.647 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:12:28.647 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:12:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:29.155 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:12:29.205 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:12:29.205 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:29.205 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:12:29.205 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:12:29.205 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:12:29.205 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:29.367 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:12:29.431 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:12:29.495 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:12:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:12:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:12:29.719 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:12:29.775 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:12:29.860 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:12:29.960 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:12:30.118 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:12:30.183 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:12:30.223 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:12:30.249 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:12:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:12:30.771 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:12:30.773 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:12:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:12:30.815 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:12:30.896 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:12:30.929 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:12:30.952 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:12:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:12:31.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:12:31.222 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:12:31.222 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:31.222 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:12:31.222 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:12:31.222 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:12:31.222 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:31.325 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:12:31.352 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:12:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:12:31.536 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:12:32.569 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:12:32.599 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:12:32.649 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:12:32.650 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:32.650 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:12:32.650 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:12:32.650 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:12:32.650 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:32.707 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:12:32.757 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:12:32.757 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:32.757 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:12:32.757 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:32.808 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:12:32.859 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:12:32.859 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:32.859 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:12:32.860 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:12:32.860 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:12:32.860 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:33.248 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:12:33.299 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:12:33.300 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:33.300 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:12:33.300 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:12:33.300 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:12:33.300 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:34.530 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:12:34.585 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:12:35.663 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:12:35.694 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:12:35.844 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:12:36.031 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:12:36.063 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:12:36.113 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:12:36.114 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:36.114 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:12:36.114 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:12:36.114 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:12:36.114 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:36.171 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:12:36.198 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:12:36.307 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:12:36.389 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:12:37.439 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:12:37.474 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:12:37.525 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:12:37.525 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:37.525 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:12:37.525 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:12:37.526 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:12:37.526 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:37.575 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:12:37.625 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:12:37.625 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:37.625 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:12:37.625 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:37.656 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:12:37.684 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:12:37.706 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:12:37.735 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:12:37.735 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:37.735 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:12:37.735 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:12:37.735 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:12:37.735 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:37.748 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:12:37.802 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:12:37.838 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:12:38.093 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:12:38.137 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:12:38.144 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:12:38.144 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:12:38.144 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:12:38.144 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:12:38.145 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:12:38.145 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:38.192 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:12:38.222 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:12:38.253 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:12:38.297 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:12:39.062 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:12:39.112 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:12:39.154 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:12:40.434 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:12:40.535 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:12:40.590 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:12:40.705 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:12:40.746 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:12:40.771 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:12:40.833 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:12:40.833 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:12:40.949 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:12:40.949 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:12:41.057 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:12:41.082 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:12:41.098 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:12:41.098 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:12:41.343 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:12:41.343 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:12:41.452 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:12:41.525 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:12:41.724 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:12:41.724 INFO:teuthology.orchestra.run.smithi142.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-21T00:12:41.724 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:42.488 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:12:42.540 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:12:42.610 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:12:42.679 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:12:42.714 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:12:42.974 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:12:43.019 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:12:43.049 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:12:43.080 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:12:43.124 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:12:43.884 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:12:43.938 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:12:43.980 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:12:45.270 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:12:45.380 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:12:45.437 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:12:45.550 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:12:45.582 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:12:45.616 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:12:45.653 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:12:45.653 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:12:45.760 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:12:45.760 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:12:45.852 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:12:45.878 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:12:45.893 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:12:45.893 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:12:46.138 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:12:46.138 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:12:46.230 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:12:46.303 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:12:46.506 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:12:46.506 INFO:teuthology.orchestra.run.smithi083.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-21T00:12:46.506 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:47.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:12:47.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:12:47.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:12:47.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:12:47.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:12:47.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:12:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:12:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:12:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:12:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:12:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:12:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:12:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:12:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:12:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:12:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:12:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:12:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:12:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:12:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:12:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:12:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:12:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:12:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:12:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:12:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:12:47.996 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:12:47.996 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:12:47.996 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:12:47.996 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:12:47.996 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:12:47.996 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:12:47.996 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:12:47.996 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:12:47.996 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:12:47.997 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:12:47.997 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:12:47.997 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:12:47.997 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:12:47.997 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:12:47.997 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:12:47.997 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:12:47.997 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:12:47.997 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:12:47.998 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:12:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:12:48.000 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:12:48.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:12:48.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:12:48.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:12:48.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:12:48.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:12:48.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:12:48.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:12:48.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:12:48.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:12:48.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:12:48.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:12:48.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:12:48.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:12:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:12:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:50.240 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-09-21T00:12:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:12:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:12:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:12:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:12:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:12:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:12:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:12:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:12:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:12:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:12:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:12:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:12:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:12:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:12:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:12:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:12:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:12:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:12:50.252 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-21T00:12:50.845 DEBUG:teuthology.parallel:result is None 2024-09-21T00:12:52.711 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:12:52.711 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:12:52.712 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:12:52.713 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:12:52.713 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:12:52.713 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:12:52.713 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:12:52.713 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:12:52.713 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:12:52.713 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:12:52.713 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:12:52.713 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:12:52.713 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:12:52.724 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:12:52.725 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:12:52.726 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:12:52.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:12:52.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:12:52.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:12:52.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:12:52.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:12:52.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:12:52.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:12:52.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:12:52.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:12:52.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:12:52.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:12:52.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:12:52.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:12:54.906 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:12:54.906 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:54.906 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2024-09-21T00:12:54.906 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:12:54.906 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:12:54.906 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:12:54.906 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:12:54.906 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.906 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.907 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:12:54.909 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.910 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:12:54.911 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.912 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:12:54.913 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:12:54.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:12:54.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:12:54.917 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:12:54.918 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:12:54.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:12:54.918 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-09-21T00:12:55.516 DEBUG:teuthology.parallel:result is None 2024-09-21T00:12:55.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:12:55.661 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:12:55.706 INFO:teuthology.orchestra.run.smithi083.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:12:55.706 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:12:55.706 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:12:55.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:12:55.845 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:12:55.891 INFO:teuthology.orchestra.run.smithi142.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:12:55.891 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:12:55.891 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:12:55.893 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T00:12:55.893 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:12:55.894 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:12:55.952 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:12:55.952 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:12:56.010 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T00:12:56.010 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:12:56.010 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:12:56.071 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:12:56.172 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:12:56.173 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:12:56.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:12:56.323 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T00:12:56.324 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:12:56.324 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:12:56.381 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:12:56.479 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:12:56.479 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:12:56.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:12:56.630 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T00:12:56.630 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:12:56.630 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:12:56.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:12:56.784 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:12:56.784 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:12:56.839 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:12:56.935 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T00:12:57.054 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T00:12:57.054 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /var/log/ceph 2024-09-21T00:12:57.058 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-09-21T00:12:57.114 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T00:12:57.114 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T00:12:57.118 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T00:12:57.173 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T00:12:57.173 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T00:12:57.177 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T00:12:57.338 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-21T00:12:57.338 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-21T00:12:57.340 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-21T00:12:57.340 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:12:57.340 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T00:12:57.376 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T00:12:57.543 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T00:12:57.599 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:12:57.599 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T00:12:57.634 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T00:12:57.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T00:12:57.865 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T00:12:57.865 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T00:12:57.865 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313', 'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/recovery-fs}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7913313', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240920.212106-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7864, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240920.212106-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi083.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGhgZvdcakU3o56mSJUEl/prpKiBqYnRKnGGg2HduLB7AKbD5MgpK0UCuc1nIYX6cJEn80+IPSPXWzSlzMXfxQ0=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBuM9HNNchwsX3NLJD0jS1AffATkP57Awv8xApXsr4cxXA6Of5uNaZkA4QKd79jpQ6Q7slHwdVShlMSlUBLRbuo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_fs']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_23:48:22', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T00:12:57.866 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T00:12:57.870 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T00:12:57.905 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T00:12:57.946 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T00:12:58.002 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:12:58.002 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:12:58.037 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:12:58.037 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2024-09-21T00:12:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:12:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:12:58.113 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-09-21T00:12:58.113 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:12:58.113 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:12:58.113 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-21 00:12:46.847627476 +0000 2024-09-21T00:12:58.113 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-21 00:10:39.156848735 +0000 2024-09-21T00:12:58.113 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-21 00:10:39.156848735 +0000 2024-09-21T00:12:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-21 00:10:39.156848735 +0000 2024-09-21T00:12:58.114 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:12:58.205 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-21T00:12:58.205 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-21T00:12:58.205 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000339816 s, 1.5 MB/s 2024-09-21T00:12:58.208 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:12:58.244 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2024-09-21T00:12:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:12:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:12:58.319 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 654 Links: 1 2024-09-21T00:12:58.319 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:12:58.319 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:12:58.319 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-21 00:12:46.848627452 +0000 2024-09-21T00:12:58.319 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-21 00:10:39.624837690 +0000 2024-09-21T00:12:58.319 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-21 00:10:39.624837690 +0000 2024-09-21T00:12:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-21 00:10:39.624837690 +0000 2024-09-21T00:12:58.320 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:12:58.411 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-21T00:12:58.411 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-21T00:12:58.412 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000269651 s, 1.9 MB/s 2024-09-21T00:12:58.414 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:12:58.450 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2024-09-21T00:12:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:12:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:12:58.526 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 674 Links: 1 2024-09-21T00:12:58.526 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:12:58.526 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:12:58.527 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-21 00:12:46.848627452 +0000 2024-09-21T00:12:58.527 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-21 00:10:40.103826385 +0000 2024-09-21T00:12:58.527 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-21 00:10:40.103826385 +0000 2024-09-21T00:12:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-21 00:10:40.103826385 +0000 2024-09-21T00:12:58.527 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:12:58.619 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-21T00:12:58.619 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-21T00:12:58.619 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000292599 s, 1.7 MB/s 2024-09-21T00:12:58.622 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:12:58.658 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2024-09-21T00:12:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:12:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:12:58.733 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 692 Links: 1 2024-09-21T00:12:58.733 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:12:58.733 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:12:58.733 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-21 00:12:46.849627429 +0000 2024-09-21T00:12:58.733 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-21 00:10:40.569815382 +0000 2024-09-21T00:12:58.733 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-21 00:10:40.569815382 +0000 2024-09-21T00:12:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-21 00:10:40.569815382 +0000 2024-09-21T00:12:58.733 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:12:58.825 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-21T00:12:58.825 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-21T00:12:58.825 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000333755 s, 1.5 MB/s 2024-09-21T00:12:58.828 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:12:58.864 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T00:12:58.864 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:12:58.864 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:12:58.903 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:12:58.903 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-09-21T00:12:58.981 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:12:58.981 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:12:58.981 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-21T00:12:58.981 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:12:58.981 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:12:58.981 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-21 00:12:42.120301172 +0000 2024-09-21T00:12:58.981 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-21 00:10:41.498707291 +0000 2024-09-21T00:12:58.981 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-21 00:10:41.498707291 +0000 2024-09-21T00:12:58.981 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-21 00:10:41.498707291 +0000 2024-09-21T00:12:58.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:12:59.075 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-21T00:12:59.075 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-21T00:12:59.075 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000363652 s, 1.4 MB/s 2024-09-21T00:12:59.077 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:12:59.114 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-09-21T00:12:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:12:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:12:59.193 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-09-21T00:12:59.193 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:12:59.193 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:12:59.194 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-21 00:12:42.121301154 +0000 2024-09-21T00:12:59.194 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-21 00:10:41.981698573 +0000 2024-09-21T00:12:59.194 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-21 00:10:41.981698573 +0000 2024-09-21T00:12:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-21 00:10:41.981698573 +0000 2024-09-21T00:12:59.194 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:12:59.287 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-21T00:12:59.287 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-21T00:12:59.287 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000280408 s, 1.8 MB/s 2024-09-21T00:12:59.290 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:12:59.327 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-09-21T00:12:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:12:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:12:59.402 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-09-21T00:12:59.402 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:12:59.402 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:12:59.403 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-21 00:12:42.121301154 +0000 2024-09-21T00:12:59.403 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-21 00:10:42.452690071 +0000 2024-09-21T00:12:59.403 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-21 00:10:42.452690071 +0000 2024-09-21T00:12:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-21 00:10:42.452690071 +0000 2024-09-21T00:12:59.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:12:59.494 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-21T00:12:59.494 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-21T00:12:59.494 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000264003 s, 1.9 MB/s 2024-09-21T00:12:59.497 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:12:59.533 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-09-21T00:12:59.609 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:12:59.610 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:12:59.610 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-09-21T00:12:59.610 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:12:59.610 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:12:59.610 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-21 00:12:42.122301136 +0000 2024-09-21T00:12:59.610 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-21 00:10:42.913681750 +0000 2024-09-21T00:12:59.610 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-21 00:10:42.913681750 +0000 2024-09-21T00:12:59.611 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-21 00:10:42.913681750 +0000 2024-09-21T00:12:59.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:12:59.703 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-21T00:12:59.703 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-21T00:12:59.703 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000239572 s, 2.1 MB/s 2024-09-21T00:12:59.705 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:12:59.742 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T00:12:59.742 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T00:12:59.742 INFO:tasks.ceph:Generating config... 2024-09-21T00:13:00.342 INFO:tasks.ceph:[client] pid file = 2024-09-21T00:13:00.342 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-21T00:13:00.342 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T00:13:00.342 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T00:13:00.342 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T00:13:00.342 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T00:13:00.343 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T00:13:00.343 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T00:13:00.343 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T00:13:00.344 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T00:13:00.344 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T00:13:00.502 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T00:13:00.514 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T00:13:00.667 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T00:13:00.722 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.83'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2024-09-21T00:13:00.722 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.83,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-21T00:13:00.723 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:00.723 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T00:13:00.758 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.83 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:00.937 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:00.937 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: generated fsid d4df3382-b453-41c4-9497-6203e3b4e46e 2024-09-21T00:13:00.937 INFO:teuthology.orchestra.run.smithi083.stdout:setting min_mon_release = quincy 2024-09-21T00:13:00.937 INFO:teuthology.orchestra.run.smithi083.stdout:epoch 0 2024-09-21T00:13:00.938 INFO:teuthology.orchestra.run.smithi083.stdout:fsid d4df3382-b453-41c4-9497-6203e3b4e46e 2024-09-21T00:13:00.938 INFO:teuthology.orchestra.run.smithi083.stdout:last_changed 2024-09-21T00:13:00.937195+0000 2024-09-21T00:13:00.938 INFO:teuthology.orchestra.run.smithi083.stdout:created 2024-09-21T00:13:00.937195+0000 2024-09-21T00:13:00.938 INFO:teuthology.orchestra.run.smithi083.stdout:min_mon_release 17 (quincy) 2024-09-21T00:13:00.938 INFO:teuthology.orchestra.run.smithi083.stdout:election_strategy: 1 2024-09-21T00:13:00.938 INFO:teuthology.orchestra.run.smithi083.stdout:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-21T00:13:00.938 INFO:teuthology.orchestra.run.smithi083.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2024-09-21T00:13:00.938 INFO:teuthology.orchestra.run.smithi083.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-09-21T00:13:00.938 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T00:13:00.946 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T00:13:00.981 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d4df3382-b453-41c4-9497-6203e3b4e46e... 2024-09-21T00:13:00.982 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T00:13:01.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T00:13:01.118 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2024-09-21T00:13:01.118 INFO:teuthology.orchestra.run.smithi083.stdout: chdir = "" 2024-09-21T00:13:01.118 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T00:13:01.118 INFO:teuthology.orchestra.run.smithi083.stdout: auth supported = cephx 2024-09-21T00:13:01.118 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.118 INFO:teuthology.orchestra.run.smithi083.stdout: filestore xattr use omap = true 2024-09-21T00:13:01.118 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.118 INFO:teuthology.orchestra.run.smithi083.stdout: mon clock drift allowed = 1.000 2024-09-21T00:13:01.119 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.119 INFO:teuthology.orchestra.run.smithi083.stdout: osd crush chooseleaf type = 0 2024-09-21T00:13:01.119 INFO:teuthology.orchestra.run.smithi083.stdout: auth debug = true 2024-09-21T00:13:01.119 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.119 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on old message = true 2024-09-21T00:13:01.119 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on bug = true 2024-09-21T00:13:01.119 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.119 INFO:teuthology.orchestra.run.smithi083.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T00:13:01.120 INFO:teuthology.orchestra.run.smithi083.stdout: mon pg warn max object skew = 0 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default size = 2 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow primary affinity = true 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow pg remap = true 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on legacy crush tunables = false 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on crush straw calc version zero = false 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on no sortbitwise = false 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on osd down out interval zero = false 2024-09-21T00:13:01.121 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on too few osds = false 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: mon_allow_pool_size_one = true 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: osd default data pool replay window = 5 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: mon allow pool delete = true 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: mon cluster log file level = debug 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: debug asserts on shutdown = true 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: mon health detail to clog = false 2024-09-21T00:13:01.122 INFO:teuthology.orchestra.run.smithi083.stdout: mon host = "172.21.15.83,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on skipped message = False 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = d4df3382-b453-41c4-9497-6203e3b4e46e 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout:[osd] 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: osd journal size = 100 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub load threshold = 5.0 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub max interval = 600 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: osd mclock profile = high_recovery_ops 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: osd recover clone overlap = true 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: osd recovery max chunk = 1048576 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug shutdown = true 2024-09-21T00:13:01.123 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug op order = true 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug verify stray on activate = true 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug trim objects = true 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: osd open classes on start = true 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug pg log writeout = true 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: osd deep scrub update digest min age = 30 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: osd map max advance = 10 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: journal zero on create = true 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: filestore ondisk finisher threads = 3 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: filestore apply finisher threads = 3 2024-09-21T00:13:01.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: bdev debug aio = true 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug misdirected ops = true 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore block size = 96636764160 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore fsck on mount = True 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluefs = 20 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluestore = 20 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: debug osd = 20 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: debug rocksdb = 10 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.9 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.8 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: osd failsafe full ratio = 0.95 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: osd objectstore = bluestore 2024-09-21T00:13:01.125 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr] 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: debug mgr = 20 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: mgr/telemetry/nag = false 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout:[mon] 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: debug paxos = 20 2024-09-21T00:13:01.126 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: mon data avail warn = 5 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: mon mgr mkfs grace = 240 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd reporter subtree level = osd 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd prime pg temp = true 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T00:13:01.127 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: # 1m isn't quite enough 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: mon_down_mkfs_grace = 2m 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_filestore_osds = false 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: mon down mkfs grace = 300 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout:[client] 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: rgw cache enabled = true 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable ops log = true 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable usage log = true 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = "" 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.a] 2024-09-21T00:13:01.128 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.b] 2024-09-21T00:13:01.129 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.c] 2024-09-21T00:13:01.129 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2024-09-21T00:13:01.129 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2024-09-21T00:13:01.129 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2024-09-21T00:13:01.129 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2024-09-21T00:13:01.131 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-09-21T00:13:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-09-21T00:13:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T00:13:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-09-21T00:13:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T00:13:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.83,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = d4df3382-b453-41c4-9497-6203e3b4e46e 2024-09-21T00:13:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-09-21T00:13:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-09-21T00:13:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-21T00:13:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-09-21T00:13:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-09-21T00:13:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: mon down mkfs grace = 300 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-09-21T00:13:01.140 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2024-09-21T00:13:01.141 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-09-21T00:13:01.141 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2024-09-21T00:13:01.157 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T00:13:01.157 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T00:13:01.320 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T00:13:01.320 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:01.320 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T00:13:01.355 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:01.355 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T00:13:01.429 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:13:01.429 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:01.429 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T00:13:01.429 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T00:13:01.546 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:01.546 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:01.620 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:13:01.620 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:01.620 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T00:13:01.620 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T00:13:01.700 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:01.700 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:01.775 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T00:13:01.775 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T00:13:01.776 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T00:13:01.941 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T00:13:01.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T00:13:02.134 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T00:13:02.148 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T00:13:02.148 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T00:13:02.311 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T00:13:02.323 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-21T00:13:02.378 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T00:13:02.543 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T00:13:02.553 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-21T00:13:02.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T00:13:02.776 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T00:13:02.787 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-21T00:13:02.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T00:13:03.008 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T00:13:03.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-21T00:13:03.075 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T00:13:03.075 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T00:13:03.217 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T00:13:03.250 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-21T00:13:03.392 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-21T00:13:03.426 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T00:13:03.568 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T00:13:03.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-21T00:13:03.745 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-21T00:13:03.780 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T00:13:03.780 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T00:13:03.780 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T00:13:03.836 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T00:13:03.836 INFO:tasks.ceph:role: osd.0 2024-09-21T00:13:03.836 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:13:03.836 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T00:13:03.899 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T00:13:03.899 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T00:13:03.899 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T00:13:03.899 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T00:13:03.899 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T00:13:03.899 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-09-21T00:13:03.899 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T00:13:03.899 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T00:13:03.899 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T00:13:03.899 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T00:13:04.311 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-09-21T00:13:04.316 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-09-21T00:13:04.316 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T00:13:04.458 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T00:13:04.521 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T00:13:04.577 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T00:13:04.577 INFO:tasks.ceph:role: osd.1 2024-09-21T00:13:04.577 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:13:04.577 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T00:13:04.642 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T00:13:04.642 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T00:13:04.642 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T00:13:04.642 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T00:13:04.642 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T00:13:04.643 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-09-21T00:13:04.643 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T00:13:04.643 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T00:13:04.643 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T00:13:04.643 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T00:13:04.995 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-09-21T00:13:04.999 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-09-21T00:13:04.999 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T00:13:05.084 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T00:13:05.148 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T00:13:05.206 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T00:13:05.206 INFO:tasks.ceph:role: osd.2 2024-09-21T00:13:05.206 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:13:05.206 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T00:13:05.269 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T00:13:05.269 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T00:13:05.269 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T00:13:05.269 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T00:13:05.269 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T00:13:05.269 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-09-21T00:13:05.270 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T00:13:05.270 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T00:13:05.270 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T00:13:05.270 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T00:13:05.653 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-09-21T00:13:05.657 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-09-21T00:13:05.657 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T00:13:05.753 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T00:13:05.816 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T00:13:05.872 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T00:13:05.872 INFO:tasks.ceph:role: osd.3 2024-09-21T00:13:05.872 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:13:05.872 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T00:13:05.935 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T00:13:05.935 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T00:13:05.935 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T00:13:05.936 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T00:13:05.936 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T00:13:05.936 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-09-21T00:13:05.936 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T00:13:05.936 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T00:13:05.936 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T00:13:05.936 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T00:13:06.344 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-09-21T00:13:06.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-09-21T00:13:06.348 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T00:13:06.477 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T00:13:06.541 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:06.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:06.705+0000 7f0659558640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T00:13:06.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:06.710+0000 7f0659558640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T00:13:06.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:06.710+0000 7f0659558640 -1 bdev(0x55c2e29d5900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T00:13:06.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:06.710+0000 7f0659558640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T00:13:09.732 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T00:13:09.787 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:09.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:09.938+0000 7f7a99702640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T00:13:09.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:09.938+0000 7f7a99702640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T00:13:09.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:09.938+0000 7f7a99702640 -1 bdev(0x556fcb315900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T00:13:09.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:09.939+0000 7f7a99702640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T00:13:13.180 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T00:13:13.236 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:13.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:13.387+0000 7ff181c1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T00:13:13.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:13.388+0000 7ff181c1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T00:13:13.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:13.388+0000 7ff181c1e640 -1 bdev(0x564914b75900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T00:13:13.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:13.388+0000 7ff181c1e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T00:13:16.414 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T00:13:16.470 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:16.622+0000 7f3c090e2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T00:13:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:16.623+0000 7f3c090e2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T00:13:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:16.623+0000 7f3c090e2640 -1 bdev(0x55e67d769900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T00:13:16.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:16.623+0000 7f3c090e2640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T00:13:19.662 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T00:13:19.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T00:13:19.786 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T00:13:19.787 INFO:tasks.ceph:role: osd.4 2024-09-21T00:13:19.787 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:13:19.787 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T00:13:19.853 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T00:13:19.853 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T00:13:19.853 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T00:13:19.853 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T00:13:19.853 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T00:13:19.853 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-21T00:13:19.853 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T00:13:19.854 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T00:13:19.854 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T00:13:19.854 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T00:13:20.262 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-21T00:13:20.266 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-21T00:13:20.267 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T00:13:20.396 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T00:13:20.462 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T00:13:20.518 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T00:13:20.518 INFO:tasks.ceph:role: osd.5 2024-09-21T00:13:20.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:13:20.518 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T00:13:20.580 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T00:13:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T00:13:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T00:13:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T00:13:20.581 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T00:13:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-21T00:13:20.581 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T00:13:20.581 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T00:13:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T00:13:20.581 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T00:13:20.940 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-21T00:13:20.944 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-21T00:13:20.944 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T00:13:21.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T00:13:21.089 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T00:13:21.145 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T00:13:21.145 INFO:tasks.ceph:role: osd.6 2024-09-21T00:13:21.145 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:13:21.145 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T00:13:21.207 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T00:13:21.208 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T00:13:21.208 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T00:13:21.208 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T00:13:21.208 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T00:13:21.208 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-21T00:13:21.209 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T00:13:21.209 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T00:13:21.209 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T00:13:21.209 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T00:13:21.591 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-21T00:13:21.595 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-21T00:13:21.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T00:13:21.696 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T00:13:21.758 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T00:13:21.813 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T00:13:21.813 INFO:tasks.ceph:role: osd.7 2024-09-21T00:13:21.813 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:13:21.813 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T00:13:21.876 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T00:13:21.876 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T00:13:21.876 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T00:13:21.876 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T00:13:21.876 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T00:13:21.876 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-21T00:13:21.876 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T00:13:21.876 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T00:13:21.876 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T00:13:21.877 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T00:13:22.300 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-21T00:13:22.305 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-21T00:13:22.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T00:13:22.442 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T00:13:22.508 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:22.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:22.673+0000 7ff9dce16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T00:13:22.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:22.677+0000 7ff9dce16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T00:13:22.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:22.677+0000 7ff9dce16640 -1 bdev(0x55e06b75d900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T00:13:22.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:22.678+0000 7ff9dce16640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T00:13:25.721 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T00:13:25.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:25.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:25.931+0000 7fd999215640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T00:13:25.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:25.932+0000 7fd999215640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T00:13:25.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:25.932+0000 7fd999215640 -1 bdev(0x55e9c48ef900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T00:13:25.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:25.932+0000 7fd999215640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T00:13:27.867 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:13:27.872 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:13:29.234 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T00:13:29.290 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:29.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:29.443+0000 7f0d4f862640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T00:13:29.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:29.444+0000 7f0d4f862640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T00:13:29.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:29.444+0000 7f0d4f862640 -1 bdev(0x5565a6705900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T00:13:29.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:29.444+0000 7f0d4f862640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T00:13:32.477 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T00:13:32.533 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:32.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:32.685+0000 7f66142e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T00:13:32.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:32.685+0000 7f66142e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T00:13:32.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:32.685+0000 7f66142e8640 -1 bdev(0x55f749001900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T00:13:32.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:32.686+0000 7f66142e8640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T00:13:35.710 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T00:13:35.765 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T00:13:35.766 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:35.766 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T00:13:35.828 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:35.828 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-21T00:13:35.926 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:35.927 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-21T00:13:36.023 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:36.023 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T00:13:36.118 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:36.118 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T00:13:36.214 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:36.214 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T00:13:36.309 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:36.309 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T00:13:36.404 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:36.404 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T00:13:36.460 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:36.461 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-21T00:13:36.555 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:36.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-21T00:13:36.650 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:36.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T00:13:36.745 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:36.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T00:13:36.841 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:36.841 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T00:13:36.936 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:36.936 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T00:13:37.032 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:37.032 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T00:13:37.068 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:37.068 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-21T00:13:37.144 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:37.144 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T00:13:37.179 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:37.179 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-21T00:13:37.254 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T00:13:37.254 DEBUG:teuthology.orchestra.run.smithi083:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T00:13:37.258 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T00:13:37.307 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.y] 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCND+5m4BEbOBAAnYu83HMncFLmEGsIFY7png== 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCOD+5mExeVEhAAJ0iLestg/L0Bib9lwUH24w== 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCOD+5mHWpbIBAAdSilqp128yDhCNuyzCvnXw== 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.0] 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCSD+5miVogKhAA06kRAaDzFMcXZM4Vhsma3g== 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.1] 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCVD+5mf6v5NxAArD4h726rUnz5HARwEOQR3g== 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.2] 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCZD+5mO/szFxAAeNIB5Sarus2uwIhImdJGEw== 2024-09-21T00:13:37.308 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.3] 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCcD+5mchg5JRAA9FArVM2ewxn/vI7C4NNj4g== 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.x] 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCOD+5muywJCBAAQSPUQ+xJ+FcRzBhpyeeyGg== 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCOD+5mTOI9LhAA7A8BMfTgq3PIkGMqHVwybw== 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPD+5m/O54ABAA6NBFQRXdTc0JRxe/mFvJDA== 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.4] 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCiD+5mU6AwKBAAaLyaTasM/iHTD7jtPxWY0g== 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.5] 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQClD+5m0JiSNxAApNM2e3ipmXOP3qCiAojn7w== 2024-09-21T00:13:37.309 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.6] 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCpD+5m8yN5GhAA5Fu+YIBbECGHXB5T2KJbRg== 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.7] 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCsD+5mqVrkKBAAdCi/KbLE9zPn+gbjsHBZKw== 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPD+5mV1rxDBAAkcsI2sXp787CjEVP5Ncm1g== 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout:[client.2] 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPD+5mUjBnFxAAzIWgv6WSifHvfdrq6ygbNw== 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPD+5m77beIRAABZoupjF+AI2eZzvL8RVSdA== 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout:[client.3] 2024-09-21T00:13:37.310 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPD+5mhDBwLBAAnfSvKwitJgk/F7004NzHEg== 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCND+5m4BEbOBAAnYu83HMncFLmEGsIFY7png== 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCOD+5mExeVEhAAJ0iLestg/L0Bib9lwUH24w== 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCOD+5mHWpbIBAAdSilqp128yDhCNuyzCvnXw== 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCSD+5miVogKhAA06kRAaDzFMcXZM4Vhsma3g== 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCVD+5mf6v5NxAArD4h726rUnz5HARwEOQR3g== 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCZD+5mO/szFxAAeNIB5Sarus2uwIhImdJGEw== 2024-09-21T00:13:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCcD+5mchg5JRAA9FArVM2ewxn/vI7C4NNj4g== 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCOD+5muywJCBAAQSPUQ+xJ+FcRzBhpyeeyGg== 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCOD+5mTOI9LhAA7A8BMfTgq3PIkGMqHVwybw== 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCPD+5m/O54ABAA6NBFQRXdTc0JRxe/mFvJDA== 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCiD+5mU6AwKBAAaLyaTasM/iHTD7jtPxWY0g== 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQClD+5m0JiSNxAApNM2e3ipmXOP3qCiAojn7w== 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCpD+5m8yN5GhAA5Fu+YIBbECGHXB5T2KJbRg== 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCsD+5mqVrkKBAAdCi/KbLE9zPn+gbjsHBZKw== 2024-09-21T00:13:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-09-21T00:13:37.349 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCPD+5mV1rxDBAAkcsI2sXp787CjEVP5Ncm1g== 2024-09-21T00:13:37.349 INFO:teuthology.orchestra.run.smithi142.stdout:[client.2] 2024-09-21T00:13:37.349 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCPD+5mUjBnFxAAzIWgv6WSifHvfdrq6ygbNw== 2024-09-21T00:13:37.349 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2024-09-21T00:13:37.349 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCPD+5m77beIRAABZoupjF+AI2eZzvL8RVSdA== 2024-09-21T00:13:37.349 INFO:teuthology.orchestra.run.smithi142.stdout:[client.3] 2024-09-21T00:13:37.349 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCPD+5mhDBwLBAAnfSvKwitJgk/F7004NzHEg== 2024-09-21T00:13:37.350 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T00:13:37.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T00:13:37.552 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T00:13:37.556 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T00:13:37.722 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T00:13:37.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T00:13:37.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:37.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:38.054 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:38.058 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:38.220 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:38.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:38.386 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:38.389 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:38.551 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T00:13:38.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T00:13:38.717 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T00:13:38.722 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T00:13:38.886 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T00:13:38.890 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T00:13:39.054 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:39.058 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:39.219 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:39.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:39.385 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:39.389 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:39.550 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:39.554 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T00:13:39.713 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T00:13:39.717 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T00:13:39.881 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T00:13:39.886 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T00:13:40.049 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T00:13:40.053 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T00:13:40.217 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T00:13:40.273 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T00:13:40.437 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T00:13:40.437 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T00:13:40.491 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T00:13:40.668 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T00:13:40.723 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T00:13:40.778 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T00:13:40.954 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T00:13:41.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T00:13:41.065 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T00:13:41.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T00:13:41.296 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:41.300 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T00:13:41.335 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T00:13:41.335 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T00:13:41.335 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T00:13:41.376 INFO:tasks.ceph.mon.a:Started 2024-09-21T00:13:41.376 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T00:13:41.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T00:13:41.380 INFO:tasks.ceph.mon.b:Started 2024-09-21T00:13:41.380 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T00:13:41.380 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T00:13:41.384 INFO:tasks.ceph.mon.c:Started 2024-09-21T00:13:41.384 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T00:13:41.384 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T00:13:41.385 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T00:13:41.388 INFO:tasks.ceph.mgr.y:Started 2024-09-21T00:13:41.388 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T00:13:41.388 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T00:13:41.393 INFO:tasks.ceph.mgr.x:Started 2024-09-21T00:13:41.393 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-21T00:13:41.393 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-21T00:13:41.398 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-21T00:13:41.398 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-21T00:13:41.444 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-21T00:13:41.444 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-21T00:13:41.491 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-21T00:13:41.491 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-21T00:13:41.537 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-21T00:13:41.537 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-21T00:13:41.583 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-21T00:13:41.583 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-21T00:13:41.630 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-21T00:13:41.630 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-21T00:13:41.676 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-21T00:13:41.677 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-21T00:13:41.724 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-21T00:13:41.724 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-21T00:13:41.773 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-21T00:13:41.773 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-21T00:13:41.827 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-21T00:13:41.827 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-21T00:13:41.880 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-21T00:13:41.880 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-21T00:13:41.936 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-21T00:13:41.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-21T00:13:41.980 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T00:13:41.980 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-21T00:13:42.036 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T00:13:42.036 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-21T00:13:42.096 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-21T00:13:42.096 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-21T00:13:42.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.092+0000 7f9561600640 1 -- 172.21.15.83:0/3433952973 <== mon.2 v2:172.21.15.142:3301/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v3)=0 v3) ==== 109+0+0 (secure 0 0 0) 0x7f9558003df0 con 0x7f9564202350 2024-09-21T00:13:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.094+0000 7f42b1200640 1 -- 172.21.15.83:0/1251603539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42900039e0 msgr2=0x7f4290003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.094+0000 7f42b1200640 1 --2- 172.21.15.83:0/1251603539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42900039e0 0x7f4290003e10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f42a4002230 tx=0x7f4290005830 comp rx=0 tx=0).stop 2024-09-21T00:13:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.095+0000 7f42abe00640 1 -- 172.21.15.83:0/1251603539 reap_dead start 2024-09-21T00:13:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.095+0000 7f42b1200640 1 -- 172.21.15.83:0/1251603539 shutdown_connections 2024-09-21T00:13:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.095+0000 7f42b1200640 1 -- 172.21.15.83:0/1251603539 >> 172.21.15.83:0/1251603539 conn(0x7f42ac0cfec0 msgr2=0x7f42ac0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.095+0000 7f42b1200640 1 -- 172.21.15.83:0/1251603539 shutdown_connections 2024-09-21T00:13:42.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.096+0000 7f3e05800640 1 -- 172.21.15.83:0/2656571201 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f3ddc000e60 con 0x7f3df80e7290 2024-09-21T00:13:42.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.098+0000 7f3df3e00640 1 -- 172.21.15.83:0/2656571201 <== mon.1 v2:172.21.15.142:3300/0 8 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f3dec0109b0 con 0x7f3df80e7290 2024-09-21T00:13:42.108 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-21T00:13:42.108 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-21T00:13:42.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.102+0000 7f3e01600640 1 -- 172.21.15.83:0/1214679079 <== mon.0 v2:172.21.15.83:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v4)=0 v4) ==== 114+0+0 (secure 0 0 0) 0x7f3dfc012420 con 0x7f3e0406e330 2024-09-21T00:13:42.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.103+0000 7f3e01600640 1 -- 172.21.15.83:0/1214679079 <== mon.0 v2:172.21.15.83:3300/0 10 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f3dfc0121b0 con 0x7f3e0406e330 2024-09-21T00:13:42.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.099+0000 7f9561600640 1 -- 172.21.15.83:0/3433952973 <== mon.2 v2:172.21.15.142:3301/0 10 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f9558029020 con 0x7f9564202350 2024-09-21T00:13:42.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.098+0000 7f956c400640 1 -- 172.21.15.83:0/3433952973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9564202350 msgr2=0x7f956406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.101+0000 7f956c400640 1 --2- 172.21.15.83:0/3433952973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9564202350 0x7f956406ef90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f955800f680 tx=0x7f955800fb40 comp rx=0 tx=0).stop 2024-09-21T00:13:42.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.102+0000 7f956c400640 1 -- 172.21.15.83:0/3433952973 shutdown_connections 2024-09-21T00:13:42.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.102+0000 7f956c400640 1 --2- 172.21.15.83:0/3433952973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95640b28e0 0x7f95640b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.102+0000 7f956c400640 1 --2- 172.21.15.83:0/3433952973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9564202350 0x7f956406ef90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.102+0000 7f956c400640 1 --2- 172.21.15.83:0/3433952973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f954c0099b0 0x7f956406dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.102+0000 7f956c400640 1 -- 172.21.15.83:0/3433952973 >> 172.21.15.83:0/3433952973 conn(0x7f956409d830 msgr2=0x7f9564158280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.102+0000 7f956c400640 1 -- 172.21.15.83:0/3433952973 shutdown_connections 2024-09-21T00:13:42.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.102+0000 7f956c400640 1 -- 172.21.15.83:0/3433952973 wait complete. 2024-09-21T00:13:42.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.100+0000 7f42b1200640 1 -- 172.21.15.83:0/1251603539 wait complete. 2024-09-21T00:13:42.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.108+0000 7f3df6a00640 1 -- 172.21.15.83:0/1214679079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e0406e330 msgr2=0x7f3e04156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.108+0000 7f3df6a00640 1 --2- 172.21.15.83:0/1214679079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e0406e330 0x7f3e04156240 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c670 tx=0x7f3dfc00cb30 comp rx=0 tx=0).stop 2024-09-21T00:13:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.109+0000 7f3df6a00640 1 -- 172.21.15.83:0/1214679079 shutdown_connections 2024-09-21T00:13:42.118 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-21T00:13:42.118 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-21T00:13:42.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.110+0000 7f3df6a00640 1 --2- 172.21.15.83:0/1214679079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e0415fc50 0x7f3e0415c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.110+0000 7f3df6a00640 1 --2- 172.21.15.83:0/1214679079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e040cf7d0 0x7f3e040a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.110+0000 7f3df6a00640 1 --2- 172.21.15.83:0/1214679079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e0406e330 0x7f3e04156240 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.110+0000 7f3df6a00640 1 -- 172.21.15.83:0/1214679079 >> 172.21.15.83:0/1214679079 conn(0x7f3e040b1b90 msgr2=0x7f3e040cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.110+0000 7f3df6a00640 1 -- 172.21.15.83:0/1214679079 shutdown_connections 2024-09-21T00:13:42.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.110+0000 7f3df6a00640 1 -- 172.21.15.83:0/1214679079 wait complete. 2024-09-21T00:13:42.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.120+0000 7f3df3e00640 1 -- 172.21.15.83:0/2656571201 <== mon.1 v2:172.21.15.142:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f3dec028020 con 0x7f3df80e7290 2024-09-21T00:13:42.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.122+0000 7f3df3e00640 1 -- 172.21.15.83:0/2656571201 <== mon.1 v2:172.21.15.142:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f3dec010cf0 con 0x7f3df80e7290 2024-09-21T00:13:42.141 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-21T00:13:42.141 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-21T00:13:42.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.135+0000 7f3e05800640 1 -- 172.21.15.83:0/2656571201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80e7290 msgr2=0x7f3df801f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.139+0000 7f3e05800640 1 --2- 172.21.15.83:0/2656571201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80e7290 0x7f3df801f320 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3dec001190 tx=0x7f3dec001650 comp rx=0 tx=0).stop 2024-09-21T00:13:42.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.139+0000 7f3e05800640 1 -- 172.21.15.83:0/2656571201 shutdown_connections 2024-09-21T00:13:42.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.139+0000 7f3e05800640 1 --2- 172.21.15.83:0/2656571201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3df817e0d0 0x7f3df801fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.139+0000 7f3e05800640 1 --2- 172.21.15.83:0/2656571201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80e7290 0x7f3df801f320 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.139+0000 7f3e05800640 1 --2- 172.21.15.83:0/2656571201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df8009f30 0x7f3df8021b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.139+0000 7f3e05800640 1 -- 172.21.15.83:0/2656571201 >> 172.21.15.83:0/2656571201 conn(0x7f3df8051420 msgr2=0x7f3df8052d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.139+0000 7f3e05800640 1 -- 172.21.15.83:0/2656571201 shutdown_connections 2024-09-21T00:13:42.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.140+0000 7f3e05800640 1 -- 172.21.15.83:0/2656571201 wait complete. 2024-09-21T00:13:42.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.122+0000 7fca66000640 1 -- 172.21.15.83:0/2712378447 <== mon.2 v2:172.21.15.142:3301/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fca60044650 con 0x7fca68054c70 2024-09-21T00:13:42.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.135+0000 7f42b1200640 1 Processor -- start 2024-09-21T00:13:42.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.136+0000 7f42b1200640 1 -- start start 2024-09-21T00:13:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.151+0000 7f42b1200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42900039e0 0x7f42ac1418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.151+0000 7f42b1200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42ac15e610 0x7f42ac14d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.151+0000 7f42b1200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42ac14b880 0x7f42ac15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.152+0000 7f42b1200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac1528b0 con 0x7f42ac15e610 2024-09-21T00:13:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.152+0000 7f42b1200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac06e810 con 0x7f42ac14b880 2024-09-21T00:13:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.152+0000 7f42b1200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac15bd30 con 0x7f42900039e0 2024-09-21T00:13:42.195 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T00:13:42.195 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.160+0000 7f42aaa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42ac15e610 0x7f42ac14d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.160+0000 7f42aaa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42ac15e610 0x7f42ac14d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52344/0 (socket says 172.21.15.83:52344) 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.160+0000 7f42aaa00640 1 -- 172.21.15.83:0/1172721356 learned_addr learned my addr 172.21.15.83:0/1172721356 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.162+0000 7f42ab400640 1 --2- 172.21.15.83:0/1172721356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42900039e0 0x7f42ac1418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.162+0000 7f42abe00640 1 --2- 172.21.15.83:0/1172721356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42ac14b880 0x7f42ac15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.163+0000 7f42ab400640 1 -- 172.21.15.83:0/1172721356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42ac14b880 msgr2=0x7f42ac15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.163+0000 7f42ab400640 1 --2- 172.21.15.83:0/1172721356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42ac14b880 0x7f42ac15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.163+0000 7f42ab400640 1 -- 172.21.15.83:0/1172721356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42ac15e610 msgr2=0x7f42ac14d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.163+0000 7f42ab400640 1 --2- 172.21.15.83:0/1172721356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42ac15e610 0x7f42ac14d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.163+0000 7f42ab400640 1 -- 172.21.15.83:0/1172721356 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac15edf0 con 0x7f42900039e0 2024-09-21T00:13:42.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.163+0000 7f42ab400640 1 --2- 172.21.15.83:0/1172721356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42900039e0 0x7f42ac1418e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42a4001cc0 tx=0x7f42a40012e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:42.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.166+0000 7f42a3400640 1 -- 172.21.15.83:0/1172721356 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4003da0 con 0x7f42900039e0 2024-09-21T00:13:42.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.166+0000 7f42a3400640 1 -- 172.21.15.83:0/1172721356 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f42a402d680 con 0x7f42900039e0 2024-09-21T00:13:42.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.166+0000 7f42a3400640 1 -- 172.21.15.83:0/1172721356 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a402da30 con 0x7f42900039e0 2024-09-21T00:13:42.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.170+0000 7f42b1200640 1 -- 172.21.15.83:0/1172721356 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac141e20 con 0x7f42900039e0 2024-09-21T00:13:42.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.170+0000 7f42b1200640 1 -- 172.21.15.83:0/1172721356 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac14c5f0 con 0x7f42900039e0 2024-09-21T00:13:42.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.182+0000 7f42a3400640 1 -- 172.21.15.83:0/1172721356 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f42a4046020 con 0x7f42900039e0 2024-09-21T00:13:42.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.182+0000 7f42a3400640 1 -- 172.21.15.83:0/1172721356 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f42a403fb00 con 0x7f42900039e0 2024-09-21T00:13:42.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.193+0000 7f42b1200640 1 -- 172.21.15.83:0/1172721356 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ac15f010 con 0x7f42900039e0 2024-09-21T00:13:42.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.198+0000 7f42a3400640 1 -- 172.21.15.83:0/1172721356 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f42a404d070 con 0x7f42900039e0 2024-09-21T00:13:42.211 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-21T00:13:42.212 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-21T00:13:42.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.211+0000 7fc0ef200640 1 -- 172.21.15.83:0/2140900486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0f01621d0 msgr2=0x7fc0f01625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.212+0000 7fc0ef200640 1 --2- 172.21.15.83:0/2140900486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0f01621d0 0x7fc0f01625e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc0f008cea0 tx=0x7fc0dc02a3d0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.215+0000 7fc0ef200640 1 -- 172.21.15.83:0/2140900486 shutdown_connections 2024-09-21T00:13:42.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.215+0000 7fc0ef200640 1 --2- 172.21.15.83:0/2140900486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0f01621d0 0x7fc0f01625e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.215+0000 7fc0ef200640 1 --2- 172.21.15.83:0/2140900486 >> v2:172.21.15.142:3300/0 conn(0x7fc0f006d2b0 0x7fc0f00cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.215+0000 7fc0ef200640 1 -- 172.21.15.83:0/2140900486 >> 172.21.15.83:0/2140900486 conn(0x7fc0f00d1960 msgr2=0x7fc0f00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.215+0000 7fc0ef200640 1 -- 172.21.15.83:0/2140900486 shutdown_connections 2024-09-21T00:13:42.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.218+0000 7fc0ef200640 1 -- 172.21.15.83:0/2140900486 wait complete. 2024-09-21T00:13:42.239 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-21T00:13:42.239 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-21T00:13:42.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.225+0000 7fc0ef200640 1 Processor -- start 2024-09-21T00:13:42.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.225+0000 7fc0ef200640 1 -- start start 2024-09-21T00:13:42.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.231+0000 7fc0ef200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0f006d2b0 0x7fc0f01fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.232+0000 7fc0ede00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0f006d2b0 0x7fc0f01fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.232+0000 7fc0ede00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0f006d2b0 0x7fc0f01fa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52370/0 (socket says 172.21.15.83:52370) 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.232+0000 7fc0ede00640 1 -- 172.21.15.83:0/4199361340 learned_addr learned my addr 172.21.15.83:0/4199361340 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.233+0000 7fc0ef200640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f015ebe0 0x7fc0f014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.233+0000 7fc0ef200640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0f01621d0 0x7fc0f0153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.233+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f015fa90 con 0x7fc0f006d2b0 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.233+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f015f910 con 0x7fc0f015ebe0 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.233+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f0154e90 con 0x7fc0f01621d0 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.234+0000 7fc0ee800640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0f01621d0 0x7fc0f0153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.234+0000 7fc0ed400640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f015ebe0 0x7fc0f014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.234+0000 7fc0ede00640 1 -- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0f01621d0 msgr2=0x7fc0f0153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.236+0000 7fc0ede00640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0f01621d0 0x7fc0f0153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.236+0000 7fc0ede00640 1 -- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f015ebe0 msgr2=0x7fc0f014dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.236+0000 7fc0ede00640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f015ebe0 0x7fc0f014dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.236+0000 7fc0ede00640 1 -- 172.21.15.83:0/4199361340 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f0155480 con 0x7fc0f006d2b0 2024-09-21T00:13:42.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.236+0000 7fc0ed400640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f015ebe0 0x7fc0f014dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:13:42.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.236+0000 7fc0ee800640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0f01621d0 0x7fc0f0153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:13:42.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.237+0000 7fc0ede00640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0f006d2b0 0x7fc0f01fa1a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000b3e0 tx=0x7fc0e000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:42.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.240+0000 7fc0e6000640 1 -- 172.21.15.83:0/4199361340 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0015020 con 0x7fc0f006d2b0 2024-09-21T00:13:42.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.240+0000 7fc0e6000640 1 -- 172.21.15.83:0/4199361340 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fc0e0011920 con 0x7fc0f006d2b0 2024-09-21T00:13:42.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.240+0000 7fc0e6000640 1 -- 172.21.15.83:0/4199361340 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0011d50 con 0x7fc0f006d2b0 2024-09-21T00:13:42.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.240+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f01faca0 con 0x7fc0f006d2b0 2024-09-21T00:13:42.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.240+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f0156ce0 con 0x7fc0f006d2b0 2024-09-21T00:13:42.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.242+0000 7fc0e6000640 1 -- 172.21.15.83:0/4199361340 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0e0018020 con 0x7fc0f006d2b0 2024-09-21T00:13:42.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.242+0000 7fc0e6000640 1 -- 172.21.15.83:0/4199361340 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc0e00198e0 con 0x7fc0f006d2b0 2024-09-21T00:13:42.265 DEBUG:tasks.ceph:set 22 configs 2024-09-21T00:13:42.265 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.265 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.265 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.266 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.266 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.250+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f00cf7f0 con 0x7fc0f006d2b0 2024-09-21T00:13:42.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.264+0000 7fc0e6000640 1 -- 172.21.15.83:0/4199361340 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc0e001f020 con 0x7fc0f006d2b0 2024-09-21T00:13:42.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.337+0000 7f96f2600640 1 -- 172.21.15.83:0/2263286101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96ec0709e0 msgr2=0x7f96ec06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.337+0000 7f96f2600640 1 --2- 172.21.15.83:0/2263286101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96ec0709e0 0x7f96ec06cde0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0cdc50 tx=0x7f96e402a850 comp rx=0 tx=0).stop 2024-09-21T00:13:42.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.337+0000 7f96f2600640 1 -- 172.21.15.83:0/2263286101 shutdown_connections 2024-09-21T00:13:42.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.337+0000 7f96f2600640 1 --2- 172.21.15.83:0/2263286101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96ec0709e0 0x7f96ec06cde0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.337+0000 7f96f2600640 1 --2- 172.21.15.83:0/2263286101 >> v2:172.21.15.83:3300/0 conn(0x7f96ec15ed20 0x7f96ec0704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.337+0000 7f96f2600640 1 --2- 172.21.15.83:0/2263286101 >> v2:172.21.15.142:3300/0 conn(0x7f96ec074820 0x7f96ec0cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.338+0000 7f96f2600640 1 -- 172.21.15.83:0/2263286101 >> 172.21.15.83:0/2263286101 conn(0x7f96ec0cfec0 msgr2=0x7f96ec0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.338+0000 7f96f2600640 1 -- 172.21.15.83:0/2263286101 shutdown_connections 2024-09-21T00:13:42.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.338+0000 7f96f2600640 1 -- 172.21.15.83:0/2263286101 wait complete. 2024-09-21T00:13:42.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.349+0000 7f96f2600640 1 Processor -- start 2024-09-21T00:13:42.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.350+0000 7f96f2600640 1 -- start start 2024-09-21T00:13:42.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.360+0000 7f59c2a00640 1 -- 172.21.15.83:0/2056540773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59bc06ddf0 msgr2=0x7f59bc06e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.360+0000 7f59c2a00640 1 --2- 172.21.15.83:0/2056540773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59bc06ddf0 0x7f59bc06e200 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06ffc0 tx=0x7f59b402a840 comp rx=0 tx=0).stop 2024-09-21T00:13:42.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.360+0000 7f96f2600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96ec0709e0 0x7f96ec139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.360+0000 7f59c2a00640 1 -- 172.21.15.83:0/2056540773 shutdown_connections 2024-09-21T00:13:42.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.360+0000 7f59c2a00640 1 --2- 172.21.15.83:0/2056540773 >> v2:172.21.15.83:3300/0 conn(0x7f59bc074280 0x7f59bc074690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.360+0000 7f59c2a00640 1 --2- 172.21.15.83:0/2056540773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59bc06ddf0 0x7f59bc06e200 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.360+0000 7f59c2a00640 1 -- 172.21.15.83:0/2056540773 >> 172.21.15.83:0/2056540773 conn(0x7f59bc0b1b90 msgr2=0x7f59bc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.360+0000 7f96f2600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96ec074820 0x7f96ec14c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.361+0000 7f59c2a00640 1 -- 172.21.15.83:0/2056540773 shutdown_connections 2024-09-21T00:13:42.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.361+0000 7f96ebe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96ec074820 0x7f96ec14c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.361+0000 7f96ebe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96ec074820 0x7f96ec14c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52394/0 (socket says 172.21.15.83:52394) 2024-09-21T00:13:42.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.361+0000 7f96f1200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96ec0709e0 0x7f96ec139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.361+0000 7f96f1200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96ec0709e0 0x7f96ec139d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:35664/0 (socket says 172.21.15.83:35664) 2024-09-21T00:13:42.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.361+0000 7f96ebe00640 1 -- 172.21.15.83:0/2741065870 learned_addr learned my addr 172.21.15.83:0/2741065870 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:42.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.361+0000 7f96f2600640 1 --2- 172.21.15.83:0/2741065870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96ec15ed20 0x7f96ec1403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.361+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec06d4a0 con 0x7f96ec074820 2024-09-21T00:13:42.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.362+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec06d320 con 0x7f96ec0709e0 2024-09-21T00:13:42.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.362+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f96ec06d620 con 0x7f96ec15ed20 2024-09-21T00:13:42.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.362+0000 7f96f1c00640 1 --2- 172.21.15.83:0/2741065870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96ec15ed20 0x7f96ec1403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.368+0000 7f96ebe00640 1 -- 172.21.15.83:0/2741065870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96ec15ed20 msgr2=0x7f96ec1403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.368+0000 7f96ebe00640 1 --2- 172.21.15.83:0/2741065870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96ec15ed20 0x7f96ec1403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.368+0000 7f96ebe00640 1 -- 172.21.15.83:0/2741065870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96ec0709e0 msgr2=0x7f96ec139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.368+0000 7f96ebe00640 1 --2- 172.21.15.83:0/2741065870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96ec0709e0 0x7f96ec139d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.368+0000 7f96ebe00640 1 -- 172.21.15.83:0/2741065870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec158700 con 0x7f96ec074820 2024-09-21T00:13:42.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.368+0000 7f96ebe00640 1 --2- 172.21.15.83:0/2741065870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96ec074820 0x7f96ec14c8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f96d800ca10 tx=0x7f96d800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:42.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.369+0000 7f96e8c00640 1 -- 172.21.15.83:0/2741065870 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8007c70 con 0x7f96ec074820 2024-09-21T00:13:42.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.369+0000 7f96e8c00640 1 -- 172.21.15.83:0/2741065870 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f96d8004020 con 0x7f96ec074820 2024-09-21T00:13:42.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.370+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ec13f340 con 0x7f96ec074820 2024-09-21T00:13:42.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.370+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ec13f900 con 0x7f96ec074820 2024-09-21T00:13:42.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.361+0000 7f59c2a00640 1 -- 172.21.15.83:0/2056540773 wait complete. 2024-09-21T00:13:42.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.371+0000 7f59c2a00640 1 Processor -- start 2024-09-21T00:13:42.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.371+0000 7f59c2a00640 1 -- start start 2024-09-21T00:13:42.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.375+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ec06ab30 con 0x7f96ec074820 2024-09-21T00:13:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.381+0000 7f59c2a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59bc06ddf0 0x7f59bc0b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.381+0000 7f59c2a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59bc074280 0x7f59bc155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.381+0000 7f59c2a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59bc156c30 0x7f59bc156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.382+0000 7f59c0a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59bc156c30 0x7f59bc156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.382+0000 7f59c0a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59bc156c30 0x7f59bc156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:35676/0 (socket says 172.21.15.83:35676) 2024-09-21T00:13:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.382+0000 7f59c0a00640 1 -- 172.21.15.83:0/2315479469 learned_addr learned my addr 172.21.15.83:0/2315479469 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.382+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc074d50 con 0x7f59bc074280 2024-09-21T00:13:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.382+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc074bd0 con 0x7f59bc156c30 2024-09-21T00:13:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.382+0000 7f59bbe00640 1 --2- 172.21.15.83:0/2315479469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59bc06ddf0 0x7f59bc0b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.382+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f59bc074ed0 con 0x7f59bc06ddf0 2024-09-21T00:13:42.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.381+0000 7f96e8c00640 1 -- 172.21.15.83:0/2741065870 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8004450 con 0x7f96ec074820 2024-09-21T00:13:42.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.383+0000 7f59c0a00640 1 -- 172.21.15.83:0/2315479469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59bc06ddf0 msgr2=0x7f59bc0b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.383+0000 7f59c0a00640 1 --2- 172.21.15.83:0/2315479469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59bc06ddf0 0x7f59bc0b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.383+0000 7f59c0a00640 1 -- 172.21.15.83:0/2315479469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59bc074280 msgr2=0x7f59bc155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.383+0000 7f59c0a00640 1 --2- 172.21.15.83:0/2315479469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59bc074280 0x7f59bc155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.383+0000 7f59c0a00640 1 -- 172.21.15.83:0/2315479469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59bc0c3ed0 con 0x7f59bc156c30 2024-09-21T00:13:42.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.384+0000 7f96e8c00640 1 -- 172.21.15.83:0/2741065870 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f96d8003980 con 0x7f96ec074820 2024-09-21T00:13:42.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.385+0000 7f96e8c00640 1 -- 172.21.15.83:0/2741065870 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f96d8022db0 con 0x7f96ec074820 2024-09-21T00:13:42.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.385+0000 7f59c0a00640 1 --2- 172.21.15.83:0/2315479469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59bc156c30 0x7f59bc156030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00d650 tx=0x7f59ac00db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:42.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.390+0000 7f96e8c00640 1 -- 172.21.15.83:0/2741065870 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f96ec06ab30 con 0x7f96ec074820 2024-09-21T00:13:42.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.413+0000 7fca6f200640 1 -- 172.21.15.83:0/2712378447 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fca6804f930 con 0x7fca68054c70 2024-09-21T00:13:42.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.420+0000 7f59b3e00640 1 -- 172.21.15.83:0/2315479469 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac017070 con 0x7f59bc156c30 2024-09-21T00:13:42.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.420+0000 7f59b3e00640 1 -- 172.21.15.83:0/2315479469 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f59ac005220 con 0x7f59bc156c30 2024-09-21T00:13:42.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.420+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59bc0c41b0 con 0x7f59bc156c30 2024-09-21T00:13:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.420+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59bc0c4770 con 0x7f59bc156c30 2024-09-21T00:13:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.422+0000 7f59b3e00640 1 -- 172.21.15.83:0/2315479469 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac005650 con 0x7f59bc156c30 2024-09-21T00:13:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.422+0000 7fca66000640 1 -- 172.21.15.83:0/2712378447 <== mon.2 v2:172.21.15.142:3301/0 10 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca60053020 con 0x7fca68054c70 2024-09-21T00:13:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.424+0000 7f42a3400640 1 -- 172.21.15.83:0/1172721356 <== mon.2 v2:172.21.15.142:3301/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42a4031020 con 0x7f42900039e0 2024-09-21T00:13:42.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.429+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5994005290 con 0x7f59bc156c30 2024-09-21T00:13:42.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.426+0000 7f59b3e00640 1 -- 172.21.15.83:0/2315479469 <== mon.1 v2:172.21.15.142:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59ac009910 con 0x7f59bc156c30 2024-09-21T00:13:42.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.429+0000 7fca66000640 1 -- 172.21.15.83:0/2712378447 <== mon.2 v2:172.21.15.142:3301/0 11 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fca600448e0 con 0x7fca68054c70 2024-09-21T00:13:42.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.431+0000 7f59b3e00640 1 -- 172.21.15.83:0/2315479469 <== mon.1 v2:172.21.15.142:3300/0 5 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f59ac009ac0 con 0x7f59bc156c30 2024-09-21T00:13:42.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.431+0000 7f59b3e00640 1 -- 172.21.15.83:0/2315479469 <== mon.1 v2:172.21.15.142:3300/0 6 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f59ac0108e0 con 0x7f59bc156c30 2024-09-21T00:13:42.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.433+0000 7fc0e6000640 1 -- 172.21.15.83:0/4199361340 <== mon.0 v2:172.21.15.83:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0e00193b0 con 0x7fc0f006d2b0 2024-09-21T00:13:42.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.437+0000 7fca6f200640 1 -- 172.21.15.83:0/2712378447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68054c70 msgr2=0x7fca680332a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.437+0000 7fca6f200640 1 --2- 172.21.15.83:0/2712378447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68054c70 0x7fca680332a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fca60031000 tx=0x7fca600046c0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.439+0000 7f6c79e00640 1 -- 172.21.15.83:0/1674358112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c58003ac0 msgr2=0x7f6c58003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.439+0000 7f6c79e00640 1 --2- 172.21.15.83:0/1674358112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c58003ac0 0x7f6c58003f50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c64006fd0 tx=0x7f6c58005830 comp rx=0 tx=0).stop 2024-09-21T00:13:42.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.443+0000 7f96e8c00640 1 -- 172.21.15.83:0/2741065870 <== mon.0 v2:172.21.15.83:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96d8003e00 con 0x7f96ec074820 2024-09-21T00:13:42.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.444+0000 7f59b3e00640 1 -- 172.21.15.83:0/2315479469 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f59ac010b30 con 0x7f59bc156c30 2024-09-21T00:13:42.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.447+0000 7f6c73e00640 1 -- 172.21.15.83:0/1674358112 reap_dead start 2024-09-21T00:13:42.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.447+0000 7f6c79e00640 1 -- 172.21.15.83:0/1674358112 shutdown_connections 2024-09-21T00:13:42.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.447+0000 7f6c79e00640 1 -- 172.21.15.83:0/1674358112 >> 172.21.15.83:0/1674358112 conn(0x7f6c740d0ee0 msgr2=0x7f6c740d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.447+0000 7f6c79e00640 1 -- 172.21.15.83:0/1674358112 shutdown_connections 2024-09-21T00:13:42.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.451+0000 7fca6f200640 1 -- 172.21.15.83:0/2712378447 shutdown_connections 2024-09-21T00:13:42.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.451+0000 7fca6f200640 1 --2- 172.21.15.83:0/2712378447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca680337e0 0x7fca68031290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.451+0000 7fca6f200640 1 --2- 172.21.15.83:0/2712378447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68054c70 0x7fca680332a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.451+0000 7fca6f200640 1 --2- 172.21.15.83:0/2712378447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca68006140 0x7fca6804ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.451+0000 7fca6f200640 1 -- 172.21.15.83:0/2712378447 >> 172.21.15.83:0/2712378447 conn(0x7fca6801d9a0 msgr2=0x7fca6804a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.448+0000 7f6c79e00640 1 -- 172.21.15.83:0/1674358112 wait complete. 2024-09-21T00:13:42.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.455+0000 7f6c79e00640 1 Processor -- start 2024-09-21T00:13:42.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.455+0000 7f6c79e00640 1 -- start start 2024-09-21T00:13:42.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.458+0000 7fca6f200640 1 -- 172.21.15.83:0/2712378447 shutdown_connections 2024-09-21T00:13:42.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.458+0000 7fca6f200640 1 -- 172.21.15.83:0/2712378447 wait complete. 2024-09-21T00:13:42.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.462+0000 7f6c79e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c741f5530 0x7f6c740c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.463+0000 7f6c79e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c741f65b0 0x7f6c741f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.463+0000 7f6c72a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c741f5530 0x7f6c740c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.463+0000 7f6c72a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c741f5530 0x7f6c740c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:35692/0 (socket says 172.21.15.83:35692) 2024-09-21T00:13:42.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.463+0000 7f6c72a00640 1 -- 172.21.15.83:0/2478186676 learned_addr learned my addr 172.21.15.83:0/2478186676 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:42.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.464+0000 7f6c79e00640 1 --2- 172.21.15.83:0/2478186676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c74205ea0 0x7f6c742062b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.464+0000 7f6c72000640 1 --2- 172.21.15.83:0/2478186676 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c741f65b0 0x7f6c741f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.469+0000 7f6c73e00640 1 --2- 172.21.15.83:0/2478186676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c74205ea0 0x7f6c742062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.469+0000 7f6c79e00640 1 -- 172.21.15.83:0/2478186676 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740b38a0 con 0x7f6c741f65b0 2024-09-21T00:13:42.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.469+0000 7f6c79e00640 1 -- 172.21.15.83:0/2478186676 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740b3720 con 0x7f6c741f5530 2024-09-21T00:13:42.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.469+0000 7f6c79e00640 1 -- 172.21.15.83:0/2478186676 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6c740b3a20 con 0x7f6c74205ea0 2024-09-21T00:13:42.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.471+0000 7f6c72000640 1 -- 172.21.15.83:0/2478186676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c74205ea0 msgr2=0x7f6c742062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.471+0000 7f6c72000640 1 --2- 172.21.15.83:0/2478186676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c74205ea0 0x7f6c742062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.471+0000 7f6c72000640 1 -- 172.21.15.83:0/2478186676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c741f5530 msgr2=0x7f6c740c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.471+0000 7f6c72000640 1 --2- 172.21.15.83:0/2478186676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c741f5530 0x7f6c740c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.471+0000 7f6c72000640 1 -- 172.21.15.83:0/2478186676 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c741f6f00 con 0x7f6c741f65b0 2024-09-21T00:13:42.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.472+0000 7f6c72000640 1 --2- 172.21.15.83:0/2478186676 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c741f65b0 0x7f6c741f69c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000b3e0 tx=0x7f6c6000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:42.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.474+0000 7f6c6b400640 1 -- 172.21.15.83:0/2478186676 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60015020 con 0x7f6c741f65b0 2024-09-21T00:13:42.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.474+0000 7f6c6b400640 1 -- 172.21.15.83:0/2478186676 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c60011940 con 0x7f6c741f65b0 2024-09-21T00:13:42.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.474+0000 7f6c79e00640 1 -- 172.21.15.83:0/2478186676 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c74204c40 con 0x7f6c741f65b0 2024-09-21T00:13:42.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.475+0000 7f6c79e00640 1 -- 172.21.15.83:0/2478186676 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c74205200 con 0x7f6c741f65b0 2024-09-21T00:13:42.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.482+0000 7f6c68c00640 1 -- 172.21.15.83:0/2478186676 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c740b6d20 con 0x7f6c741f65b0 2024-09-21T00:13:42.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.488+0000 7f6c6b400640 1 -- 172.21.15.83:0/2478186676 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60011d90 con 0x7f6c741f65b0 2024-09-21T00:13:42.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.488+0000 7f6c6b400640 1 -- 172.21.15.83:0/2478186676 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c60018020 con 0x7f6c741f65b0 2024-09-21T00:13:42.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.488+0000 7f6c6b400640 1 -- 172.21.15.83:0/2478186676 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6c60019920 con 0x7f6c741f65b0 2024-09-21T00:13:42.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.491+0000 7f6c6b400640 1 -- 172.21.15.83:0/2478186676 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6c740b6d20 con 0x7f6c741f65b0 2024-09-21T00:13:42.554 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.601+0000 7f42b1200640 1 -- 172.21.15.83:0/1172721356 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f42ac0b4c10 con 0x7f42900039e0 2024-09-21T00:13:42.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.625+0000 7fc7f3200640 1 -- 172.21.15.83:0/1413144572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7ec0df180 msgr2=0x7fc7ec005c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.625+0000 7fc7f3200640 1 --2- 172.21.15.83:0/1413144572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7ec0df180 0x7fc7ec005c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc7f406c0e0 tx=0x7fc7f40a63c0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.627+0000 7f42a3400640 1 -- 172.21.15.83:0/1172721356 <== mon.2 v2:172.21.15.142:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f42ac15edf0 con 0x7f42900039e0 2024-09-21T00:13:42.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.627+0000 7fc7f3200640 1 -- 172.21.15.83:0/1413144572 shutdown_connections 2024-09-21T00:13:42.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.627+0000 7fc7f3200640 1 --2- 172.21.15.83:0/1413144572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7ec0df180 0x7fc7ec005c60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.627+0000 7fc7f3200640 1 -- 172.21.15.83:0/1413144572 >> 172.21.15.83:0/1413144572 conn(0x7fc7ec051420 msgr2=0x7fc7ec051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.627+0000 7fc7f3200640 1 -- 172.21.15.83:0/1413144572 shutdown_connections 2024-09-21T00:13:42.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.631+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fc0f00b7250 con 0x7fc0f006d2b0 2024-09-21T00:13:42.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.634+0000 7f42b1200640 1 -- 172.21.15.83:0/1172721356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42900039e0 msgr2=0x7f42ac1418e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.634+0000 7f42b1200640 1 --2- 172.21.15.83:0/1172721356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42900039e0 0x7f42ac1418e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42a4001cc0 tx=0x7f42a40012e0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.635+0000 7f42b1200640 1 -- 172.21.15.83:0/1172721356 shutdown_connections 2024-09-21T00:13:42.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.635+0000 7f42b1200640 1 --2- 172.21.15.83:0/1172721356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42ac14b880 0x7f42ac15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.635+0000 7f42b1200640 1 --2- 172.21.15.83:0/1172721356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42ac15e610 0x7f42ac14d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.635+0000 7f42b1200640 1 --2- 172.21.15.83:0/1172721356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42900039e0 0x7f42ac1418e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.635+0000 7f42b1200640 1 -- 172.21.15.83:0/1172721356 >> 172.21.15.83:0/1172721356 conn(0x7f42ac0cfec0 msgr2=0x7f42ac0b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.639+0000 7f42b1200640 1 -- 172.21.15.83:0/1172721356 shutdown_connections 2024-09-21T00:13:42.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.640+0000 7f42b1200640 1 -- 172.21.15.83:0/1172721356 wait complete. 2024-09-21T00:13:42.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.639+0000 7fc0e6000640 1 -- 172.21.15.83:0/4199361340 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7fc0e0019b30 con 0x7fc0f006d2b0 2024-09-21T00:13:42.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.631+0000 7fc7f3200640 1 -- 172.21.15.83:0/1413144572 wait complete. 2024-09-21T00:13:42.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.643+0000 7fc7f3200640 1 Processor -- start 2024-09-21T00:13:42.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.646+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0f006d2b0 msgr2=0x7fc0f01fa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.646+0000 7fc0ef200640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0f006d2b0 0x7fc0f01fa1a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000b3e0 tx=0x7fc0e000b8a0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.644+0000 7fc7f3200640 1 -- start start 2024-09-21T00:13:42.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.646+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 shutdown_connections 2024-09-21T00:13:42.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.646+0000 7fc0ef200640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0f01621d0 0x7fc0f0153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.646+0000 7fc0ef200640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f015ebe0 0x7fc0f014dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.646+0000 7fc0ef200640 1 --2- 172.21.15.83:0/4199361340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0f006d2b0 0x7fc0f01fa1a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.646+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 >> 172.21.15.83:0/4199361340 conn(0x7fc0f00d1960 msgr2=0x7fc0f00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.650+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 shutdown_connections 2024-09-21T00:13:42.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.650+0000 7fc0ef200640 1 -- 172.21.15.83:0/4199361340 wait complete. 2024-09-21T00:13:42.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.661+0000 7fc7f3200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7ec009ba0 0x7fc7ec0e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.661+0000 7fc7f3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7ec0df180 0x7fc7ec020f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.661+0000 7fc7f3200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7ec043050 0x7fc7ec043460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.662+0000 7fc7f1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7ec009ba0 0x7fc7ec0e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.662+0000 7fc7f1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7ec009ba0 0x7fc7ec0e1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:40818/0 (socket says 172.21.15.83:40818) 2024-09-21T00:13:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.666+0000 7fc7f1e00640 1 -- 172.21.15.83:0/2363499895 learned_addr learned my addr 172.21.15.83:0/2363499895 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.667+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f96ec06da80 con 0x7f96ec074820 2024-09-21T00:13:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.668+0000 7fc7f2800640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7ec043050 0x7fc7ec043460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.670+0000 7fc7f3200640 1 -- 172.21.15.83:0/2363499895 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec00bdb0 con 0x7fc7ec043050 2024-09-21T00:13:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.670+0000 7fc7f1400640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7ec0df180 0x7fc7ec020f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.670+0000 7fc7f3200640 1 -- 172.21.15.83:0/2363499895 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec00bc30 con 0x7fc7ec0df180 2024-09-21T00:13:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.670+0000 7fc7f3200640 1 -- 172.21.15.83:0/2363499895 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ec006d70 con 0x7fc7ec009ba0 2024-09-21T00:13:42.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.675+0000 7fc7f1e00640 1 -- 172.21.15.83:0/2363499895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7ec0df180 msgr2=0x7fc7ec020f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.675+0000 7fc7f1e00640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7ec0df180 0x7fc7ec020f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.675+0000 7fc7f1e00640 1 -- 172.21.15.83:0/2363499895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7ec043050 msgr2=0x7fc7ec043460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.675+0000 7fc7f1e00640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7ec043050 0x7fc7ec043460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.675+0000 7fc7f1e00640 1 -- 172.21.15.83:0/2363499895 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec0e2190 con 0x7fc7ec009ba0 2024-09-21T00:13:42.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.677+0000 7fc7f1400640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7ec0df180 0x7fc7ec020f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:13:42.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.677+0000 7fc7f2800640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7ec043050 0x7fc7ec043460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:13:42.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.681+0000 7fc7f1e00640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7ec009ba0 0x7fc7ec0e1710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c3c0 tx=0x7fc7e400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:42.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.681+0000 7fc7ea000640 1 -- 172.21.15.83:0/2363499895 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4017070 con 0x7fc7ec009ba0 2024-09-21T00:13:42.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.681+0000 7fc7ea000640 1 -- 172.21.15.83:0/2363499895 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7e40035f0 con 0x7fc7ec009ba0 2024-09-21T00:13:42.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.681+0000 7fc7f3200640 1 -- 172.21.15.83:0/2363499895 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ec0e2470 con 0x7fc7ec009ba0 2024-09-21T00:13:42.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.682+0000 7fc7f3200640 1 -- 172.21.15.83:0/2363499895 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ec0e1c50 con 0x7fc7ec009ba0 2024-09-21T00:13:42.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.682+0000 7fc7ea000640 1 -- 172.21.15.83:0/2363499895 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4003a20 con 0x7fc7ec009ba0 2024-09-21T00:13:42.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.685+0000 7f96e8c00640 1 -- 172.21.15.83:0/2741065870 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v9)=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7f96d8014030 con 0x7f96ec074820 2024-09-21T00:13:42.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.685+0000 7fc7f3200640 1 -- 172.21.15.83:0/2363499895 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7cc005290 con 0x7fc7ec009ba0 2024-09-21T00:13:42.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.688+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96ec074820 msgr2=0x7f96ec14c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.688+0000 7fc7ea000640 1 -- 172.21.15.83:0/2363499895 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc7e401a070 con 0x7fc7ec009ba0 2024-09-21T00:13:42.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.689+0000 7f96f2600640 1 --2- 172.21.15.83:0/2741065870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96ec074820 0x7f96ec14c8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f96d800ca10 tx=0x7f96d800ced0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.689+0000 7fc7ea000640 1 -- 172.21.15.83:0/2363499895 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc7e4012740 con 0x7fc7ec009ba0 2024-09-21T00:13:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.691+0000 7fc7ea000640 1 -- 172.21.15.83:0/2363499895 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc7e4021020 con 0x7fc7ec009ba0 2024-09-21T00:13:42.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.697+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 shutdown_connections 2024-09-21T00:13:42.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.697+0000 7f96f2600640 1 --2- 172.21.15.83:0/2741065870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96ec15ed20 0x7f96ec1403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.697+0000 7f96f2600640 1 --2- 172.21.15.83:0/2741065870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96ec074820 0x7f96ec14c8c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.697+0000 7f96f2600640 1 --2- 172.21.15.83:0/2741065870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96ec0709e0 0x7f96ec139d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.697+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 >> 172.21.15.83:0/2741065870 conn(0x7f96ec0cfec0 msgr2=0x7f96ec0b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.721+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 shutdown_connections 2024-09-21T00:13:42.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.721+0000 7f96f2600640 1 -- 172.21.15.83:0/2741065870 wait complete. 2024-09-21T00:13:42.732 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.750+0000 7fbd0b400640 1 -- 172.21.15.83:0/2233167801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcfc0384f0 msgr2=0x7fbcfc038900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.751+0000 7fbd03400640 1 -- 172.21.15.83:0/2233167801 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd040b3070 con 0x7fbcfc0384f0 2024-09-21T00:13:42.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.751+0000 7fbd0b400640 1 --2- 172.21.15.83:0/2233167801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcfc0384f0 0x7fbcfc038900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbd0407ad70 tx=0x7fbd040a6390 comp rx=0 tx=0).stop 2024-09-21T00:13:42.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.753+0000 7fbd0b400640 1 -- 172.21.15.83:0/2233167801 shutdown_connections 2024-09-21T00:13:42.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.753+0000 7fbd0b400640 1 --2- 172.21.15.83:0/2233167801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcfc0363e0 0x7fbcfc0367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.753+0000 7fbd0b400640 1 --2- 172.21.15.83:0/2233167801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcfc0384f0 0x7fbcfc038900 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.753+0000 7fbd0b400640 1 -- 172.21.15.83:0/2233167801 >> 172.21.15.83:0/2233167801 conn(0x7fbcfc0515c0 msgr2=0x7fbcfc0519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.753+0000 7fbd0b400640 1 -- 172.21.15.83:0/2233167801 shutdown_connections 2024-09-21T00:13:42.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.755+0000 7fbd0b400640 1 -- 172.21.15.83:0/2233167801 wait complete. 2024-09-21T00:13:42.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.762+0000 7fbd0b400640 1 Processor -- start 2024-09-21T00:13:42.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.769+0000 7fbd0b400640 1 -- start start 2024-09-21T00:13:42.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.771+0000 7fbd0b400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc009e00 0x7fbcfc17b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.779+0000 7fbd08a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc009e00 0x7fbcfc17b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.779+0000 7fbd08a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc009e00 0x7fbcfc17b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52444/0 (socket says 172.21.15.83:52444) 2024-09-21T00:13:42.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.779+0000 7fbd08a00640 1 -- 172.21.15.83:0/1760883864 learned_addr learned my addr 172.21.15.83:0/1760883864 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:42.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.779+0000 7fbd0b400640 1 --2- 172.21.15.83:0/1760883864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcfc0363e0 0x7fbcfc021c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.779+0000 7fbd0b400640 1 --2- 172.21.15.83:0/1760883864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcfc0384f0 0x7fbcfc0353e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.784 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.786+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc038e40 con 0x7fbcfc009e00 2024-09-21T00:13:42.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.786+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc0e7900 con 0x7fbcfc0363e0 2024-09-21T00:13:42.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.786+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbcfc038fc0 con 0x7fbcfc0384f0 2024-09-21T00:13:42.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.792+0000 7fbd08a00640 1 -- 172.21.15.83:0/1760883864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcfc0384f0 msgr2=0x7fbcfc0353e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T00:13:42.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.792+0000 7fbd08a00640 1 --2- 172.21.15.83:0/1760883864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcfc0384f0 0x7fbcfc0353e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.792+0000 7fbd08a00640 1 -- 172.21.15.83:0/1760883864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcfc0363e0 msgr2=0x7fbcfc021c10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T00:13:42.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.792+0000 7fbd08a00640 1 --2- 172.21.15.83:0/1760883864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcfc0363e0 0x7fbcfc021c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.793+0000 7fbd08a00640 1 -- 172.21.15.83:0/1760883864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcfc182640 con 0x7fbcfc009e00 2024-09-21T00:13:42.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.794+0000 7fbd08a00640 1 --2- 172.21.15.83:0/1760883864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc009e00 0x7fbcfc17b710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800c3c0 tx=0x7fbcf800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:42.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.796+0000 7fbd00c00640 1 -- 172.21.15.83:0/1760883864 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8011790 con 0x7fbcfc009e00 2024-09-21T00:13:42.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.796+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcfc17e390 con 0x7fbcfc009e00 2024-09-21T00:13:42.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.796+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcfc17e950 con 0x7fbcfc009e00 2024-09-21T00:13:42.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.800+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcfc0e3190 con 0x7fbcfc009e00 2024-09-21T00:13:42.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.804+0000 7fbd00c00640 1 -- 172.21.15.83:0/1760883864 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcf8017070 con 0x7fbcfc009e00 2024-09-21T00:13:42.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.804+0000 7fbd00c00640 1 -- 172.21.15.83:0/1760883864 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8011790 con 0x7fbcfc009e00 2024-09-21T00:13:42.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.806+0000 7fc8f2000640 1 -- 172.21.15.83:0/2768243639 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4004470 con 0x7fc8dc0053f0 2024-09-21T00:13:42.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.808+0000 7f71d3e00640 1 -- 172.21.15.83:0/561687643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71d40aef90 msgr2=0x7f71d4070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.808+0000 7f71d3e00640 1 --2- 172.21.15.83:0/561687643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71d40aef90 0x7f71d4070230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71c4005fd0 tx=0x7f71c402a540 comp rx=0 tx=0).stop 2024-09-21T00:13:42.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.810+0000 7fc8fa800640 1 -- 172.21.15.83:0/2768243639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8dc0053f0 msgr2=0x7fc8dc00ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.810+0000 7fc8fa800640 1 --2- 172.21.15.83:0/2768243639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8dc0053f0 0x7fc8dc00ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40099a0 tx=0x7fc8dc005830 comp rx=0 tx=0).stop 2024-09-21T00:13:42.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.810+0000 7fc8fa800640 1 -- 172.21.15.83:0/2768243639 shutdown_connections 2024-09-21T00:13:42.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.810+0000 7fc8fa800640 1 --2- 172.21.15.83:0/2768243639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8dc0053f0 0x7fc8dc00ba80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.810+0000 7fc8fa800640 1 -- 172.21.15.83:0/2768243639 >> 172.21.15.83:0/2768243639 conn(0x7fc8ec051440 msgr2=0x7fc8ec051880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.811+0000 7fc8fa800640 1 -- 172.21.15.83:0/2768243639 shutdown_connections 2024-09-21T00:13:42.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.811+0000 7fc8fa800640 1 -- 172.21.15.83:0/2768243639 wait complete. 2024-09-21T00:13:42.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.814+0000 7f71d3e00640 1 -- 172.21.15.83:0/561687643 shutdown_connections 2024-09-21T00:13:42.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.814+0000 7f71d3e00640 1 --2- 172.21.15.83:0/561687643 >> v2:172.21.15.83:3300/0 conn(0x7f71d4070770 0x7f71d4155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.814+0000 7f71d3e00640 1 --2- 172.21.15.83:0/561687643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71d40aef90 0x7f71d4070230 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.814+0000 7f71d3e00640 1 -- 172.21.15.83:0/561687643 >> 172.21.15.83:0/561687643 conn(0x7f71d40cfec0 msgr2=0x7f71d40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.816+0000 7f71d3e00640 1 -- 172.21.15.83:0/561687643 shutdown_connections 2024-09-21T00:13:42.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.817+0000 7f71d3e00640 1 -- 172.21.15.83:0/561687643 wait complete. 2024-09-21T00:13:42.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.819+0000 7fbd00c00640 1 -- 172.21.15.83:0/1760883864 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbcf8011ac0 con 0x7fbcfc009e00 2024-09-21T00:13:42.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.819+0000 7fbd00c00640 1 -- 172.21.15.83:0/1760883864 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbcf8012420 con 0x7fbcfc009e00 2024-09-21T00:13:42.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.819+0000 7fbd00c00640 1 -- 172.21.15.83:0/1760883864 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbcfc036d30 con 0x7fbcfc009e00 2024-09-21T00:13:42.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.825+0000 7fc8fa800640 1 Processor -- start 2024-09-21T00:13:42.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.827+0000 7f71d3e00640 1 Processor -- start 2024-09-21T00:13:42.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.832+0000 7f71d3e00640 1 -- start start 2024-09-21T00:13:42.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.826+0000 7fc8fa800640 1 -- start start 2024-09-21T00:13:42.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.824+0000 7f6c68c00640 1 -- 172.21.15.83:0/2478186676 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f6c740cf310 con 0x7f6c741f65b0 2024-09-21T00:13:42.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.838+0000 7f71d3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d406dc40 0x7f71d414e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.838+0000 7f71d3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71d4070770 0x7f71d41fdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.838+0000 7f71d3e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71d40aef90 0x7f71d41f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.839+0000 7f71d3e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f71d40cddc0 con 0x7f71d406dc40 2024-09-21T00:13:42.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.839+0000 7f71d2000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71d4070770 0x7f71d41fdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.839+0000 7f71d3e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4155b20 con 0x7f71d4070770 2024-09-21T00:13:42.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.839+0000 7f71d3e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f71d40cdf40 con 0x7f71d40aef90 2024-09-21T00:13:42.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.839+0000 7f71d2a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d406dc40 0x7f71d414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.839+0000 7f71d2a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d406dc40 0x7f71d414e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52470/0 (socket says 172.21.15.83:52470) 2024-09-21T00:13:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.839+0000 7f71d2a00640 1 -- 172.21.15.83:0/3519971834 learned_addr learned my addr 172.21.15.83:0/3519971834 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:42.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.842+0000 7fc8fa800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec04a360 0x7fc8ec179f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.842+0000 7fc8fa800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8ec17a4d0 0x7fc8ec17a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.842+0000 7fc8f3400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec04a360 0x7fc8ec179f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.840+0000 7f71d2a00640 1 -- 172.21.15.83:0/3519971834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71d40aef90 msgr2=0x7f71d41f9e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T00:13:42.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.840+0000 7f71d2a00640 1 --2- 172.21.15.83:0/3519971834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71d40aef90 0x7f71d41f9e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.840+0000 7f71d2a00640 1 -- 172.21.15.83:0/3519971834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71d4070770 msgr2=0x7f71d41fdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.839+0000 7f71d2000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71d4070770 0x7f71d41fdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:35742/0 (socket says 172.21.15.83:35742) 2024-09-21T00:13:42.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.842+0000 7fc8f3400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec04a360 0x7fc8ec179f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:35752/0 (socket says 172.21.15.83:35752) 2024-09-21T00:13:42.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.843+0000 7f71d2a00640 1 --2- 172.21.15.83:0/3519971834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71d4070770 0x7f71d41fdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.843+0000 7f71d2a00640 1 -- 172.21.15.83:0/3519971834 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d40748e0 con 0x7f71d406dc40 2024-09-21T00:13:42.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.843+0000 7fc8f3400640 1 -- 172.21.15.83:0/2801327153 learned_addr learned my addr 172.21.15.83:0/2801327153 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:42.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.847+0000 7fc8fa800640 1 --2- 172.21.15.83:0/2801327153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ec048630 0x7fc8ec048a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.848+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec007480 con 0x7fc8ec17a4d0 2024-09-21T00:13:42.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.848+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec007300 con 0x7fc8ec04a360 2024-09-21T00:13:42.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.848+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ec052380 con 0x7fc8ec048630 2024-09-21T00:13:42.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.847+0000 7f71d2000640 1 --2- 172.21.15.83:0/3519971834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71d4070770 0x7f71d41fdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:13:42.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.848+0000 7fc8f3e00640 1 --2- 172.21.15.83:0/2801327153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ec048630 0x7fc8ec048a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.849+0000 7f71d2a00640 1 --2- 172.21.15.83:0/3519971834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d406dc40 0x7f71d414e010 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71c000b3e0 tx=0x7f71c000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:42.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.850+0000 7f6c6b400640 1 -- 172.21.15.83:0/2478186676 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f6c6001f020 con 0x7f6c741f65b0 2024-09-21T00:13:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.854+0000 7fc8f3e00640 1 -- 172.21.15.83:0/2801327153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec04a360 msgr2=0x7fc8ec179f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.854+0000 7fc8f3e00640 1 --2- 172.21.15.83:0/2801327153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec04a360 0x7fc8ec179f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.854+0000 7fc8f3e00640 1 -- 172.21.15.83:0/2801327153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8ec17a4d0 msgr2=0x7fc8ec17a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.854+0000 7fc8f3e00640 1 --2- 172.21.15.83:0/2801327153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8ec17a4d0 0x7fc8ec17a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.854+0000 7fc8f3e00640 1 -- 172.21.15.83:0/2801327153 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ec165160 con 0x7fc8ec048630 2024-09-21T00:13:42.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.854+0000 7fc8f3400640 1 --2- 172.21.15.83:0/2801327153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec04a360 0x7fc8ec179f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:13:42.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.854+0000 7f71caa00640 1 -- 172.21.15.83:0/3519971834 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0015020 con 0x7f71d406dc40 2024-09-21T00:13:42.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.855+0000 7f6c68c00640 1 -- 172.21.15.83:0/2478186676 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c741f65b0 msgr2=0x7f6c741f69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.855+0000 7f6c68c00640 1 --2- 172.21.15.83:0/2478186676 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c741f65b0 0x7f6c741f69c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000b3e0 tx=0x7f6c6000b8a0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.855+0000 7f6c68c00640 1 -- 172.21.15.83:0/2478186676 shutdown_connections 2024-09-21T00:13:42.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.855+0000 7f6c68c00640 1 --2- 172.21.15.83:0/2478186676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c74205ea0 0x7f6c742062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.855+0000 7f71d3e00640 1 -- 172.21.15.83:0/3519971834 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d4074bc0 con 0x7f71d406dc40 2024-09-21T00:13:42.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.855+0000 7f6c68c00640 1 --2- 172.21.15.83:0/2478186676 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c741f65b0 0x7f6c741f69c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.855+0000 7f6c68c00640 1 --2- 172.21.15.83:0/2478186676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c741f5530 0x7f6c740c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.855+0000 7f6c68c00640 1 -- 172.21.15.83:0/2478186676 >> 172.21.15.83:0/2478186676 conn(0x7f6c740d0ee0 msgr2=0x7f6c740b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.856+0000 7f6c68c00640 1 -- 172.21.15.83:0/2478186676 shutdown_connections 2024-09-21T00:13:42.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.857+0000 7f6c68c00640 1 -- 172.21.15.83:0/2478186676 wait complete. 2024-09-21T00:13:42.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.856+0000 7fc8f3e00640 1 --2- 172.21.15.83:0/2801327153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ec048630 0x7fc8ec048a40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec036420 tx=0x7fc8e4003800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.859+0000 7f71caa00640 1 -- 172.21.15.83:0/3519971834 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71c0011920 con 0x7f71d406dc40 2024-09-21T00:13:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.859+0000 7f71d3e00640 1 -- 172.21.15.83:0/3519971834 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d41fd560 con 0x7f71d406dc40 2024-09-21T00:13:42.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.859+0000 7f71caa00640 1 -- 172.21.15.83:0/3519971834 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0015020 con 0x7f71d406dc40 2024-09-21T00:13:42.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.863+0000 7fc8e3400640 1 -- 172.21.15.83:0/2801327153 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4032440 con 0x7fc8ec048630 2024-09-21T00:13:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.863+0000 7fc8e3400640 1 -- 172.21.15.83:0/2801327153 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8e40326d0 con 0x7fc8ec048630 2024-09-21T00:13:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.863+0000 7fc8e3400640 1 -- 172.21.15.83:0/2801327153 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4032b00 con 0x7fc8ec048630 2024-09-21T00:13:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.863+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8ec165440 con 0x7fc8ec048630 2024-09-21T00:13:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.863+0000 7fc8e3400640 1 -- 172.21.15.83:0/2801327153 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc8e403d7b0 con 0x7fc8ec048630 2024-09-21T00:13:42.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.865+0000 7f71caa00640 1 -- 172.21.15.83:0/3519971834 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f71c0018020 con 0x7f71d406dc40 2024-09-21T00:13:42.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.866+0000 7f71caa00640 1 -- 172.21.15.83:0/3519971834 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f71c0019660 con 0x7f71d406dc40 2024-09-21T00:13:42.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.867+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f5994005580 con 0x7f59bc156c30 2024-09-21T00:13:42.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.864+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8ec165a00 con 0x7fc8ec048630 2024-09-21T00:13:42.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.870+0000 7fc8e3400640 1 -- 172.21.15.83:0/2801327153 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc8e403b650 con 0x7fc8ec048630 2024-09-21T00:13:42.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.870+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8ec052820 con 0x7fc8ec048630 2024-09-21T00:13:42.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.870+0000 7f71d3e00640 1 -- 172.21.15.83:0/3519971834 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d40cfad0 con 0x7f71d406dc40 2024-09-21T00:13:42.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.876+0000 7fc8e3400640 1 -- 172.21.15.83:0/2801327153 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc8e403daa0 con 0x7fc8ec048630 2024-09-21T00:13:42.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.887+0000 7f71caa00640 1 -- 172.21.15.83:0/3519971834 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f71c001f020 con 0x7f71d406dc40 2024-09-21T00:13:42.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.896+0000 7f59b3e00640 1 -- 172.21.15.83:0/2315479469 <== mon.1 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v11)=0 v11) ==== 106+0+0 (secure 0 0 0) 0x7f59ac010d10 con 0x7f59bc156c30 2024-09-21T00:13:42.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.898+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59bc156c30 msgr2=0x7f59bc156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.898+0000 7f59c2a00640 1 --2- 172.21.15.83:0/2315479469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59bc156c30 0x7f59bc156030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00d650 tx=0x7f59ac00db10 comp rx=0 tx=0).stop 2024-09-21T00:13:42.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.900+0000 7f022ca00640 1 -- 172.21.15.83:0/24176920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0220050a10 msgr2=0x7f0220050fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f022ca00640 1 --2- 172.21.15.83:0/24176920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0220050a10 0x7f0220050fd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0228052020 tx=0x7f02280a7000 comp rx=0 tx=0).stop 2024-09-21T00:13:42.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f022ca00640 1 -- 172.21.15.83:0/24176920 shutdown_connections 2024-09-21T00:13:42.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f022ca00640 1 --2- 172.21.15.83:0/24176920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0220050a10 0x7f0220050fd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f022ca00640 1 --2- 172.21.15.83:0/24176920 >> v2:172.21.15.142:3300/0 conn(0x7f0220034420 0x7f02200504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f022ca00640 1 -- 172.21.15.83:0/24176920 >> 172.21.15.83:0/24176920 conn(0x7f022001d9c0 msgr2=0x7f0220039680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f022ca00640 1 -- 172.21.15.83:0/24176920 shutdown_connections 2024-09-21T00:13:42.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f022ca00640 1 -- 172.21.15.83:0/24176920 wait complete. 2024-09-21T00:13:42.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 shutdown_connections 2024-09-21T00:13:42.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f59c2a00640 1 --2- 172.21.15.83:0/2315479469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59bc156c30 0x7f59bc156030 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f59c2a00640 1 --2- 172.21.15.83:0/2315479469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59bc074280 0x7f59bc155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f59c2a00640 1 --2- 172.21.15.83:0/2315479469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59bc06ddf0 0x7f59bc0b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 >> 172.21.15.83:0/2315479469 conn(0x7f59bc0b1b90 msgr2=0x7f59bc0afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 shutdown_connections 2024-09-21T00:13:42.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.902+0000 7f59c2a00640 1 -- 172.21.15.83:0/2315479469 wait complete. 2024-09-21T00:13:42.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.915+0000 7f022ca00640 1 Processor -- start 2024-09-21T00:13:42.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.919+0000 7f022ca00640 1 -- start start 2024-09-21T00:13:42.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.926+0000 7f022ca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0220034420 0x7f0220176750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.926+0000 7f022ca00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0220050a10 0x7f0220053da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.931+0000 7f0225e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0220034420 0x7f0220176750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.931+0000 7f0225e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0220034420 0x7f0220176750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:35778/0 (socket says 172.21.15.83:35778) 2024-09-21T00:13:42.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.931+0000 7f0225e00640 1 -- 172.21.15.83:0/740383181 learned_addr learned my addr 172.21.15.83:0/740383181 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:42.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.931+0000 7f022ca00640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02200df3d0 0x7f022016bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:42.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.931+0000 7f022ca00640 1 -- 172.21.15.83:0/740383181 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0220039f10 con 0x7f0220050a10 2024-09-21T00:13:42.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.932+0000 7f0226800640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02200df3d0 0x7f022016bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.932+0000 7f022ca00640 1 -- 172.21.15.83:0/740383181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0220039d90 con 0x7f0220034420 2024-09-21T00:13:42.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.932+0000 7f022ca00640 1 -- 172.21.15.83:0/740383181 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0220051510 con 0x7f02200df3d0 2024-09-21T00:13:42.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.933+0000 7f0225400640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0220050a10 0x7f0220053da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:42.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.937+0000 7f0226800640 1 -- 172.21.15.83:0/740383181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0220034420 msgr2=0x7f0220176750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.937+0000 7f0226800640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0220034420 0x7f0220176750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.937+0000 7f0226800640 1 -- 172.21.15.83:0/740383181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0220050a10 msgr2=0x7f0220053da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.937+0000 7f0226800640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0220050a10 0x7f0220053da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.937+0000 7f0226800640 1 -- 172.21.15.83:0/740383181 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0220168750 con 0x7f02200df3d0 2024-09-21T00:13:42.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.937+0000 7f0225400640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0220050a10 0x7f0220053da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:13:42.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.938+0000 7f0226800640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02200df3d0 0x7f022016bd50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f022806bcf0 tx=0x7f0228072440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:42.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.940+0000 7f021e000640 1 -- 172.21.15.83:0/740383181 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228072530 con 0x7f02200df3d0 2024-09-21T00:13:42.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.940+0000 7f021e000640 1 -- 172.21.15.83:0/740383181 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02280727c0 con 0x7f02200df3d0 2024-09-21T00:13:42.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.940+0000 7f021e000640 1 -- 172.21.15.83:0/740383181 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02280702a0 con 0x7f02200df3d0 2024-09-21T00:13:42.942 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.942 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.940+0000 7f022ca00640 1 -- 172.21.15.83:0/740383181 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02200542e0 con 0x7f02200df3d0 2024-09-21T00:13:42.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.940+0000 7f022ca00640 1 -- 172.21.15.83:0/740383181 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0220054f80 con 0x7f02200df3d0 2024-09-21T00:13:42.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.943+0000 7f0213400640 1 -- 172.21.15.83:0/740383181 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc005290 con 0x7f02200df3d0 2024-09-21T00:13:42.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.948+0000 7f021e000640 1 -- 172.21.15.83:0/740383181 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f02280707d0 con 0x7f02200df3d0 2024-09-21T00:13:42.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.948+0000 7f021e000640 1 -- 172.21.15.83:0/740383181 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f02280be750 con 0x7f02200df3d0 2024-09-21T00:13:42.952 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi083') 2024-09-21T00:13:42.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.948+0000 7f021e000640 1 -- 172.21.15.83:0/740383181 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f02280b4030 con 0x7f02200df3d0 2024-09-21T00:13:42.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.968+0000 7fe673400640 1 -- 172.21.15.83:0/3818020658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654004800 msgr2=0x7fe654004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.968+0000 7fe673400640 1 --2- 172.21.15.83:0/3818020658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654004800 0x7fe654004c10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0cbd70 tx=0x7fe654005830 comp rx=0 tx=0).stop 2024-09-21T00:13:42.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.968+0000 7fe673400640 1 -- 172.21.15.83:0/3818020658 shutdown_connections 2024-09-21T00:13:42.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.968+0000 7fe673400640 1 --2- 172.21.15.83:0/3818020658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654004800 0x7fe654004c10 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0cbd70 tx=0x7fe654005830 comp rx=0 tx=0).stop 2024-09-21T00:13:42.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.968+0000 7fe673400640 1 -- 172.21.15.83:0/3818020658 >> 172.21.15.83:0/3818020658 conn(0x7fe66c0b1b90 msgr2=0x7fe66c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.974+0000 7fe673400640 1 -- 172.21.15.83:0/3818020658 shutdown_connections 2024-09-21T00:13:42.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.974+0000 7fe673400640 1 -- 172.21.15.83:0/3818020658 wait complete. 2024-09-21T00:13:42.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.992+0000 7fe673400640 1 Processor -- start 2024-09-21T00:13:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.992+0000 7fe673400640 1 -- start start 2024-09-21T00:13:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.995+0000 7f44ce800640 1 -- 172.21.15.83:0/852278494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b0004800 msgr2=0x7f44b0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.995+0000 7f44c7e00640 1 -- 172.21.15.83:0/852278494 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0097d0 con 0x7f44b0004800 2024-09-21T00:13:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.995+0000 7f44ce800640 1 --2- 172.21.15.83:0/852278494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b0004800 0x7f44b0004c10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009c00 tx=0x7f44b0005830 comp rx=0 tx=0).stop 2024-09-21T00:13:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.996+0000 7f44ce800640 1 -- 172.21.15.83:0/852278494 shutdown_connections 2024-09-21T00:13:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.996+0000 7f44ce800640 1 --2- 172.21.15.83:0/852278494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b0004800 0x7f44b0004c10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.996+0000 7f44ce800640 1 -- 172.21.15.83:0/852278494 >> 172.21.15.83:0/852278494 conn(0x7f44c80d1960 msgr2=0x7f44c80d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:42.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:42.998+0000 7fe673400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe66c168ad0 0x7fe66c088440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.000+0000 7fe673400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe66c213400 0x7fe66c16ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.000+0000 7f44ce800640 1 -- 172.21.15.83:0/852278494 shutdown_connections 2024-09-21T00:13:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.000+0000 7f44ce800640 1 -- 172.21.15.83:0/852278494 wait complete. 2024-09-21T00:13:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.000+0000 7fe673400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe66c0a0550 0x7fe66c0a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.000+0000 7fe673400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c0cf6e0 con 0x7fe66c213400 2024-09-21T00:13:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.000+0000 7fe673400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c0cc720 con 0x7fe66c168ad0 2024-09-21T00:13:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.000+0000 7fe673400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe66c0cf860 con 0x7fe66c0a0550 2024-09-21T00:13:43.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.005+0000 7fe66be00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe66c213400 0x7fe66c16ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.007+0000 7f44ce800640 1 Processor -- start 2024-09-21T00:13:43.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.007+0000 7fe66be00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe66c213400 0x7fe66c16ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52526/0 (socket says 172.21.15.83:52526) 2024-09-21T00:13:43.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.007+0000 7fe66be00640 1 -- 172.21.15.83:0/217546403 learned_addr learned my addr 172.21.15.83:0/217546403 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:43.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.011+0000 7fe66be00640 1 -- 172.21.15.83:0/217546403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe66c0a0550 msgr2=0x7fe66c0a0960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T00:13:43.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.011+0000 7fe66be00640 1 --2- 172.21.15.83:0/217546403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe66c0a0550 0x7fe66c0a0960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.011+0000 7fe66be00640 1 -- 172.21.15.83:0/217546403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe66c168ad0 msgr2=0x7fe66c088440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T00:13:43.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.011+0000 7fe66be00640 1 --2- 172.21.15.83:0/217546403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe66c168ad0 0x7fe66c088440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.011+0000 7fe66be00640 1 -- 172.21.15.83:0/217546403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c0a0ea0 con 0x7fe66c213400 2024-09-21T00:13:43.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.012+0000 7fe66be00640 1 --2- 172.21.15.83:0/217546403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe66c213400 0x7fe66c16ac20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0018f0 tx=0x7fe65c006110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:43.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.007+0000 7f44ce800640 1 -- start start 2024-09-21T00:13:43.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.010+0000 7f44ce800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b0004800 0x7f44c814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.010+0000 7f44ce800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44c814f720 0x7f44c81fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.010+0000 7f44ce800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44c8150fb0 0x7f44c81fd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.010+0000 7f44ce800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f44c80cf970 con 0x7f44c814f720 2024-09-21T00:13:43.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.010+0000 7f44ce800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f44c80cf7f0 con 0x7f44c8150fb0 2024-09-21T00:13:43.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.010+0000 7f44ce800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f44c80cfaf0 con 0x7f44b0004800 2024-09-21T00:13:43.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.014+0000 7f44cca00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44c814f720 0x7f44c81fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.014+0000 7f44cca00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44c814f720 0x7f44c81fd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52536/0 (socket says 172.21.15.83:52536) 2024-09-21T00:13:43.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.014+0000 7f44cca00640 1 -- 172.21.15.83:0/1197395269 learned_addr learned my addr 172.21.15.83:0/1197395269 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:43.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.016+0000 7f44cca00640 1 -- 172.21.15.83:0/1197395269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b0004800 msgr2=0x7f44c814eb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T00:13:43.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.016+0000 7f44cca00640 1 --2- 172.21.15.83:0/1197395269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b0004800 0x7f44c814eb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.016+0000 7f44cca00640 1 -- 172.21.15.83:0/1197395269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44c8150fb0 msgr2=0x7f44c81fd6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T00:13:43.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.016+0000 7f44cca00640 1 --2- 172.21.15.83:0/1197395269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44c8150fb0 0x7f44c81fd6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.016+0000 7f44cca00640 1 -- 172.21.15.83:0/1197395269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c815b520 con 0x7f44c814f720 2024-09-21T00:13:43.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.015+0000 7fe668c00640 1 -- 172.21.15.83:0/217546403 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c043070 con 0x7fe66c213400 2024-09-21T00:13:43.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.016+0000 7fe668c00640 1 -- 172.21.15.83:0/217546403 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe65c038040 con 0x7fe66c213400 2024-09-21T00:13:43.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.017+0000 7fc7f3200640 1 -- 172.21.15.83:0/2363499895 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fc7cc005850 con 0x7fc7ec009ba0 2024-09-21T00:13:43.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.018+0000 7f44cca00640 1 --2- 172.21.15.83:0/1197395269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44c814f720 0x7f44c81fd190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009b20 tx=0x7f44bc030960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:43.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.016+0000 7fe668c00640 1 -- 172.21.15.83:0/217546403 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c004c90 con 0x7fe66c213400 2024-09-21T00:13:43.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.017+0000 7fe673400640 1 -- 172.21.15.83:0/217546403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66c1685f0 con 0x7fe66c213400 2024-09-21T00:13:43.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.017+0000 7fe673400640 1 -- 172.21.15.83:0/217546403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66c1693a0 con 0x7fe66c213400 2024-09-21T00:13:43.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.019+0000 7f901ee00640 1 -- 172.21.15.83:0/681719713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f901815ed20 msgr2=0x7f90180704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.019+0000 7f901ee00640 1 --2- 172.21.15.83:0/681719713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f901815ed20 0x7f90180704a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9004005fd0 tx=0x7f900402e780 comp rx=0 tx=0).stop 2024-09-21T00:13:43.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.021+0000 7f901ee00640 1 -- 172.21.15.83:0/681719713 shutdown_connections 2024-09-21T00:13:43.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.021+0000 7f901ee00640 1 --2- 172.21.15.83:0/681719713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f901815ed20 0x7f90180704a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.021+0000 7f901ee00640 1 --2- 172.21.15.83:0/681719713 >> v2:172.21.15.142:3300/0 conn(0x7f9018074820 0x7f90180cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.021+0000 7f901ee00640 1 -- 172.21.15.83:0/681719713 >> 172.21.15.83:0/681719713 conn(0x7f90180cfec0 msgr2=0x7f90180d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.021+0000 7f901ee00640 1 -- 172.21.15.83:0/681719713 shutdown_connections 2024-09-21T00:13:43.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.021+0000 7f901ee00640 1 -- 172.21.15.83:0/681719713 wait complete. 2024-09-21T00:13:43.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.023+0000 7f44c5600640 1 -- 172.21.15.83:0/1197395269 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0097d0 con 0x7f44c814f720 2024-09-21T00:13:43.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.023+0000 7f44c5600640 1 -- 172.21.15.83:0/1197395269 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44bc030b50 con 0x7f44c814f720 2024-09-21T00:13:43.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.026+0000 7f44ce800640 1 -- 172.21.15.83:0/1197395269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c814f500 con 0x7f44c814f720 2024-09-21T00:13:43.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.026+0000 7f44ce800640 1 -- 172.21.15.83:0/1197395269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c81fde60 con 0x7f44c814f720 2024-09-21T00:13:43.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.022+0000 7fe673400640 1 -- 172.21.15.83:0/217546403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66c06ddf0 con 0x7fe66c213400 2024-09-21T00:13:43.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.030+0000 7f901ee00640 1 Processor -- start 2024-09-21T00:13:43.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.030+0000 7f901ee00640 1 -- start start 2024-09-21T00:13:43.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.031+0000 7ff1fae00640 1 -- 172.21.15.83:0/3690288532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f4073050 msgr2=0x7ff1f416f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.031+0000 7ff1fae00640 1 --2- 172.21.15.83:0/3690288532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f4073050 0x7ff1f416f150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40518f0 tx=0x7ff1e002b1e0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.031+0000 7fc7ea000640 1 -- 172.21.15.83:0/2363499895 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7fc7e4003bc0 con 0x7fc7ec009ba0 2024-09-21T00:13:43.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.031+0000 7ff1fae00640 1 -- 172.21.15.83:0/3690288532 shutdown_connections 2024-09-21T00:13:43.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.031+0000 7ff1fae00640 1 --2- 172.21.15.83:0/3690288532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f4073050 0x7ff1f416f150 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.031+0000 7ff1fae00640 1 --2- 172.21.15.83:0/3690288532 >> v2:172.21.15.83:3300/0 conn(0x7ff1f4072c40 0x7ff1f416ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.031+0000 7ff1fae00640 1 -- 172.21.15.83:0/3690288532 >> 172.21.15.83:0/3690288532 conn(0x7ff1f406cde0 msgr2=0x7ff1f406d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.032+0000 7ff1fae00640 1 -- 172.21.15.83:0/3690288532 shutdown_connections 2024-09-21T00:13:43.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.032+0000 7ff1fae00640 1 -- 172.21.15.83:0/3690288532 wait complete. 2024-09-21T00:13:43.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.033+0000 7fe668c00640 1 -- 172.21.15.83:0/217546403 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe65c046070 con 0x7fe66c213400 2024-09-21T00:13:43.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.033+0000 7fe668c00640 1 -- 172.21.15.83:0/217546403 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe65c048440 con 0x7fe66c213400 2024-09-21T00:13:43.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.034+0000 7fe668c00640 1 -- 172.21.15.83:0/217546403 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe65c04d070 con 0x7fe66c213400 2024-09-21T00:13:43.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.029+0000 7f44c5600640 1 -- 172.21.15.83:0/1197395269 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc045410 con 0x7f44c814f720 2024-09-21T00:13:43.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.035+0000 7f44c5600640 1 -- 172.21.15.83:0/1197395269 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f44bc043020 con 0x7f44c814f720 2024-09-21T00:13:43.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.035+0000 7f44c5600640 1 -- 172.21.15.83:0/1197395269 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f44bc045df0 con 0x7f44c814f720 2024-09-21T00:13:43.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7f5445a00640 1 -- 172.21.15.83:0/4079673876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5438053630 msgr2=0x7f5438053a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7f5445a00640 1 --2- 172.21.15.83:0/4079673876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5438053630 0x7f5438053a40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5440052020 tx=0x7f54400a6280 comp rx=0 tx=0).stop 2024-09-21T00:13:43.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7fc7df400640 1 -- 172.21.15.83:0/2363499895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7ec009ba0 msgr2=0x7fc7ec0e1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7fc7df400640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7ec009ba0 0x7fc7ec0e1710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c3c0 tx=0x7fc7e400c880 comp rx=0 tx=0).stop 2024-09-21T00:13:43.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7fc7df400640 1 -- 172.21.15.83:0/2363499895 shutdown_connections 2024-09-21T00:13:43.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7fc7df400640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7ec043050 0x7fc7ec043460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7fc7df400640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7ec0df180 0x7fc7ec020f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7fc7df400640 1 --2- 172.21.15.83:0/2363499895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7ec009ba0 0x7fc7ec0e1710 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7fc7df400640 1 -- 172.21.15.83:0/2363499895 >> 172.21.15.83:0/2363499895 conn(0x7fc7ec051420 msgr2=0x7fc7ec052660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7f5445a00640 1 -- 172.21.15.83:0/4079673876 shutdown_connections 2024-09-21T00:13:43.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7f5445a00640 1 --2- 172.21.15.83:0/4079673876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5438053630 0x7f5438053a40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7f5445a00640 1 --2- 172.21.15.83:0/4079673876 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5438050fb0 0x7f54380513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7fc7df400640 1 -- 172.21.15.83:0/2363499895 shutdown_connections 2024-09-21T00:13:43.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7f5445a00640 1 -- 172.21.15.83:0/4079673876 >> 172.21.15.83:0/4079673876 conn(0x7f543801fc00 msgr2=0x7f5438056960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7fc7df400640 1 -- 172.21.15.83:0/2363499895 wait complete. 2024-09-21T00:13:43.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.036+0000 7f5445a00640 1 -- 172.21.15.83:0/4079673876 shutdown_connections 2024-09-21T00:13:43.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.037+0000 7f5445a00640 1 -- 172.21.15.83:0/4079673876 wait complete. 2024-09-21T00:13:43.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.039+0000 7f901ee00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90180709e0 0x7f901813d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.039+0000 7f901ee00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9018074820 0x7f901813f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.040+0000 7f901da00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90180709e0 0x7f901813d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.040+0000 7f901da00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90180709e0 0x7f901813d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52576/0 (socket says 172.21.15.83:52576) 2024-09-21T00:13:43.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.040+0000 7f901d000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9018074820 0x7f901813f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.040+0000 7f901d000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9018074820 0x7f901813f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:40930/0 (socket says 172.21.15.83:40930) 2024-09-21T00:13:43.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.041+0000 7f901d000640 1 -- 172.21.15.83:0/1738594338 learned_addr learned my addr 172.21.15.83:0/1738594338 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:43.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.041+0000 7f901ee00640 1 --2- 172.21.15.83:0/1738594338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901815ed20 0x7f90181f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.041+0000 7f901e400640 1 --2- 172.21.15.83:0/1738594338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901815ed20 0x7f90181f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.042+0000 7f901ee00640 1 -- 172.21.15.83:0/1738594338 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9018070050 con 0x7f90180709e0 2024-09-21T00:13:43.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.042+0000 7f901ee00640 1 -- 172.21.15.83:0/1738594338 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f901815f2a0 con 0x7f901815ed20 2024-09-21T00:13:43.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.041+0000 7f44ce800640 1 -- 172.21.15.83:0/1197395269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a4005290 con 0x7f44c814f720 2024-09-21T00:13:43.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.042+0000 7f901ee00640 1 -- 172.21.15.83:0/1738594338 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f90180701d0 con 0x7f9018074820 2024-09-21T00:13:43.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.046+0000 7f901e400640 1 -- 172.21.15.83:0/1738594338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9018074820 msgr2=0x7f901813f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.046+0000 7f901e400640 1 --2- 172.21.15.83:0/1738594338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9018074820 0x7f901813f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.046+0000 7f901e400640 1 -- 172.21.15.83:0/1738594338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90180709e0 msgr2=0x7f901813d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.046+0000 7f901e400640 1 --2- 172.21.15.83:0/1738594338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90180709e0 0x7f901813d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.048+0000 7f44c5600640 1 -- 172.21.15.83:0/1197395269 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f44bc0324f0 con 0x7f44c814f720 2024-09-21T00:13:43.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.047+0000 7f901e400640 1 -- 172.21.15.83:0/1738594338 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90181400a0 con 0x7f901815ed20 2024-09-21T00:13:43.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.049+0000 7f901e400640 1 --2- 172.21.15.83:0/1738594338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901815ed20 0x7f90181f4760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f901000bdf0 tx=0x7f9010009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:43.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.049+0000 7ff1fae00640 1 Processor -- start 2024-09-21T00:13:43.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.051+0000 7f5445a00640 1 Processor -- start 2024-09-21T00:13:43.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.051+0000 7f5445a00640 1 -- start start 2024-09-21T00:13:43.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.051+0000 7f9015600640 1 -- 172.21.15.83:0/1738594338 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010019070 con 0x7f901815ed20 2024-09-21T00:13:43.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.051+0000 7f9015600640 1 -- 172.21.15.83:0/1738594338 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9010014440 con 0x7f901815ed20 2024-09-21T00:13:43.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.051+0000 7f9015600640 1 -- 172.21.15.83:0/1738594338 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010014890 con 0x7f901815ed20 2024-09-21T00:13:43.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.051+0000 7f901ee00640 1 -- 172.21.15.83:0/1738594338 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9018140380 con 0x7f901815ed20 2024-09-21T00:13:43.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.051+0000 7f901ee00640 1 -- 172.21.15.83:0/1738594338 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9018140940 con 0x7f901815ed20 2024-09-21T00:13:43.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.051+0000 7ff1fae00640 1 -- start start 2024-09-21T00:13:43.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.055+0000 7f6cd2000640 1 -- 172.21.15.83:0/2921672288 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4035020 con 0x7f6cd415b7a0 2024-09-21T00:13:43.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.055+0000 7f6cd9200640 1 -- 172.21.15.83:0/2921672288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd415b7a0 msgr2=0x7f6cd40cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.055+0000 7f6cd9200640 1 --2- 172.21.15.83:0/2921672288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd415b7a0 0x7f6cd40cc6c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009900 tx=0x7f6cc402a560 comp rx=0 tx=0).stop 2024-09-21T00:13:43.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.056+0000 7f6cd9200640 1 -- 172.21.15.83:0/2921672288 shutdown_connections 2024-09-21T00:13:43.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.056+0000 7f6cd9200640 1 --2- 172.21.15.83:0/2921672288 >> v2:172.21.15.83:3300/0 conn(0x7f6cd415eea0 0x7f6cd40cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.056+0000 7f6cd9200640 1 --2- 172.21.15.83:0/2921672288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd415b7a0 0x7f6cd40cc6c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.056+0000 7f6cd9200640 1 -- 172.21.15.83:0/2921672288 >> 172.21.15.83:0/2921672288 conn(0x7f6cd406f920 msgr2=0x7f6cd40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.056+0000 7f6cd9200640 1 -- 172.21.15.83:0/2921672288 shutdown_connections 2024-09-21T00:13:43.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.057+0000 7f6cd9200640 1 -- 172.21.15.83:0/2921672288 wait complete. 2024-09-21T00:13:43.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.058+0000 7f1713400640 1 -- 172.21.15.83:0/226194773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f170c0d1120 msgr2=0x7f170c0ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.058+0000 7f1713400640 1 --2- 172.21.15.83:0/226194773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f170c0d1120 0x7f170c0ceb90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f170c0d2080 tx=0x7f170402a7e0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.058+0000 7f9015600640 1 -- 172.21.15.83:0/1738594338 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f901001c070 con 0x7f901815ed20 2024-09-21T00:13:43.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.058+0000 7f9015600640 1 -- 172.21.15.83:0/1738594338 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f901001ecd0 con 0x7f901815ed20 2024-09-21T00:13:43.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.058+0000 7f1713400640 1 -- 172.21.15.83:0/226194773 shutdown_connections 2024-09-21T00:13:43.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.058+0000 7f1713400640 1 --2- 172.21.15.83:0/226194773 >> v2:172.21.15.83:3300/0 conn(0x7f170c0d0170 0x7f170c0d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.058+0000 7f1713400640 1 --2- 172.21.15.83:0/226194773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f170c0d1120 0x7f170c0ceb90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.058+0000 7f1713400640 1 -- 172.21.15.83:0/226194773 >> 172.21.15.83:0/226194773 conn(0x7f170c09d830 msgr2=0x7f170c0b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.058+0000 7f900aa00640 1 -- 172.21.15.83:0/1738594338 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90180d0800 con 0x7f901815ed20 2024-09-21T00:13:43.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.059+0000 7f1713400640 1 -- 172.21.15.83:0/226194773 shutdown_connections 2024-09-21T00:13:43.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.058+0000 7f5445a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5438050fb0 0x7f54380e0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.062+0000 7ff1fae00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f4072c40 0x7ff1f4161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.062+0000 7ff1fae00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f4073050 0x7ff1f4165410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.062+0000 7ff1fae00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1f408b060 0x7ff1f40b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.061+0000 7f6cd9200640 1 Processor -- start 2024-09-21T00:13:43.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.062+0000 7f6cd9200640 1 -- start start 2024-09-21T00:13:43.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.062+0000 7f5445a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5438053630 0x7f5438054810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.062+0000 7f5445a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5438055f40 0x7f5438054d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.063+0000 7f5445a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f54380e64e0 con 0x7f5438055f40 2024-09-21T00:13:43.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.063+0000 7f5445a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f54380e6360 con 0x7f5438050fb0 2024-09-21T00:13:43.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.063+0000 7f5445a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f54380e6660 con 0x7f5438053630 2024-09-21T00:13:43.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.063+0000 7f543ea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5438050fb0 0x7f54380e0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.063+0000 7f543e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5438053630 0x7f5438054810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.063+0000 7ff1f8e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1f408b060 0x7ff1f40b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.064+0000 7ff1f8e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1f408b060 0x7ff1f40b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52606/0 (socket says 172.21.15.83:52606) 2024-09-21T00:13:43.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.064+0000 7ff1f8e00640 1 -- 172.21.15.83:0/268029661 learned_addr learned my addr 172.21.15.83:0/268029661 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:43.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.064+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4073650 con 0x7ff1f408b060 2024-09-21T00:13:43.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.064+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f408bd90 con 0x7ff1f4072c40 2024-09-21T00:13:43.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.064+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f40737d0 con 0x7ff1f4073050 2024-09-21T00:13:43.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.064+0000 7f543f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5438055f40 0x7f5438054d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7f543f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5438055f40 0x7f5438054d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52598/0 (socket says 172.21.15.83:52598) 2024-09-21T00:13:43.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7f543f400640 1 -- 172.21.15.83:0/2655154760 learned_addr learned my addr 172.21.15.83:0/2655154760 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:43.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7ff1f3e00640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f4072c40 0x7ff1f4161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.066+0000 7f6cd9200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cd40ccc00 0x7f6cd414a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.066+0000 7f6cd9200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd415b7a0 0x7f6cd41f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.066+0000 7f6cd9200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd415eea0 0x7f6cd40ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.059+0000 7f1713400640 1 -- 172.21.15.83:0/226194773 wait complete. 2024-09-21T00:13:43.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7ff1f3400640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f4073050 0x7ff1f4165410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7ff1f8e00640 1 -- 172.21.15.83:0/268029661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f4073050 msgr2=0x7ff1f4165410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7ff1f8e00640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f4073050 0x7ff1f4165410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7ff1f8e00640 1 -- 172.21.15.83:0/268029661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f4072c40 msgr2=0x7ff1f4161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7ff1f8e00640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f4072c40 0x7ff1f4161b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7ff1f8e00640 1 -- 172.21.15.83:0/268029661 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f4169d70 con 0x7ff1f408b060 2024-09-21T00:13:43.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7ff1f3400640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f4073050 0x7ff1f4165410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:13:43.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.065+0000 7ff1f3e00640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f4072c40 0x7ff1f4161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:13:43.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.067+0000 7ff1f8e00640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1f408b060 0x7ff1f40b3230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400c3c0 tx=0x7ff1e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:43.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.068+0000 7ff1ebe00640 1 -- 172.21.15.83:0/268029661 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4011790 con 0x7ff1f408b060 2024-09-21T00:13:43.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.068+0000 7f6cd3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd415eea0 0x7f6cd40ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.068+0000 7f6cd3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd415eea0 0x7f6cd40ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:35900/0 (socket says 172.21.15.83:35900) 2024-09-21T00:13:43.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.068+0000 7f6cd3e00640 1 -- 172.21.15.83:0/1792794419 learned_addr learned my addr 172.21.15.83:0/1792794419 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:43.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.068+0000 7f6cd3400640 1 --2- 172.21.15.83:0/1792794419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cd40ccc00 0x7f6cd414a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.068+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f4160540 con 0x7ff1f408b060 2024-09-21T00:13:43.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.069+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f4160b00 con 0x7ff1f408b060 2024-09-21T00:13:43.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.069+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd40ce480 con 0x7f6cd40ccc00 2024-09-21T00:13:43.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.070+0000 7f6cd2a00640 1 --2- 172.21.15.83:0/1792794419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd415b7a0 0x7f6cd41f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.070+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd40ce300 con 0x7f6cd415eea0 2024-09-21T00:13:43.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.070+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd40ce600 con 0x7f6cd415b7a0 2024-09-21T00:13:43.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.070+0000 7f543f400640 1 -- 172.21.15.83:0/2655154760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5438053630 msgr2=0x7f5438054810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.071+0000 7f543f400640 1 --2- 172.21.15.83:0/2655154760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5438053630 0x7f5438054810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.071+0000 7f543f400640 1 -- 172.21.15.83:0/2655154760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5438050fb0 msgr2=0x7f54380e0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.072+0000 7ff1ebe00640 1 -- 172.21.15.83:0/268029661 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1e4017070 con 0x7ff1f408b060 2024-09-21T00:13:43.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.072+0000 7ff1ebe00640 1 -- 172.21.15.83:0/268029661 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4011c60 con 0x7ff1f408b060 2024-09-21T00:13:43.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.071+0000 7f543f400640 1 --2- 172.21.15.83:0/2655154760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5438050fb0 0x7f54380e0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.072+0000 7f543f400640 1 -- 172.21.15.83:0/2655154760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5438039930 con 0x7f5438055f40 2024-09-21T00:13:43.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.071+0000 7f6cd3e00640 1 -- 172.21.15.83:0/1792794419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd415b7a0 msgr2=0x7f6cd41f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.071+0000 7f6cd3e00640 1 --2- 172.21.15.83:0/1792794419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd415b7a0 0x7f6cd41f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.071+0000 7f6cd3e00640 1 -- 172.21.15.83:0/1792794419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cd40ccc00 msgr2=0x7f6cd414a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.071+0000 7f6cd3e00640 1 --2- 172.21.15.83:0/1792794419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cd40ccc00 0x7f6cd414a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.073+0000 7f1713400640 1 Processor -- start 2024-09-21T00:13:43.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.071+0000 7f6cd3e00640 1 -- 172.21.15.83:0/1792794419 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd414aeb0 con 0x7f6cd415eea0 2024-09-21T00:13:43.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.073+0000 7f1713400640 1 -- start start 2024-09-21T00:13:43.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.073+0000 7ff1ebe00640 1 -- 172.21.15.83:0/268029661 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff1e401c460 con 0x7ff1f408b060 2024-09-21T00:13:43.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.073+0000 7ff1ebe00640 1 -- 172.21.15.83:0/268029661 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff1e4012970 con 0x7ff1f408b060 2024-09-21T00:13:43.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.073+0000 7f6cd2a00640 1 --2- 172.21.15.83:0/1792794419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd415b7a0 0x7f6cd41f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:13:43.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.074+0000 7f6cd3e00640 1 --2- 172.21.15.83:0/1792794419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd415eea0 0x7f6cd40ab190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00b9e0 tx=0x7f6ccc00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:43.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.074+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1cc005290 con 0x7ff1f408b060 2024-09-21T00:13:43.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.075+0000 7f6ccb400640 1 -- 172.21.15.83:0/1792794419 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc019070 con 0x7f6cd415eea0 2024-09-21T00:13:43.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.075+0000 7f6ccb400640 1 -- 172.21.15.83:0/1792794419 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ccc00cc30 con 0x7f6cd415eea0 2024-09-21T00:13:43.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.075+0000 7f6ccb400640 1 -- 172.21.15.83:0/1792794419 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0146a0 con 0x7f6cd415eea0 2024-09-21T00:13:43.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.075+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd41f2340 con 0x7f6cd415eea0 2024-09-21T00:13:43.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.074+0000 7f9015600640 1 -- 172.21.15.83:0/1738594338 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f90180d0800 con 0x7f901815ed20 2024-09-21T00:13:43.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.078+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd40a9650 con 0x7f6cd415eea0 2024-09-21T00:13:43.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.078+0000 7f6ccb400640 1 -- 172.21.15.83:0/1792794419 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ccc01c070 con 0x7f6cd415eea0 2024-09-21T00:13:43.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.078+0000 7f6ccb400640 1 -- 172.21.15.83:0/1792794419 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6ccc01ec60 con 0x7f6cd415eea0 2024-09-21T00:13:43.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.078+0000 7f543f400640 1 --2- 172.21.15.83:0/2655154760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5438055f40 0x7f5438054d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f544006ba80 tx=0x7f54400aec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:43.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.079+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd40a9440 con 0x7f6cd415eea0 2024-09-21T00:13:43.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.080+0000 7f1713400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f170c0d0170 0x7f170c0ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.081+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fbcfc01dd50 con 0x7fbcfc009e00 2024-09-21T00:13:43.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.081+0000 7f1713400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f170c0d1120 0x7f170c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.081+0000 7f5436a00640 1 -- 172.21.15.83:0/2655154760 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54400b3050 con 0x7f5438055f40 2024-09-21T00:13:43.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.081+0000 7f5445a00640 1 -- 172.21.15.83:0/2655154760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5438039c10 con 0x7f5438055f40 2024-09-21T00:13:43.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.081+0000 7f5445a00640 1 -- 172.21.15.83:0/2655154760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5438055350 con 0x7f5438055f40 2024-09-21T00:13:43.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.083+0000 7f6ccb400640 1 -- 172.21.15.83:0/1792794419 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6ccc023020 con 0x7f6cd415eea0 2024-09-21T00:13:43.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.083+0000 7f5445a00640 1 -- 172.21.15.83:0/2655154760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54380555b0 con 0x7f5438055f40 2024-09-21T00:13:43.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.084+0000 7ff1ebe00640 1 -- 172.21.15.83:0/268029661 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff1e4012420 con 0x7ff1f408b060 2024-09-21T00:13:43.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.085+0000 7f170be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f170c0d1120 0x7f170c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.085+0000 7f170be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f170c0d1120 0x7f170c06f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:35916/0 (socket says 172.21.15.83:35916) 2024-09-21T00:13:43.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.085+0000 7f5436a00640 1 -- 172.21.15.83:0/2655154760 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54400bf070 con 0x7f5438055f40 2024-09-21T00:13:43.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.085+0000 7f170be00640 1 -- 172.21.15.83:0/4289421575 learned_addr learned my addr 172.21.15.83:0/4289421575 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:43.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.085+0000 7f5436a00640 1 -- 172.21.15.83:0/2655154760 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54400ba8a0 con 0x7f5438055f40 2024-09-21T00:13:43.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.085+0000 7f1713400640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15ee80 0x7f170c1f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.086+0000 7f1710a00640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f170c0d0170 0x7f170c0ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.087+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f170c0b6700 con 0x7f170c15ee80 2024-09-21T00:13:43.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.087+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f170c0b6580 con 0x7f170c0d1120 2024-09-21T00:13:43.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.088+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f170c0b6880 con 0x7f170c0d0170 2024-09-21T00:13:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.089+0000 7f1710a00640 1 -- 172.21.15.83:0/4289421575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f170c0d1120 msgr2=0x7f170c06f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.089+0000 7f1710a00640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f170c0d1120 0x7f170c06f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.089+0000 7f1710a00640 1 -- 172.21.15.83:0/4289421575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15ee80 msgr2=0x7f170c1f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.089+0000 7f1711400640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15ee80 0x7f170c1f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.089+0000 7f1710a00640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15ee80 0x7f170c1f8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.090+0000 7f1710a00640 1 -- 172.21.15.83:0/4289421575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c06e330 con 0x7f170c0d0170 2024-09-21T00:13:43.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.090+0000 7f1711400640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15ee80 0x7f170c1f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:13:43.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.090+0000 7f1710a00640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f170c0d0170 0x7f170c0ccaa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00c3f0 tx=0x7f16fc00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:43.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.095+0000 7f1708c00640 1 -- 172.21.15.83:0/4289421575 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc011790 con 0x7f170c0d0170 2024-09-21T00:13:43.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.095+0000 7f1708c00640 1 -- 172.21.15.83:0/4289421575 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16fc017070 con 0x7f170c0d0170 2024-09-21T00:13:43.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.096+0000 7f1708c00640 1 -- 172.21.15.83:0/4289421575 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc011ca0 con 0x7f170c0d0170 2024-09-21T00:13:43.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.097+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170c06e5f0 con 0x7f170c0d0170 2024-09-21T00:13:43.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.097+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f170c06ecc0 con 0x7f170c0d0170 2024-09-21T00:13:43.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.097+0000 7f1708c00640 1 -- 172.21.15.83:0/4289421575 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f16fc01c460 con 0x7f170c0d0170 2024-09-21T00:13:43.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.087+0000 7f5436a00640 1 -- 172.21.15.83:0/2655154760 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f54400baa80 con 0x7f5438055f40 2024-09-21T00:13:43.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.087+0000 7f5436a00640 1 -- 172.21.15.83:0/2655154760 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f54400ba660 con 0x7f5438055f40 2024-09-21T00:13:43.100 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.098+0000 7f1708c00640 1 -- 172.21.15.83:0/4289421575 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f16fc005020 con 0x7f170c0d0170 2024-09-21T00:13:43.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.098+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f170c0b6da0 con 0x7f170c0d0170 2024-09-21T00:13:43.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.101+0000 7f1708c00640 1 -- 172.21.15.83:0/4289421575 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f170c1592d0 con 0x7f170c0d0170 2024-09-21T00:13:43.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.102+0000 7f5436a00640 1 -- 172.21.15.83:0/2655154760 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f54400c8060 con 0x7f5438055f40 2024-09-21T00:13:43.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.111+0000 7fbd00c00640 1 -- 172.21.15.83:0/1760883864 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v13)=0 v13) ==== 119+0+0 (secure 0 0 0) 0x7fbcf801c460 con 0x7fbcfc009e00 2024-09-21T00:13:43.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.113+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc009e00 msgr2=0x7fbcfc17b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.113+0000 7fbd0b400640 1 --2- 172.21.15.83:0/1760883864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc009e00 0x7fbcfc17b710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800c3c0 tx=0x7fbcf800c880 comp rx=0 tx=0).stop 2024-09-21T00:13:43.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.113+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 shutdown_connections 2024-09-21T00:13:43.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.113+0000 7fbd0b400640 1 --2- 172.21.15.83:0/1760883864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcfc0384f0 0x7fbcfc0353e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.113+0000 7fbd0b400640 1 --2- 172.21.15.83:0/1760883864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcfc0363e0 0x7fbcfc021c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.113+0000 7fbd0b400640 1 --2- 172.21.15.83:0/1760883864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc009e00 0x7fbcfc17b710 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800c3c0 tx=0x7fbcf800c880 comp rx=0 tx=0).stop 2024-09-21T00:13:43.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.113+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 >> 172.21.15.83:0/1760883864 conn(0x7fbcfc0515c0 msgr2=0x7fbcfc0ea3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.114+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 shutdown_connections 2024-09-21T00:13:43.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.114+0000 7fbd0b400640 1 -- 172.21.15.83:0/1760883864 wait complete. 2024-09-21T00:13:43.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.117+0000 7f0213400640 1 -- 172.21.15.83:0/740383181 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f01fc005850 con 0x7f02200df3d0 2024-09-21T00:13:43.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.118+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc8ec0347a0 con 0x7fc8ec048630 2024-09-21T00:13:43.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.127+0000 7f021e000640 1 -- 172.21.15.83:0/740383181 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f02280ba020 con 0x7f02200df3d0 2024-09-21T00:13:43.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.129+0000 7f71d3e00640 1 -- 172.21.15.83:0/3519971834 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f71d40cf7f0 con 0x7f71d406dc40 2024-09-21T00:13:43.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.129+0000 7f0213400640 1 -- 172.21.15.83:0/740383181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02200df3d0 msgr2=0x7f022016bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.129+0000 7f0213400640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02200df3d0 0x7f022016bd50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f022806bcf0 tx=0x7f0228072440 comp rx=0 tx=0).stop 2024-09-21T00:13:43.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.129+0000 7f0213400640 1 -- 172.21.15.83:0/740383181 shutdown_connections 2024-09-21T00:13:43.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.129+0000 7f0213400640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02200df3d0 0x7f022016bd50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.129+0000 7f0213400640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0220050a10 0x7f0220053da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.129+0000 7f0213400640 1 --2- 172.21.15.83:0/740383181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0220034420 0x7f0220176750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.129+0000 7f0213400640 1 -- 172.21.15.83:0/740383181 >> 172.21.15.83:0/740383181 conn(0x7f022001d9c0 msgr2=0x7f02200dc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.130+0000 7f0213400640 1 -- 172.21.15.83:0/740383181 shutdown_connections 2024-09-21T00:13:43.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.130+0000 7f0213400640 1 -- 172.21.15.83:0/740383181 wait complete. 2024-09-21T00:13:43.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.153+0000 7fc8e3400640 1 -- 172.21.15.83:0/2801327153 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7fc8e403dc80 con 0x7fc8ec048630 2024-09-21T00:13:43.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.154+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ec048630 msgr2=0x7fc8ec048a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.154+0000 7fc8fa800640 1 --2- 172.21.15.83:0/2801327153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ec048630 0x7fc8ec048a40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec036420 tx=0x7fc8e4003800 comp rx=0 tx=0).stop 2024-09-21T00:13:43.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.154+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 shutdown_connections 2024-09-21T00:13:43.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.154+0000 7fc8fa800640 1 --2- 172.21.15.83:0/2801327153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ec048630 0x7fc8ec048a40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.154+0000 7fc8fa800640 1 --2- 172.21.15.83:0/2801327153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8ec17a4d0 0x7fc8ec17a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.154+0000 7fc8fa800640 1 --2- 172.21.15.83:0/2801327153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec04a360 0x7fc8ec179f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.154+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 >> 172.21.15.83:0/2801327153 conn(0x7fc8ec051440 msgr2=0x7fc8ec0dfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.155+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 shutdown_connections 2024-09-21T00:13:43.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.155+0000 7fc8fa800640 1 -- 172.21.15.83:0/2801327153 wait complete. 2024-09-21T00:13:43.172 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.173+0000 7f71caa00640 1 -- 172.21.15.83:0/3519971834 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7f71c001f020 con 0x7f71d406dc40 2024-09-21T00:13:43.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.175+0000 7f71d3e00640 1 -- 172.21.15.83:0/3519971834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d406dc40 msgr2=0x7f71d414e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.175+0000 7f71d3e00640 1 --2- 172.21.15.83:0/3519971834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d406dc40 0x7f71d414e010 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71c000b3e0 tx=0x7f71c000b8a0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.175+0000 7f71d3e00640 1 -- 172.21.15.83:0/3519971834 shutdown_connections 2024-09-21T00:13:43.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.175+0000 7f71d3e00640 1 --2- 172.21.15.83:0/3519971834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71d40aef90 0x7f71d41f9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.175+0000 7f71d3e00640 1 --2- 172.21.15.83:0/3519971834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71d4070770 0x7f71d41fdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.175+0000 7f71d3e00640 1 --2- 172.21.15.83:0/3519971834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d406dc40 0x7f71d414e010 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.175+0000 7f71d3e00640 1 -- 172.21.15.83:0/3519971834 >> 172.21.15.83:0/3519971834 conn(0x7f71d40cfec0 msgr2=0x7f71d40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.175+0000 7f71d3e00640 1 -- 172.21.15.83:0/3519971834 shutdown_connections 2024-09-21T00:13:43.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.176+0000 7f71d3e00640 1 -- 172.21.15.83:0/3519971834 wait complete. 2024-09-21T00:13:43.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.193+0000 7f44ce800640 1 -- 172.21.15.83:0/1197395269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f44a4005850 con 0x7f44c814f720 2024-09-21T00:13:43.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.206+0000 7f44c5600640 1 -- 172.21.15.83:0/1197395269 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7f44bc0455b0 con 0x7f44c814f720 2024-09-21T00:13:43.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.211+0000 7f44ce800640 1 -- 172.21.15.83:0/1197395269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44c814f720 msgr2=0x7f44c81fd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.211+0000 7f44ce800640 1 --2- 172.21.15.83:0/1197395269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44c814f720 0x7f44c81fd190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009b20 tx=0x7f44bc030960 comp rx=0 tx=0).stop 2024-09-21T00:13:43.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.211+0000 7f44ce800640 1 -- 172.21.15.83:0/1197395269 shutdown_connections 2024-09-21T00:13:43.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.211+0000 7f44ce800640 1 --2- 172.21.15.83:0/1197395269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44c8150fb0 0x7f44c81fd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.211+0000 7f44ce800640 1 --2- 172.21.15.83:0/1197395269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44c814f720 0x7f44c81fd190 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009b20 tx=0x7f44bc030960 comp rx=0 tx=0).stop 2024-09-21T00:13:43.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.211+0000 7f44ce800640 1 --2- 172.21.15.83:0/1197395269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b0004800 0x7f44c814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.211+0000 7f44ce800640 1 -- 172.21.15.83:0/1197395269 >> 172.21.15.83:0/1197395269 conn(0x7f44c80d1960 msgr2=0x7f44c8161720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.212+0000 7f44ce800640 1 -- 172.21.15.83:0/1197395269 shutdown_connections 2024-09-21T00:13:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.212+0000 7f44ce800640 1 -- 172.21.15.83:0/1197395269 wait complete. 2024-09-21T00:13:43.214 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.215 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.238+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7ff1cc005580 con 0x7ff1f408b060 2024-09-21T00:13:43.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.238+0000 7fe673400640 1 -- 172.21.15.83:0/217546403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fe66c074b10 con 0x7fe66c213400 2024-09-21T00:13:43.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.246+0000 7ff1ebe00640 1 -- 172.21.15.83:0/268029661 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v18)=0 v18) ==== 108+0+0 (secure 0 0 0) 0x7ff1e4012420 con 0x7ff1f408b060 2024-09-21T00:13:43.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.248+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1f408b060 msgr2=0x7ff1f40b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.248+0000 7ff1fae00640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1f408b060 0x7ff1f40b3230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400c3c0 tx=0x7ff1e400c880 comp rx=0 tx=0).stop 2024-09-21T00:13:43.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.248+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 shutdown_connections 2024-09-21T00:13:43.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.248+0000 7ff1fae00640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1f408b060 0x7ff1f40b3230 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.248+0000 7ff1fae00640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f4073050 0x7ff1f4165410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.248+0000 7ff1fae00640 1 --2- 172.21.15.83:0/268029661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f4072c40 0x7ff1f4161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.248+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 >> 172.21.15.83:0/268029661 conn(0x7ff1f406cde0 msgr2=0x7ff1f40b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.249+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 shutdown_connections 2024-09-21T00:13:43.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.249+0000 7ff1fae00640 1 -- 172.21.15.83:0/268029661 wait complete. 2024-09-21T00:13:43.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.250+0000 7f900aa00640 1 -- 172.21.15.83:0/1738594338 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f90180cf870 con 0x7f901815ed20 2024-09-21T00:13:43.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.252+0000 7fe668c00640 1 -- 172.21.15.83:0/217546403 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v19)=0 v19) ==== 111+0+0 (secure 0 0 0) 0x7fe66c0a0ea0 con 0x7fe66c213400 2024-09-21T00:13:43.255 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.255 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.254+0000 7fe673400640 1 -- 172.21.15.83:0/217546403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe66c213400 msgr2=0x7fe66c16ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.254+0000 7fe673400640 1 --2- 172.21.15.83:0/217546403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe66c213400 0x7fe66c16ac20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0018f0 tx=0x7fe65c006110 comp rx=0 tx=0).stop 2024-09-21T00:13:43.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.254+0000 7fe673400640 1 -- 172.21.15.83:0/217546403 shutdown_connections 2024-09-21T00:13:43.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.254+0000 7fe673400640 1 --2- 172.21.15.83:0/217546403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe66c0a0550 0x7fe66c0a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.254+0000 7fe673400640 1 --2- 172.21.15.83:0/217546403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe66c213400 0x7fe66c16ac20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.254+0000 7fe673400640 1 --2- 172.21.15.83:0/217546403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe66c168ad0 0x7fe66c088440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.254+0000 7fe673400640 1 -- 172.21.15.83:0/217546403 >> 172.21.15.83:0/217546403 conn(0x7fe66c0b1b90 msgr2=0x7fe66c071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.255+0000 7fe673400640 1 -- 172.21.15.83:0/217546403 shutdown_connections 2024-09-21T00:13:43.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.255+0000 7fe673400640 1 -- 172.21.15.83:0/217546403 wait complete. 2024-09-21T00:13:43.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.256+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f6cd406da20 con 0x7f6cd415eea0 2024-09-21T00:13:43.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.263+0000 7f9015600640 1 -- 172.21.15.83:0/1738594338 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f901001e440 con 0x7f901815ed20 2024-09-21T00:13:43.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.264+0000 7f900aa00640 1 -- 172.21.15.83:0/1738594338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901815ed20 msgr2=0x7f90181f4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.264+0000 7f900aa00640 1 --2- 172.21.15.83:0/1738594338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901815ed20 0x7f90181f4760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f901000bdf0 tx=0x7f9010009ef0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.265+0000 7f900aa00640 1 -- 172.21.15.83:0/1738594338 shutdown_connections 2024-09-21T00:13:43.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.265+0000 7f900aa00640 1 --2- 172.21.15.83:0/1738594338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901815ed20 0x7f90181f4760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.265+0000 7f900aa00640 1 --2- 172.21.15.83:0/1738594338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9018074820 0x7f901813f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.265+0000 7f900aa00640 1 --2- 172.21.15.83:0/1738594338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90180709e0 0x7f901813d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.265+0000 7f900aa00640 1 -- 172.21.15.83:0/1738594338 >> 172.21.15.83:0/1738594338 conn(0x7f90180cfec0 msgr2=0x7f901815a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.265+0000 7f900aa00640 1 -- 172.21.15.83:0/1738594338 shutdown_connections 2024-09-21T00:13:43.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.265+0000 7f900aa00640 1 -- 172.21.15.83:0/1738594338 wait complete. 2024-09-21T00:13:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.268+0000 7f6ccb400640 1 -- 172.21.15.83:0/1792794419 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v21)=0 v21) ==== 106+0+0 (secure 0 0 0) 0x7f6ccc014840 con 0x7f6cd415eea0 2024-09-21T00:13:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.270+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd415eea0 msgr2=0x7f6cd40ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.270+0000 7f6cd9200640 1 --2- 172.21.15.83:0/1792794419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd415eea0 0x7f6cd40ab190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00b9e0 tx=0x7f6ccc00bea0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.270+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 shutdown_connections 2024-09-21T00:13:43.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.270+0000 7f6cd9200640 1 --2- 172.21.15.83:0/1792794419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd415eea0 0x7f6cd40ab190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.270+0000 7f6cd9200640 1 --2- 172.21.15.83:0/1792794419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd415b7a0 0x7f6cd41f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.270+0000 7f6cd9200640 1 --2- 172.21.15.83:0/1792794419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cd40ccc00 0x7f6cd414a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.270+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 >> 172.21.15.83:0/1792794419 conn(0x7f6cd406f920 msgr2=0x7f6cd415bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.273+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 shutdown_connections 2024-09-21T00:13:43.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.273+0000 7f6cd9200640 1 -- 172.21.15.83:0/1792794419 wait complete. 2024-09-21T00:13:43.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.280+0000 7f5445a00640 1 -- 172.21.15.83:0/2655154760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f5438035c60 con 0x7f5438055f40 2024-09-21T00:13:43.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.286+0000 7f5436a00640 1 -- 172.21.15.83:0/2655154760 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v22)=0 v22) ==== 125+0+0 (secure 0 0 0) 0x7f54400bad70 con 0x7f5438055f40 2024-09-21T00:13:43.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.289+0000 7f5445a00640 1 -- 172.21.15.83:0/2655154760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5438055f40 msgr2=0x7f5438054d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.289+0000 7f5445a00640 1 --2- 172.21.15.83:0/2655154760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5438055f40 0x7f5438054d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f544006ba80 tx=0x7f54400aec70 comp rx=0 tx=0).stop 2024-09-21T00:13:43.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.289+0000 7f5445a00640 1 -- 172.21.15.83:0/2655154760 shutdown_connections 2024-09-21T00:13:43.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.289+0000 7f5445a00640 1 --2- 172.21.15.83:0/2655154760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5438055f40 0x7f5438054d50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.289+0000 7f5445a00640 1 --2- 172.21.15.83:0/2655154760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5438053630 0x7f5438054810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.289+0000 7f5445a00640 1 --2- 172.21.15.83:0/2655154760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5438050fb0 0x7f54380e0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.289+0000 7f5445a00640 1 -- 172.21.15.83:0/2655154760 >> 172.21.15.83:0/2655154760 conn(0x7f543801fc00 msgr2=0x7f54380519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.289+0000 7f5445a00640 1 -- 172.21.15.83:0/2655154760 shutdown_connections 2024-09-21T00:13:43.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.289+0000 7f5445a00640 1 -- 172.21.15.83:0/2655154760 wait complete. 2024-09-21T00:13:43.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.290+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f170c158e50 con 0x7f170c0d0170 2024-09-21T00:13:43.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.297+0000 7f1708c00640 1 -- 172.21.15.83:0/4289421575 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f16fc005220 con 0x7f170c0d0170 2024-09-21T00:13:43.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.298+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f170c0d0170 msgr2=0x7f170c0ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.298+0000 7f1713400640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f170c0d0170 0x7f170c0ccaa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00c3f0 tx=0x7f16fc00c8b0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.298+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 shutdown_connections 2024-09-21T00:13:43.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.298+0000 7f1713400640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15ee80 0x7f170c1f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.298+0000 7f1713400640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f170c0d1120 0x7f170c06f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.298+0000 7f1713400640 1 --2- 172.21.15.83:0/4289421575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f170c0d0170 0x7f170c0ccaa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.298+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 >> 172.21.15.83:0/4289421575 conn(0x7f170c09d830 msgr2=0x7f170c160ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.298+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 shutdown_connections 2024-09-21T00:13:43.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.299+0000 7f1713400640 1 -- 172.21.15.83:0/4289421575 wait complete. 2024-09-21T00:13:43.301 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.301 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.309 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.315 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.315 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi083') 2024-09-21T00:13:43.326 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config dump 2024-09-21T00:13:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.583+0000 7fdbc5000640 1 -- 172.21.15.83:0/754538025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdba4004800 msgr2=0x7fdba4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.583+0000 7fdbc5000640 1 --2- 172.21.15.83:0/754538025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdba4004800 0x7fdba4004c10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009b50 tx=0x7fdba4005830 comp rx=0 tx=0).stop 2024-09-21T00:13:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.584+0000 7fdbc5000640 1 -- 172.21.15.83:0/754538025 shutdown_connections 2024-09-21T00:13:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.584+0000 7fdbc5000640 1 --2- 172.21.15.83:0/754538025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdba4004800 0x7fdba4004c10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.584+0000 7fdbc5000640 1 -- 172.21.15.83:0/754538025 >> 172.21.15.83:0/754538025 conn(0x7fdbc00d4440 msgr2=0x7fdbc00d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.584+0000 7fdbc5000640 1 -- 172.21.15.83:0/754538025 shutdown_connections 2024-09-21T00:13:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.584+0000 7fdbc5000640 1 -- 172.21.15.83:0/754538025 wait complete. 2024-09-21T00:13:43.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.586+0000 7fdbc5000640 1 Processor -- start 2024-09-21T00:13:43.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.586+0000 7fdbc5000640 1 -- start start 2024-09-21T00:13:43.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbc5000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba4004800 0x7fdbc014e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbc5000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc01f8740 0x7fdbc01f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbc5000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbc014b440 0x7fdbc014b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbc5000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0162d30 con 0x7fdbc014b440 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbc5000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0162bb0 con 0x7fdba4004800 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbc5000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc00d2a20 con 0x7fdbc01f8740 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbbe800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbc014b440 0x7fdbc014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbbe800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbc014b440 0x7fdbc014b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52634/0 (socket says 172.21.15.83:52634) 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbbe800640 1 -- 172.21.15.83:0/1573941704 learned_addr learned my addr 172.21.15.83:0/1573941704 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbb7e00640 1 --2- 172.21.15.83:0/1573941704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc01f8740 0x7fdbc01f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbbde00640 1 --2- 172.21.15.83:0/1573941704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba4004800 0x7fdbc014e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbbe800640 1 -- 172.21.15.83:0/1573941704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc01f8740 msgr2=0x7fdbc01f8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbbe800640 1 --2- 172.21.15.83:0/1573941704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc01f8740 0x7fdbc01f8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbbe800640 1 -- 172.21.15.83:0/1573941704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba4004800 msgr2=0x7fdbc014e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbbe800640 1 --2- 172.21.15.83:0/1573941704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba4004800 0x7fdbc014e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.588+0000 7fdbbe800640 1 -- 172.21.15.83:0/1573941704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc014bd90 con 0x7fdbc014b440 2024-09-21T00:13:43.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.589+0000 7fdbbe800640 1 --2- 172.21.15.83:0/1573941704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbc014b440 0x7fdbc014b850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00d0b90 tx=0x7fdbb8001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:43.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.589+0000 7fdbb6000640 1 -- 172.21.15.83:0/1573941704 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8011870 con 0x7fdbc014b440 2024-09-21T00:13:43.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.589+0000 7fdbb6000640 1 -- 172.21.15.83:0/1573941704 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbb8017070 con 0x7fdbc014b440 2024-09-21T00:13:43.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.589+0000 7fdbc5000640 1 -- 172.21.15.83:0/1573941704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc01f9390 con 0x7fdbc014b440 2024-09-21T00:13:43.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.589+0000 7fdbb6000640 1 -- 172.21.15.83:0/1573941704 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8011da0 con 0x7fdbc014b440 2024-09-21T00:13:43.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.589+0000 7fdbc5000640 1 -- 172.21.15.83:0/1573941704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc014ef50 con 0x7fdbc014b440 2024-09-21T00:13:43.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.589+0000 7fdbb6000640 1 -- 172.21.15.83:0/1573941704 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdbb801c460 con 0x7fdbc014b440 2024-09-21T00:13:43.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.589+0000 7fdbb6000640 1 -- 172.21.15.83:0/1573941704 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdbb801b850 con 0x7fdbc014b440 2024-09-21T00:13:43.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.590+0000 7fdbc5000640 1 -- 172.21.15.83:0/1573941704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc00d2f80 con 0x7fdbc014b440 2024-09-21T00:13:43.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.592+0000 7fdbb6000640 1 -- 172.21.15.83:0/1573941704 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdbc014bd90 con 0x7fdbc014b440 2024-09-21T00:13:43.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.656+0000 7fdbc5000640 1 -- 172.21.15.83:0/1573941704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fdbc0076180 con 0x7fdbc014b440 2024-09-21T00:13:43.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.656+0000 7fdbb6000640 1 -- 172.21.15.83:0/1573941704 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7fdbb801ba50 con 0x7fdbc014b440 2024-09-21T00:13:43.657 INFO:teuthology.orchestra.run.smithi083.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T00:13:43.657 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced client_mount_timeout 30 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced debug_client 20/20 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced debug_mgr 20/20 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced debug_ms 1/1 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced debug_mds 20/20 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced debug_ms 2/2 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:mds dev mds_debug_frag true 2024-09-21T00:13:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:mds dev mds_debug_scatterstat true 2024-09-21T00:13:43.659 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T00:13:43.659 INFO:teuthology.orchestra.run.smithi083.stdout:mds dev mds_verify_scatter true 2024-09-21T00:13:43.659 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T00:13:43.659 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T00:13:43.659 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T00:13:43.659 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced client_mount_timeout 600 2024-09-21T00:13:43.659 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced debug_client 20/20 2024-09-21T00:13:43.659 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced debug_ms 1/1 2024-09-21T00:13:43.659 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T00:13:43.659 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T00:13:43.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.657+0000 7fdbc5000640 1 -- 172.21.15.83:0/1573941704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbc014b440 msgr2=0x7fdbc014b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.657+0000 7fdbc5000640 1 --2- 172.21.15.83:0/1573941704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbc014b440 0x7fdbc014b850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00d0b90 tx=0x7fdbb8001a90 comp rx=0 tx=0).stop 2024-09-21T00:13:43.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.657+0000 7fdbc5000640 1 -- 172.21.15.83:0/1573941704 shutdown_connections 2024-09-21T00:13:43.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.657+0000 7fdbc5000640 1 --2- 172.21.15.83:0/1573941704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbc014b440 0x7fdbc014b850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.657+0000 7fdbc5000640 1 --2- 172.21.15.83:0/1573941704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc01f8740 0x7fdbc01f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.657+0000 7fdbc5000640 1 --2- 172.21.15.83:0/1573941704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba4004800 0x7fdbc014e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.657+0000 7fdbc5000640 1 -- 172.21.15.83:0/1573941704 >> 172.21.15.83:0/1573941704 conn(0x7fdbc00d4440 msgr2=0x7fdbc0160ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.657+0000 7fdbc5000640 1 -- 172.21.15.83:0/1573941704 shutdown_connections 2024-09-21T00:13:43.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.657+0000 7fdbc5000640 1 -- 172.21.15.83:0/1573941704 wait complete. 2024-09-21T00:13:43.682 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T00:13:43.682 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T00:13:43.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.901+0000 7f58b3200640 1 -- 172.21.15.83:0/344088730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5898005320 msgr2=0x7f589800b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.901+0000 7f58b3200640 1 --2- 172.21.15.83:0/344088730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5898005320 0x7f589800b9e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f58ac005fd0 tx=0x7f5898005830 comp rx=0 tx=0).stop 2024-09-21T00:13:43.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.901+0000 7f58b3200640 1 -- 172.21.15.83:0/344088730 shutdown_connections 2024-09-21T00:13:43.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.901+0000 7f58b3200640 1 --2- 172.21.15.83:0/344088730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5898005320 0x7f589800b9e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.901+0000 7f58b3200640 1 -- 172.21.15.83:0/344088730 >> 172.21.15.83:0/344088730 conn(0x7f58b40d1960 msgr2=0x7f58b40d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.901+0000 7f58b3200640 1 -- 172.21.15.83:0/344088730 shutdown_connections 2024-09-21T00:13:43.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.901+0000 7f58b3200640 1 -- 172.21.15.83:0/344088730 wait complete. 2024-09-21T00:13:43.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.903+0000 7f58b3200640 1 Processor -- start 2024-09-21T00:13:43.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.903+0000 7f58b3200640 1 -- start start 2024-09-21T00:13:43.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.904+0000 7f58b3200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5898005320 0x7f58b40ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b41f8bd0 0x7f58b40aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b3200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58b4160830 0x7f58b4160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:43.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b3200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4162830 con 0x7f58b4160830 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f58b41626b0 con 0x7f58b41f8bd0 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b3200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f58b41629b0 con 0x7f5898005320 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5898005320 0x7f58b40ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b2800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58b4160830 0x7f58b4160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5898005320 0x7f58b40ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:41006/0 (socket says 172.21.15.83:41006) 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b1e00640 1 -- 172.21.15.83:0/395392875 learned_addr learned my addr 172.21.15.83:0/395392875 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b1400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b41f8bd0 0x7f58b40aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b1e00640 1 -- 172.21.15.83:0/395392875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b41f8bd0 msgr2=0x7f58b40aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b1e00640 1 --2- 172.21.15.83:0/395392875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b41f8bd0 0x7f58b40aabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b1e00640 1 -- 172.21.15.83:0/395392875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58b4160830 msgr2=0x7f58b4160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b1e00640 1 --2- 172.21.15.83:0/395392875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58b4160830 0x7f58b4160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b1e00640 1 -- 172.21.15.83:0/395392875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b4161180 con 0x7f5898005320 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.905+0000 7f58b2800640 1 --2- 172.21.15.83:0/395392875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58b4160830 0x7f58b4160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:13:43.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.906+0000 7f58b1e00640 1 --2- 172.21.15.83:0/395392875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5898005320 0x7f58b40ca300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f58a40063d0 tx=0x7f58a40039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:43.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.906+0000 7f58aa000640 1 -- 172.21.15.83:0/395392875 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4015070 con 0x7f5898005320 2024-09-21T00:13:43.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.906+0000 7f58aa000640 1 -- 172.21.15.83:0/395392875 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58a4011840 con 0x7f5898005320 2024-09-21T00:13:43.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.906+0000 7f58b3200640 1 -- 172.21.15.83:0/395392875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b41f4ab0 con 0x7f5898005320 2024-09-21T00:13:43.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.906+0000 7f58aa000640 1 -- 172.21.15.83:0/395392875 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4011c90 con 0x7f5898005320 2024-09-21T00:13:43.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.906+0000 7f58b3200640 1 -- 172.21.15.83:0/395392875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b41f5070 con 0x7f5898005320 2024-09-21T00:13:43.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.906+0000 7f58aa000640 1 -- 172.21.15.83:0/395392875 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f58a4018070 con 0x7f5898005320 2024-09-21T00:13:43.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.906+0000 7f58aa000640 1 -- 172.21.15.83:0/395392875 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f58a40236e0 con 0x7f5898005320 2024-09-21T00:13:43.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.907+0000 7f58b3200640 1 -- 172.21.15.83:0/395392875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b40cf510 con 0x7f5898005320 2024-09-21T00:13:43.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.909+0000 7f58aa000640 1 -- 172.21.15.83:0/395392875 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f58b4161180 con 0x7f5898005320 2024-09-21T00:13:43.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.976+0000 7f58b3200640 1 -- 172.21.15.83:0/395392875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f58b4158b10 con 0x7f5898005320 2024-09-21T00:13:43.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.983+0000 7f58aa000640 1 -- 172.21.15.83:0/395392875 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f58a4010e10 con 0x7f5898005320 2024-09-21T00:13:43.984 INFO:teuthology.orchestra.run.smithi083.stderr:adjusted tunables profile to default 2024-09-21T00:13:43.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.984+0000 7f58b3200640 1 -- 172.21.15.83:0/395392875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5898005320 msgr2=0x7f58b40ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:43.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.984+0000 7f58b3200640 1 --2- 172.21.15.83:0/395392875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5898005320 0x7f58b40ca300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f58a40063d0 tx=0x7f58a40039c0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.984+0000 7f58b3200640 1 -- 172.21.15.83:0/395392875 shutdown_connections 2024-09-21T00:13:43.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.984+0000 7f58b3200640 1 --2- 172.21.15.83:0/395392875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58b4160830 0x7f58b4160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.984+0000 7f58b3200640 1 --2- 172.21.15.83:0/395392875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b41f8bd0 0x7f58b40aabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.984+0000 7f58b3200640 1 --2- 172.21.15.83:0/395392875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5898005320 0x7f58b40ca300 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:43.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.984+0000 7f58b3200640 1 -- 172.21.15.83:0/395392875 >> 172.21.15.83:0/395392875 conn(0x7f58b40d1960 msgr2=0x7f58b4157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:43.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.984+0000 7f58b3200640 1 -- 172.21.15.83:0/395392875 shutdown_connections 2024-09-21T00:13:43.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:43.984+0000 7f58b3200640 1 -- 172.21.15.83:0/395392875 wait complete. 2024-09-21T00:13:44.007 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T00:13:44.007 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T00:13:44.008 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:44.008 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T00:13:44.063 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:44.063 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T00:13:44.158 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:44.159 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T00:13:44.255 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:13:44.255 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T00:13:44.350 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:44.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T00:13:44.408 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:44.408 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T00:13:44.504 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:44.504 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T00:13:44.603 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:13:44.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T00:13:44.702 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new af1863d3-4393-46a1-9614-69443da83c29 0 2024-09-21T00:13:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.961+0000 7fbe6be00640 1 -- 172.21.15.142:0/2672961792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c06d2b0 msgr2=0x7fbe6c1621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.961+0000 7fbe6be00640 1 --2- 172.21.15.142:0/2672961792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c06d2b0 0x7fbe6c1621d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c005fd0 tx=0x7fbe5c02a560 comp rx=0 tx=0).stop 2024-09-21T00:13:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.962+0000 7fbe6be00640 1 -- 172.21.15.142:0/2672961792 shutdown_connections 2024-09-21T00:13:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.962+0000 7fbe6be00640 1 --2- 172.21.15.142:0/2672961792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c06d2b0 0x7fbe6c1621d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.962+0000 7fbe6be00640 1 -- 172.21.15.142:0/2672961792 >> 172.21.15.142:0/2672961792 conn(0x7fbe6c0d1960 msgr2=0x7fbe6c0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.962+0000 7fbe6be00640 1 -- 172.21.15.142:0/2672961792 shutdown_connections 2024-09-21T00:13:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.962+0000 7fbe6be00640 1 -- 172.21.15.142:0/2672961792 wait complete. 2024-09-21T00:13:44.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.964+0000 7fbe6be00640 1 Processor -- start 2024-09-21T00:13:44.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.964+0000 7fbe6be00640 1 -- start start 2024-09-21T00:13:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c06d2b0 0x7fbe6c143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c0cfa10 0x7fbe6c144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6be00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe6c162710 0x7fbe6c1f8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6be00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c1555b0 con 0x7fbe6c162710 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6be00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c0d3570 con 0x7fbe6c0cfa10 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6be00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbe6c155730 con 0x7fbe6c06d2b0 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c06d2b0 0x7fbe6c143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6a000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c0cfa10 0x7fbe6c144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c06d2b0 0x7fbe6c143140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:44658/0 (socket says 172.21.15.142:44658) 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6aa00640 1 -- 172.21.15.142:0/1128591695 learned_addr learned my addr 172.21.15.142:0/1128591695 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6b400640 1 --2- 172.21.15.142:0/1128591695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe6c162710 0x7fbe6c1f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6aa00640 1 -- 172.21.15.142:0/1128591695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c0cfa10 msgr2=0x7fbe6c144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6aa00640 1 --2- 172.21.15.142:0/1128591695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c0cfa10 0x7fbe6c144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6aa00640 1 -- 172.21.15.142:0/1128591695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe6c162710 msgr2=0x7fbe6c1f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6aa00640 1 --2- 172.21.15.142:0/1128591695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe6c162710 0x7fbe6c1f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.966+0000 7fbe6aa00640 1 -- 172.21.15.142:0/1128591695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6c144f50 con 0x7fbe6c06d2b0 2024-09-21T00:13:44.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.967+0000 7fbe6aa00640 1 --2- 172.21.15.142:0/1128591695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c06d2b0 0x7fbe6c143140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c034040 tx=0x7fbe5c003910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:44.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.967+0000 7fbe63400640 1 -- 172.21.15.142:0/1128591695 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c03e030 con 0x7fbe6c06d2b0 2024-09-21T00:13:44.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.967+0000 7fbe63400640 1 -- 172.21.15.142:0/1128591695 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe5c003e00 con 0x7fbe6c06d2b0 2024-09-21T00:13:44.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.967+0000 7fbe6be00640 1 -- 172.21.15.142:0/1128591695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6c143970 con 0x7fbe6c06d2b0 2024-09-21T00:13:44.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.967+0000 7fbe63400640 1 -- 172.21.15.142:0/1128591695 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c035040 con 0x7fbe6c06d2b0 2024-09-21T00:13:44.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.967+0000 7fbe6be00640 1 -- 172.21.15.142:0/1128591695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6c143f30 con 0x7fbe6c06d2b0 2024-09-21T00:13:44.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.968+0000 7fbe63400640 1 -- 172.21.15.142:0/1128591695 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbe5c041030 con 0x7fbe6c06d2b0 2024-09-21T00:13:44.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.968+0000 7fbe63400640 1 -- 172.21.15.142:0/1128591695 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fbe5c043ca0 con 0x7fbe6c06d2b0 2024-09-21T00:13:44.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.968+0000 7fbe6be00640 1 -- 172.21.15.142:0/1128591695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe6c1621d0 con 0x7fbe6c06d2b0 2024-09-21T00:13:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:44.971+0000 7fbe63400640 1 -- 172.21.15.142:0/1128591695 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbe5c043410 con 0x7fbe6c06d2b0 2024-09-21T00:13:45.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.044+0000 7fbe6be00640 1 -- 172.21.15.142:0/1128591695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "af1863d3-4393-46a1-9614-69443da83c29", "id": 0} v 0) -- 0x7fbe6c076180 con 0x7fbe6c06d2b0 2024-09-21T00:13:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.052+0000 7fbe63400640 1 -- 172.21.15.142:0/1128591695 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af1863d3-4393-46a1-9614-69443da83c29", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fbe5c004ed0 con 0x7fbe6c06d2b0 2024-09-21T00:13:45.054 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-09-21T00:13:45.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.054+0000 7fbe6be00640 1 -- 172.21.15.142:0/1128591695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c06d2b0 msgr2=0x7fbe6c143140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.054+0000 7fbe6be00640 1 --2- 172.21.15.142:0/1128591695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c06d2b0 0x7fbe6c143140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c034040 tx=0x7fbe5c003910 comp rx=0 tx=0).stop 2024-09-21T00:13:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.054+0000 7fbe6be00640 1 -- 172.21.15.142:0/1128591695 shutdown_connections 2024-09-21T00:13:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.054+0000 7fbe6be00640 1 --2- 172.21.15.142:0/1128591695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe6c162710 0x7fbe6c1f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.054+0000 7fbe6be00640 1 --2- 172.21.15.142:0/1128591695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c0cfa10 0x7fbe6c144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.054+0000 7fbe6be00640 1 --2- 172.21.15.142:0/1128591695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c06d2b0 0x7fbe6c143140 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.054+0000 7fbe6be00640 1 -- 172.21.15.142:0/1128591695 >> 172.21.15.142:0/1128591695 conn(0x7fbe6c0d1960 msgr2=0x7fbe6c0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.054+0000 7fbe6be00640 1 -- 172.21.15.142:0/1128591695 shutdown_connections 2024-09-21T00:13:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.054+0000 7fbe6be00640 1 -- 172.21.15.142:0/1128591695 wait complete. 2024-09-21T00:13:45.075 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 63121bd4-ab9f-45ef-960a-26db2f18a0cd 1 2024-09-21T00:13:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.293+0000 7f9648800640 1 -- 172.21.15.142:0/2044125719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9640074cb0 msgr2=0x7f9640073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.293+0000 7f9648800640 1 --2- 172.21.15.142:0/2044125719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9640074cb0 0x7f9640073dd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9634005fd0 tx=0x7f963402a5d0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.294+0000 7f9648800640 1 -- 172.21.15.142:0/2044125719 shutdown_connections 2024-09-21T00:13:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.294+0000 7f9648800640 1 --2- 172.21.15.142:0/2044125719 >> v2:172.21.15.142:3300/0 conn(0x7f96400cbc10 0x7f96400cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.294+0000 7f9648800640 1 --2- 172.21.15.142:0/2044125719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9640074cb0 0x7f9640073dd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.294+0000 7f9648800640 1 -- 172.21.15.142:0/2044125719 >> 172.21.15.142:0/2044125719 conn(0x7f96400cca40 msgr2=0x7f96400cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.294+0000 7f9648800640 1 -- 172.21.15.142:0/2044125719 shutdown_connections 2024-09-21T00:13:45.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.294+0000 7f9648800640 1 -- 172.21.15.142:0/2044125719 wait complete. 2024-09-21T00:13:45.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.296+0000 7f9648800640 1 Processor -- start 2024-09-21T00:13:45.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.296+0000 7f9648800640 1 -- start start 2024-09-21T00:13:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.297+0000 7f9648800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964006ddf0 0x7f964009d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.297+0000 7f9648800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9640074cb0 0x7f964015ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.297+0000 7f9648800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400cbc10 0x7f9640158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.297+0000 7f9648800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f964006f360 con 0x7f9640074cb0 2024-09-21T00:13:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9648800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f964006f1e0 con 0x7f96400cbc10 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9648800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f964006f4e0 con 0x7f964006ddf0 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9646800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400cbc10 0x7f9640158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9646800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400cbc10 0x7f9640158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59530/0 (socket says 172.21.15.142:59530) 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9645400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9640074cb0 0x7f964015ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9646800640 1 -- 172.21.15.142:0/3514340667 learned_addr learned my addr 172.21.15.142:0/3514340667 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9645e00640 1 --2- 172.21.15.142:0/3514340667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964006ddf0 0x7f964009d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9646800640 1 -- 172.21.15.142:0/3514340667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964006ddf0 msgr2=0x7f964009d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9646800640 1 --2- 172.21.15.142:0/3514340667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964006ddf0 0x7f964009d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9646800640 1 -- 172.21.15.142:0/3514340667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9640074cb0 msgr2=0x7f964015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9646800640 1 --2- 172.21.15.142:0/3514340667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9640074cb0 0x7f964015ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.298+0000 7f9646800640 1 -- 172.21.15.142:0/3514340667 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96400c8b90 con 0x7f96400cbc10 2024-09-21T00:13:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.299+0000 7f9646800640 1 --2- 172.21.15.142:0/3514340667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400cbc10 0x7f9640158770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f963c00c6b0 tx=0x7f963c00cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:45.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.299+0000 7f963a000640 1 -- 172.21.15.142:0/3514340667 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c003b70 con 0x7f96400cbc10 2024-09-21T00:13:45.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.299+0000 7f963a000640 1 -- 172.21.15.142:0/3514340667 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f963c003d30 con 0x7f96400cbc10 2024-09-21T00:13:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.299+0000 7f9648800640 1 -- 172.21.15.142:0/3514340667 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96401f9cf0 con 0x7f96400cbc10 2024-09-21T00:13:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.299+0000 7f963a000640 1 -- 172.21.15.142:0/3514340667 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c005330 con 0x7f96400cbc10 2024-09-21T00:13:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.299+0000 7f9648800640 1 -- 172.21.15.142:0/3514340667 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964009beb0 con 0x7f96400cbc10 2024-09-21T00:13:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.299+0000 7f963a000640 1 -- 172.21.15.142:0/3514340667 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f963c0054d0 con 0x7f96400cbc10 2024-09-21T00:13:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.299+0000 7f963a000640 1 -- 172.21.15.142:0/3514340667 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f963c012630 con 0x7f96400cbc10 2024-09-21T00:13:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.300+0000 7f9648800640 1 -- 172.21.15.142:0/3514340667 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96400c8d60 con 0x7f96400cbc10 2024-09-21T00:13:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.302+0000 7f963a000640 1 -- 172.21.15.142:0/3514340667 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f963c012830 con 0x7f96400cbc10 2024-09-21T00:13:45.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.375+0000 7f9648800640 1 -- 172.21.15.142:0/3514340667 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "63121bd4-ab9f-45ef-960a-26db2f18a0cd", "id": 1} v 0) -- 0x7f964006fa00 con 0x7f96400cbc10 2024-09-21T00:13:45.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.382+0000 7f963a000640 1 -- 172.21.15.142:0/3514340667 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "63121bd4-ab9f-45ef-960a-26db2f18a0cd", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f963c012a10 con 0x7f96400cbc10 2024-09-21T00:13:45.386 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-09-21T00:13:45.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.383+0000 7f9648800640 1 -- 172.21.15.142:0/3514340667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400cbc10 msgr2=0x7f9640158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.383+0000 7f9648800640 1 --2- 172.21.15.142:0/3514340667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400cbc10 0x7f9640158770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f963c00c6b0 tx=0x7f963c00cb70 comp rx=0 tx=0).stop 2024-09-21T00:13:45.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.383+0000 7f9648800640 1 -- 172.21.15.142:0/3514340667 shutdown_connections 2024-09-21T00:13:45.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.383+0000 7f9648800640 1 --2- 172.21.15.142:0/3514340667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400cbc10 0x7f9640158770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.383+0000 7f9648800640 1 --2- 172.21.15.142:0/3514340667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9640074cb0 0x7f964015ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.383+0000 7f9648800640 1 --2- 172.21.15.142:0/3514340667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964006ddf0 0x7f964009d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.383+0000 7f9648800640 1 -- 172.21.15.142:0/3514340667 >> 172.21.15.142:0/3514340667 conn(0x7f96400cca40 msgr2=0x7f96400cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:45.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.384+0000 7f9648800640 1 -- 172.21.15.142:0/3514340667 shutdown_connections 2024-09-21T00:13:45.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.384+0000 7f9648800640 1 -- 172.21.15.142:0/3514340667 wait complete. 2024-09-21T00:13:45.410 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new d1a0fa44-ff1c-416b-abf1-473c09231294 2 2024-09-21T00:13:45.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.639+0000 7f077be00640 1 -- 172.21.15.142:0/1769450760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c15e4d0 msgr2=0x7f077c0b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.639+0000 7f077be00640 1 --2- 172.21.15.142:0/1769450760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c15e4d0 0x7f077c0b7720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f077c08c580 tx=0x7f076c02a4d0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.639+0000 7f077be00640 1 -- 172.21.15.142:0/1769450760 shutdown_connections 2024-09-21T00:13:45.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.639+0000 7f077be00640 1 --2- 172.21.15.142:0/1769450760 >> v2:172.21.15.83:3300/0 conn(0x7f077c0b7c60 0x7f077c0d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.639+0000 7f077be00640 1 --2- 172.21.15.142:0/1769450760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c15e4d0 0x7f077c0b7720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.639+0000 7f077be00640 1 -- 172.21.15.142:0/1769450760 >> 172.21.15.142:0/1769450760 conn(0x7f077c0d1980 msgr2=0x7f077c0d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.640+0000 7f077be00640 1 -- 172.21.15.142:0/1769450760 shutdown_connections 2024-09-21T00:13:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.640+0000 7f077be00640 1 -- 172.21.15.142:0/1769450760 wait complete. 2024-09-21T00:13:45.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.642+0000 7f077be00640 1 Processor -- start 2024-09-21T00:13:45.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.642+0000 7f077be00640 1 -- start start 2024-09-21T00:13:45.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.643+0000 7f077be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f077c0b7c60 0x7f077c0b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.643+0000 7f077be00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077c0d3960 0x7f077c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.643+0000 7f077be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c15e4d0 0x7f077c158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.643+0000 7f077be00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f077c06e020 con 0x7f077c0d3960 2024-09-21T00:13:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.643+0000 7f077be00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f077c06dea0 con 0x7f077c15e4d0 2024-09-21T00:13:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.643+0000 7f077be00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f077c06e1a0 con 0x7f077c0b7c60 2024-09-21T00:13:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f077aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f077c0b7c60 0x7f077c0b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f077b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c15e4d0 0x7f077c158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f077aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f077c0b7c60 0x7f077c0b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:44690/0 (socket says 172.21.15.142:44690) 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f077aa00640 1 -- 172.21.15.142:0/2805446594 learned_addr learned my addr 172.21.15.142:0/2805446594 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f0773e00640 1 --2- 172.21.15.142:0/2805446594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077c0d3960 0x7f077c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f077aa00640 1 -- 172.21.15.142:0/2805446594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c15e4d0 msgr2=0x7f077c158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f077aa00640 1 --2- 172.21.15.142:0/2805446594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c15e4d0 0x7f077c158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f077aa00640 1 -- 172.21.15.142:0/2805446594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077c0d3960 msgr2=0x7f077c14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f077aa00640 1 --2- 172.21.15.142:0/2805446594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077c0d3960 0x7f077c14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f077aa00640 1 -- 172.21.15.142:0/2805446594 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c14bb80 con 0x7f077c0b7c60 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f0773e00640 1 --2- 172.21.15.142:0/2805446594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077c0d3960 0x7f077c14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:13:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.644+0000 7f077aa00640 1 --2- 172.21.15.142:0/2805446594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f077c0b7c60 0x7f077c0b6690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f076c034040 tx=0x7f076c003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:45.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.645+0000 7f0772a00640 1 -- 172.21.15.142:0/2805446594 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c03e030 con 0x7f077c0b7c60 2024-09-21T00:13:45.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.645+0000 7f0772a00640 1 -- 172.21.15.142:0/2805446594 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f076c003d10 con 0x7f077c0b7c60 2024-09-21T00:13:45.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.645+0000 7f0772a00640 1 -- 172.21.15.142:0/2805446594 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c035040 con 0x7f077c0b7c60 2024-09-21T00:13:45.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.645+0000 7f077be00640 1 -- 172.21.15.142:0/2805446594 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077c0b61e0 con 0x7f077c0b7c60 2024-09-21T00:13:45.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.645+0000 7f077be00640 1 -- 172.21.15.142:0/2805446594 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f077c158710 con 0x7f077c0b7c60 2024-09-21T00:13:45.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.645+0000 7f0772a00640 1 -- 172.21.15.142:0/2805446594 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f076c041030 con 0x7f077c0b7c60 2024-09-21T00:13:45.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.645+0000 7f0772a00640 1 -- 172.21.15.142:0/2805446594 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f076c043ce0 con 0x7f077c0b7c60 2024-09-21T00:13:45.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.646+0000 7f077be00640 1 -- 172.21.15.142:0/2805446594 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077c0d3120 con 0x7f077c0b7c60 2024-09-21T00:13:45.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.649+0000 7f0772a00640 1 -- 172.21.15.142:0/2805446594 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f077c0d3120 con 0x7f077c0b7c60 2024-09-21T00:13:45.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.722+0000 7f077be00640 1 -- 172.21.15.142:0/2805446594 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d1a0fa44-ff1c-416b-abf1-473c09231294", "id": 2} v 0) -- 0x7f077c0d3420 con 0x7f077c0b7c60 2024-09-21T00:13:45.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.727+0000 7f0772a00640 1 -- 172.21.15.142:0/2805446594 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1a0fa44-ff1c-416b-abf1-473c09231294", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f076c043410 con 0x7f077c0b7c60 2024-09-21T00:13:45.729 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-09-21T00:13:45.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.728+0000 7f077be00640 1 -- 172.21.15.142:0/2805446594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f077c0b7c60 msgr2=0x7f077c0b6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.728+0000 7f077be00640 1 --2- 172.21.15.142:0/2805446594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f077c0b7c60 0x7f077c0b6690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f076c034040 tx=0x7f076c003820 comp rx=0 tx=0).stop 2024-09-21T00:13:45.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.729+0000 7f077be00640 1 -- 172.21.15.142:0/2805446594 shutdown_connections 2024-09-21T00:13:45.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.729+0000 7f077be00640 1 --2- 172.21.15.142:0/2805446594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c15e4d0 0x7f077c158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.729+0000 7f077be00640 1 --2- 172.21.15.142:0/2805446594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077c0d3960 0x7f077c14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.729+0000 7f077be00640 1 --2- 172.21.15.142:0/2805446594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f077c0b7c60 0x7f077c0b6690 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.729+0000 7f077be00640 1 -- 172.21.15.142:0/2805446594 >> 172.21.15.142:0/2805446594 conn(0x7f077c0d1980 msgr2=0x7f077c0d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:45.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.729+0000 7f077be00640 1 -- 172.21.15.142:0/2805446594 shutdown_connections 2024-09-21T00:13:45.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.729+0000 7f077be00640 1 -- 172.21.15.142:0/2805446594 wait complete. 2024-09-21T00:13:45.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new b981efc2-7f3e-4d16-93ea-5a1c126fa745 3 2024-09-21T00:13:45.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.979+0000 7f3ad7c00640 1 -- 172.21.15.142:0/2735831246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ad00ceb90 msgr2=0x7f3ad00cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.979+0000 7f3ad7c00640 1 --2- 172.21.15.142:0/2735831246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ad00ceb90 0x7f3ad00cefa0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009be0 tx=0x7f3ac802a890 comp rx=0 tx=0).stop 2024-09-21T00:13:45.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.979+0000 7f3ad7c00640 1 -- 172.21.15.142:0/2735831246 shutdown_connections 2024-09-21T00:13:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.979+0000 7f3ad7c00640 1 --2- 172.21.15.142:0/2735831246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ad00ceb90 0x7f3ad00cefa0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.979+0000 7f3ad7c00640 1 -- 172.21.15.142:0/2735831246 >> 172.21.15.142:0/2735831246 conn(0x7f3ad009d830 msgr2=0x7f3ad00b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.979+0000 7f3ad7c00640 1 -- 172.21.15.142:0/2735831246 shutdown_connections 2024-09-21T00:13:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.979+0000 7f3ad7c00640 1 -- 172.21.15.142:0/2735831246 wait complete. 2024-09-21T00:13:45.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.981+0000 7f3ad7c00640 1 Processor -- start 2024-09-21T00:13:45.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.981+0000 7f3ad7c00640 1 -- start start 2024-09-21T00:13:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3ad7c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ad00ceb90 0x7f3ad006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3ad7c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ad00d0170 0x7f3ad01f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3ad7c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ad015ee80 0x7f3ad0157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3ad7c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00b6910 con 0x7f3ad00ceb90 2024-09-21T00:13:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3ad7c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00b6790 con 0x7f3ad015ee80 2024-09-21T00:13:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3ad7c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad00b6a90 con 0x7f3ad00d0170 2024-09-21T00:13:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3ad5c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ad015ee80 0x7f3ad0157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3ad5c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ad015ee80 0x7f3ad0157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59562/0 (socket says 172.21.15.142:59562) 2024-09-21T00:13:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3ad5c00640 1 -- 172.21.15.142:0/4221532331 learned_addr learned my addr 172.21.15.142:0/4221532331 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T00:13:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3acfe00640 1 --2- 172.21.15.142:0/4221532331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ad00d0170 0x7f3ad01f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.983+0000 7f3ad5200640 1 --2- 172.21.15.142:0/4221532331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ad00ceb90 0x7f3ad006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:45.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3ad5c00640 1 -- 172.21.15.142:0/4221532331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ad00d0170 msgr2=0x7f3ad01f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3ad5c00640 1 --2- 172.21.15.142:0/4221532331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ad00d0170 0x7f3ad01f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3ad5c00640 1 -- 172.21.15.142:0/4221532331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ad00ceb90 msgr2=0x7f3ad006dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:45.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3ad5c00640 1 --2- 172.21.15.142:0/4221532331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ad00ceb90 0x7f3ad006dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:45.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3ad5c00640 1 -- 172.21.15.142:0/4221532331 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad006cf10 con 0x7f3ad015ee80 2024-09-21T00:13:45.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3ad5c00640 1 --2- 172.21.15.142:0/4221532331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ad015ee80 0x7f3ad0157c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8006010 tx=0x7f3ac8033f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:45.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3accc00640 1 -- 172.21.15.142:0/4221532331 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8003e00 con 0x7f3ad015ee80 2024-09-21T00:13:45.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3accc00640 1 -- 172.21.15.142:0/4221532331 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ac8031a60 con 0x7f3ad015ee80 2024-09-21T00:13:45.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3accc00640 1 -- 172.21.15.142:0/4221532331 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80330d0 con 0x7f3ad015ee80 2024-09-21T00:13:45.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3ad7c00640 1 -- 172.21.15.142:0/4221532331 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad006d1f0 con 0x7f3ad015ee80 2024-09-21T00:13:45.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.984+0000 7f3ad7c00640 1 -- 172.21.15.142:0/4221532331 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad0159f80 con 0x7f3ad015ee80 2024-09-21T00:13:45.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.985+0000 7f3accc00640 1 -- 172.21.15.142:0/4221532331 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3ac8033270 con 0x7f3ad015ee80 2024-09-21T00:13:45.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.985+0000 7f3accc00640 1 -- 172.21.15.142:0/4221532331 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3ac8033560 con 0x7f3ad015ee80 2024-09-21T00:13:45.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.986+0000 7f3ad7c00640 1 -- 172.21.15.142:0/4221532331 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad006ed20 con 0x7f3ad015ee80 2024-09-21T00:13:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:45.988+0000 7f3accc00640 1 -- 172.21.15.142:0/4221532331 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3ac803f030 con 0x7f3ad015ee80 2024-09-21T00:13:46.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.061+0000 7f3ad7c00640 1 -- 172.21.15.142:0/4221532331 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b981efc2-7f3e-4d16-93ea-5a1c126fa745", "id": 3} v 0) -- 0x7f3ad00b9d80 con 0x7f3ad015ee80 2024-09-21T00:13:46.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.066+0000 7f3accc00640 1 -- 172.21.15.142:0/4221532331 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b981efc2-7f3e-4d16-93ea-5a1c126fa745", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f3ad00b9d80 con 0x7f3ad015ee80 2024-09-21T00:13:46.067 INFO:teuthology.orchestra.run.smithi142.stdout:3 2024-09-21T00:13:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.067+0000 7f3ad7c00640 1 -- 172.21.15.142:0/4221532331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ad015ee80 msgr2=0x7f3ad0157c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.067+0000 7f3ad7c00640 1 --2- 172.21.15.142:0/4221532331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ad015ee80 0x7f3ad0157c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8006010 tx=0x7f3ac8033f30 comp rx=0 tx=0).stop 2024-09-21T00:13:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.067+0000 7f3ad7c00640 1 -- 172.21.15.142:0/4221532331 shutdown_connections 2024-09-21T00:13:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.067+0000 7f3ad7c00640 1 --2- 172.21.15.142:0/4221532331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ad015ee80 0x7f3ad0157c30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.067+0000 7f3ad7c00640 1 --2- 172.21.15.142:0/4221532331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ad00d0170 0x7f3ad01f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.067+0000 7f3ad7c00640 1 --2- 172.21.15.142:0/4221532331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ad00ceb90 0x7f3ad006dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.067+0000 7f3ad7c00640 1 -- 172.21.15.142:0/4221532331 >> 172.21.15.142:0/4221532331 conn(0x7f3ad009d830 msgr2=0x7f3ad0161640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:46.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.067+0000 7f3ad7c00640 1 -- 172.21.15.142:0/4221532331 shutdown_connections 2024-09-21T00:13:46.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.067+0000 7f3ad7c00640 1 -- 172.21.15.142:0/4221532331 wait complete. 2024-09-21T00:13:46.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822 4 2024-09-21T00:13:46.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.312+0000 7f47d7e00640 1 -- 172.21.15.142:0/372434083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d815e4d0 msgr2=0x7f47d80b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.312+0000 7f47d7e00640 1 --2- 172.21.15.142:0/372434083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d815e4d0 0x7f47d80b7720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f47d80d4170 tx=0x7f47c802a480 comp rx=0 tx=0).stop 2024-09-21T00:13:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.312+0000 7f47d7e00640 1 -- 172.21.15.142:0/372434083 shutdown_connections 2024-09-21T00:13:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.312+0000 7f47d7e00640 1 --2- 172.21.15.142:0/372434083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d815e4d0 0x7f47d80b7720 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.312+0000 7f47d7e00640 1 -- 172.21.15.142:0/372434083 >> 172.21.15.142:0/372434083 conn(0x7f47d80d1980 msgr2=0x7f47d80d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.312+0000 7f47d7e00640 1 -- 172.21.15.142:0/372434083 shutdown_connections 2024-09-21T00:13:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.312+0000 7f47d7e00640 1 -- 172.21.15.142:0/372434083 wait complete. 2024-09-21T00:13:46.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.314+0000 7f47d7e00640 1 Processor -- start 2024-09-21T00:13:46.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.314+0000 7f47d7e00640 1 -- start start 2024-09-21T00:13:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47d7e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80b7c60 0x7f47d8157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47d7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d815e4d0 0x7f47d815a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47d7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d81620c0 0x7f47d80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47d7e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f47d806e0d0 con 0x7f47d80b7c60 2024-09-21T00:13:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47d7e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f47d806df50 con 0x7f47d815e4d0 2024-09-21T00:13:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47d7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f47d806e250 con 0x7f47d81620c0 2024-09-21T00:13:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47cfe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d815e4d0 0x7f47d815a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47d6a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80b7c60 0x7f47d8157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47cfe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d815e4d0 0x7f47d815a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59570/0 (socket says 172.21.15.142:59570) 2024-09-21T00:13:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47cfe00640 1 -- 172.21.15.142:0/3657491590 learned_addr learned my addr 172.21.15.142:0/3657491590 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T00:13:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.316+0000 7f47d7400640 1 --2- 172.21.15.142:0/3657491590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d81620c0 0x7f47d80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47d6a00640 1 -- 172.21.15.142:0/3657491590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d81620c0 msgr2=0x7f47d80ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47d6a00640 1 --2- 172.21.15.142:0/3657491590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d81620c0 0x7f47d80ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47d6a00640 1 -- 172.21.15.142:0/3657491590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d815e4d0 msgr2=0x7f47d815a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47d6a00640 1 --2- 172.21.15.142:0/3657491590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d815e4d0 0x7f47d815a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47d6a00640 1 -- 172.21.15.142:0/3657491590 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d81581c0 con 0x7f47d80b7c60 2024-09-21T00:13:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47d6a00640 1 --2- 172.21.15.142:0/3657491590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80b7c60 0x7f47d8157b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47c8031000 tx=0x7f47c8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47cea00640 1 -- 172.21.15.142:0/3657491590 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8031d60 con 0x7f47d80b7c60 2024-09-21T00:13:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47cea00640 1 -- 172.21.15.142:0/3657491590 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47c8033e10 con 0x7f47d80b7c60 2024-09-21T00:13:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47cea00640 1 -- 172.21.15.142:0/3657491590 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8005280 con 0x7f47d80b7c60 2024-09-21T00:13:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47d7e00640 1 -- 172.21.15.142:0/3657491590 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d81584a0 con 0x7f47d80b7c60 2024-09-21T00:13:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.317+0000 7f47d7e00640 1 -- 172.21.15.142:0/3657491590 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d80b5110 con 0x7f47d80b7c60 2024-09-21T00:13:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.318+0000 7f47cea00640 1 -- 172.21.15.142:0/3657491590 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f47c80047a0 con 0x7f47d80b7c60 2024-09-21T00:13:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.318+0000 7f47cea00640 1 -- 172.21.15.142:0/3657491590 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f47c8033300 con 0x7f47d80b7c60 2024-09-21T00:13:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.318+0000 7f47d7e00640 1 -- 172.21.15.142:0/3657491590 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d80b7720 con 0x7f47d80b7c60 2024-09-21T00:13:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.323+0000 7f47cea00640 1 -- 172.21.15.142:0/3657491590 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f47c803f030 con 0x7f47d80b7c60 2024-09-21T00:13:46.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.397+0000 7f47d7e00640 1 -- 172.21.15.142:0/3657491590 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822", "id": 4} v 0) -- 0x7f47d80d4600 con 0x7f47d80b7c60 2024-09-21T00:13:46.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.399+0000 7f47cea00640 1 -- 172.21.15.142:0/3657491590 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f47c8031770 con 0x7f47d80b7c60 2024-09-21T00:13:46.401 INFO:teuthology.orchestra.run.smithi142.stdout:4 2024-09-21T00:13:46.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.400+0000 7f47d7e00640 1 -- 172.21.15.142:0/3657491590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80b7c60 msgr2=0x7f47d8157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.400+0000 7f47d7e00640 1 --2- 172.21.15.142:0/3657491590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80b7c60 0x7f47d8157b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47c8031000 tx=0x7f47c8033c20 comp rx=0 tx=0).stop 2024-09-21T00:13:46.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.401+0000 7f47d7e00640 1 -- 172.21.15.142:0/3657491590 shutdown_connections 2024-09-21T00:13:46.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.401+0000 7f47d7e00640 1 --2- 172.21.15.142:0/3657491590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d81620c0 0x7f47d80ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.401+0000 7f47d7e00640 1 --2- 172.21.15.142:0/3657491590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d815e4d0 0x7f47d815a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.401+0000 7f47d7e00640 1 --2- 172.21.15.142:0/3657491590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80b7c60 0x7f47d8157b00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.401+0000 7f47d7e00640 1 -- 172.21.15.142:0/3657491590 >> 172.21.15.142:0/3657491590 conn(0x7f47d80d1980 msgr2=0x7f47d80ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:46.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.401+0000 7f47d7e00640 1 -- 172.21.15.142:0/3657491590 shutdown_connections 2024-09-21T00:13:46.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.401+0000 7f47d7e00640 1 -- 172.21.15.142:0/3657491590 wait complete. 2024-09-21T00:13:46.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 9596ec5c-75ff-4aa3-93d9-82ecda0b10c9 5 2024-09-21T00:13:46.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.637+0000 7fe644a00640 1 -- 172.21.15.142:0/1537351021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe640162590 msgr2=0x7fe6401629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.637+0000 7fe644a00640 1 --2- 172.21.15.142:0/1537351021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe640162590 0x7fe6401629a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe64008d3b0 tx=0x7fe62c02a560 comp rx=0 tx=0).stop 2024-09-21T00:13:46.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.637+0000 7fe644a00640 1 -- 172.21.15.142:0/1537351021 shutdown_connections 2024-09-21T00:13:46.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.637+0000 7fe644a00640 1 --2- 172.21.15.142:0/1537351021 >> v2:172.21.15.83:3300/0 conn(0x7fe6400b2e60 0x7fe6400b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.637+0000 7fe644a00640 1 --2- 172.21.15.142:0/1537351021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe640162590 0x7fe6401629a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.637+0000 7fe644a00640 1 --2- 172.21.15.142:0/1537351021 >> v2:172.21.15.142:3300/0 conn(0x7fe6400cfe00 0x7fe6400d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.637+0000 7fe644a00640 1 -- 172.21.15.142:0/1537351021 >> 172.21.15.142:0/1537351021 conn(0x7fe6400d4440 msgr2=0x7fe6400d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:46.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.637+0000 7fe644a00640 1 -- 172.21.15.142:0/1537351021 shutdown_connections 2024-09-21T00:13:46.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.637+0000 7fe644a00640 1 -- 172.21.15.142:0/1537351021 wait complete. 2024-09-21T00:13:46.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.639+0000 7fe644a00640 1 Processor -- start 2024-09-21T00:13:46.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.639+0000 7fe644a00640 1 -- start start 2024-09-21T00:13:46.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe644a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6400b2e60 0x7fe6401f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe644a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6400cfe00 0x7fe64015dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe644a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe640162590 0x7fe64015e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe644a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe6400b37b0 con 0x7fe640162590 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe644a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe6400cf5a0 con 0x7fe6400b2e60 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe644a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe6400b3930 con 0x7fe6400cfe00 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe63de00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6400b2e60 0x7fe6401f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe63d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6400cfe00 0x7fe64015dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe63de00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6400b2e60 0x7fe6401f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59574/0 (socket says 172.21.15.142:59574) 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe63de00640 1 -- 172.21.15.142:0/2085408019 learned_addr learned my addr 172.21.15.142:0/2085408019 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.641+0000 7fe63e800640 1 --2- 172.21.15.142:0/2085408019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe640162590 0x7fe64015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe63d400640 1 -- 172.21.15.142:0/2085408019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6400b2e60 msgr2=0x7fe6401f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe63d400640 1 --2- 172.21.15.142:0/2085408019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6400b2e60 0x7fe6401f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe63d400640 1 -- 172.21.15.142:0/2085408019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe640162590 msgr2=0x7fe64015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe63d400640 1 --2- 172.21.15.142:0/2085408019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe640162590 0x7fe64015e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe63d400640 1 -- 172.21.15.142:0/2085408019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6401f95b0 con 0x7fe6400cfe00 2024-09-21T00:13:46.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe63d400640 1 --2- 172.21.15.142:0/2085408019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6400cfe00 0x7fe64015dbf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe62c031000 tx=0x7fe62c0038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:46.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe636000640 1 -- 172.21.15.142:0/2085408019 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c03e030 con 0x7fe6400cfe00 2024-09-21T00:13:46.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe636000640 1 -- 172.21.15.142:0/2085408019 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe62c003ca0 con 0x7fe6400cfe00 2024-09-21T00:13:46.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe644a00640 1 -- 172.21.15.142:0/2085408019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64015d110 con 0x7fe6400cfe00 2024-09-21T00:13:46.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe636000640 1 -- 172.21.15.142:0/2085408019 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c035040 con 0x7fe6400cfe00 2024-09-21T00:13:46.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.642+0000 7fe644a00640 1 -- 172.21.15.142:0/2085408019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe640155300 con 0x7fe6400cfe00 2024-09-21T00:13:46.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.643+0000 7fe636000640 1 -- 172.21.15.142:0/2085408019 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe62c041030 con 0x7fe6400cfe00 2024-09-21T00:13:46.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.643+0000 7fe636000640 1 -- 172.21.15.142:0/2085408019 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe62c043bc0 con 0x7fe6400cfe00 2024-09-21T00:13:46.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.643+0000 7fe644a00640 1 -- 172.21.15.142:0/2085408019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6400d2a20 con 0x7fe6400cfe00 2024-09-21T00:13:46.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.647+0000 7fe636000640 1 -- 172.21.15.142:0/2085408019 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe62c004d90 con 0x7fe6400cfe00 2024-09-21T00:13:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.722+0000 7fe644a00640 1 -- 172.21.15.142:0/2085408019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9596ec5c-75ff-4aa3-93d9-82ecda0b10c9", "id": 5} v 0) -- 0x7fe64015cec0 con 0x7fe6400cfe00 2024-09-21T00:13:46.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.727+0000 7fe636000640 1 -- 172.21.15.142:0/2085408019 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9596ec5c-75ff-4aa3-93d9-82ecda0b10c9", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe62c004f70 con 0x7fe6400cfe00 2024-09-21T00:13:46.728 INFO:teuthology.orchestra.run.smithi142.stdout:5 2024-09-21T00:13:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.728+0000 7fe644a00640 1 -- 172.21.15.142:0/2085408019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6400cfe00 msgr2=0x7fe64015dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.728+0000 7fe644a00640 1 --2- 172.21.15.142:0/2085408019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6400cfe00 0x7fe64015dbf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe62c031000 tx=0x7fe62c0038a0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.728+0000 7fe644a00640 1 -- 172.21.15.142:0/2085408019 shutdown_connections 2024-09-21T00:13:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.728+0000 7fe644a00640 1 --2- 172.21.15.142:0/2085408019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe640162590 0x7fe64015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.728+0000 7fe644a00640 1 --2- 172.21.15.142:0/2085408019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6400cfe00 0x7fe64015dbf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.728+0000 7fe644a00640 1 --2- 172.21.15.142:0/2085408019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6400b2e60 0x7fe6401f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.728+0000 7fe644a00640 1 -- 172.21.15.142:0/2085408019 >> 172.21.15.142:0/2085408019 conn(0x7fe6400d4440 msgr2=0x7fe6400d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.728+0000 7fe644a00640 1 -- 172.21.15.142:0/2085408019 shutdown_connections 2024-09-21T00:13:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.728+0000 7fe644a00640 1 -- 172.21.15.142:0/2085408019 wait complete. 2024-09-21T00:13:46.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 4b631676-f08f-4b67-b2ca-5c46a9e181e6 6 2024-09-21T00:13:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.983+0000 7fd2f1600640 1 -- 172.21.15.142:0/1610534252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0acfd0 msgr2=0x7fd2ec0b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.983+0000 7fd2f1600640 1 --2- 172.21.15.142:0/1610534252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0acfd0 0x7fd2ec0b06f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0ae320 tx=0x7fd2dc02a9f0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.983+0000 7fd2f1600640 1 -- 172.21.15.142:0/1610534252 shutdown_connections 2024-09-21T00:13:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.983+0000 7fd2f1600640 1 --2- 172.21.15.142:0/1610534252 >> v2:172.21.15.83:3300/0 conn(0x7fd2ec0aed40 0x7fd2ec0d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.983+0000 7fd2f1600640 1 --2- 172.21.15.142:0/1610534252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0acfd0 0x7fd2ec0b06f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.983+0000 7fd2f1600640 1 -- 172.21.15.142:0/1610534252 >> 172.21.15.142:0/1610534252 conn(0x7fd2ec0b5140 msgr2=0x7fd2ec0b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.983+0000 7fd2f1600640 1 -- 172.21.15.142:0/1610534252 shutdown_connections 2024-09-21T00:13:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.983+0000 7fd2f1600640 1 -- 172.21.15.142:0/1610534252 wait complete. 2024-09-21T00:13:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.985+0000 7fd2f1600640 1 Processor -- start 2024-09-21T00:13:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.985+0000 7fd2f1600640 1 -- start start 2024-09-21T00:13:46.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2f1600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0acfd0 0x7fd2ec09dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:46.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2f1600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ec0aed40 0x7fd2ec15f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:46.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2f1600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0b0c30 0x7fd2ec0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:46.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2f1600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec0d0960 con 0x7fd2ec0aed40 2024-09-21T00:13:46.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2f1600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec0af4e0 con 0x7fd2ec0b0c30 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2f1600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ec0d0ae0 con 0x7fd2ec0acfd0 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2ebe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0acfd0 0x7fd2ec09dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2f0c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0b0c30 0x7fd2ec0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2ebe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0acfd0 0x7fd2ec09dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:44822/0 (socket says 172.21.15.142:44822) 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2ebe00640 1 -- 172.21.15.142:0/2264558029 learned_addr learned my addr 172.21.15.142:0/2264558029 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.987+0000 7fd2e3400640 1 --2- 172.21.15.142:0/2264558029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ec0aed40 0x7fd2ec15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2ebe00640 1 -- 172.21.15.142:0/2264558029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0b0c30 msgr2=0x7fd2ec0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2ebe00640 1 --2- 172.21.15.142:0/2264558029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0b0c30 0x7fd2ec0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2ebe00640 1 -- 172.21.15.142:0/2264558029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ec0aed40 msgr2=0x7fd2ec15f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2ebe00640 1 --2- 172.21.15.142:0/2264558029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ec0aed40 0x7fd2ec15f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2ebe00640 1 -- 172.21.15.142:0/2264558029 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec0cbce0 con 0x7fd2ec0acfd0 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2f0c00640 1 --2- 172.21.15.142:0/2264558029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0b0c30 0x7fd2ec0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:13:46.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2ebe00640 1 --2- 172.21.15.142:0/2264558029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0acfd0 0x7fd2ec09dd30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc02afe0 tx=0x7fd2dc003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:46.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2e8c00640 1 -- 172.21.15.142:0/2264558029 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc033050 con 0x7fd2ec0acfd0 2024-09-21T00:13:46.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2e8c00640 1 -- 172.21.15.142:0/2264558029 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2dc004550 con 0x7fd2ec0acfd0 2024-09-21T00:13:46.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2e8c00640 1 -- 172.21.15.142:0/2264558029 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc038450 con 0x7fd2ec0acfd0 2024-09-21T00:13:46.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2f1600640 1 -- 172.21.15.142:0/2264558029 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ec0cbfc0 con 0x7fd2ec0acfd0 2024-09-21T00:13:46.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.988+0000 7fd2f1600640 1 -- 172.21.15.142:0/2264558029 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ec0cc580 con 0x7fd2ec0acfd0 2024-09-21T00:13:46.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.989+0000 7fd2e8c00640 1 -- 172.21.15.142:0/2264558029 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7fd2dc036070 con 0x7fd2ec0acfd0 2024-09-21T00:13:46.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.989+0000 7fd2f1600640 1 -- 172.21.15.142:0/2264558029 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ec0d1000 con 0x7fd2ec0acfd0 2024-09-21T00:13:46.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.990+0000 7fd2e8c00640 1 -- 172.21.15.142:0/2264558029 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fd2dc073680 con 0x7fd2ec0acfd0 2024-09-21T00:13:46.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:46.992+0000 7fd2e8c00640 1 -- 172.21.15.142:0/2264558029 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd2dc038da0 con 0x7fd2ec0acfd0 2024-09-21T00:13:47.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.064+0000 7fd2f1600640 1 -- 172.21.15.142:0/2264558029 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4b631676-f08f-4b67-b2ca-5c46a9e181e6", "id": 6} v 0) -- 0x7fd2ec0cab60 con 0x7fd2ec0acfd0 2024-09-21T00:13:47.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.074+0000 7fd2e8c00640 1 -- 172.21.15.142:0/2264558029 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b631676-f08f-4b67-b2ca-5c46a9e181e6", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fd2dc0097a0 con 0x7fd2ec0acfd0 2024-09-21T00:13:47.075 INFO:teuthology.orchestra.run.smithi142.stdout:6 2024-09-21T00:13:47.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.075+0000 7fd2f1600640 1 -- 172.21.15.142:0/2264558029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0acfd0 msgr2=0x7fd2ec09dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:47.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.075+0000 7fd2f1600640 1 --2- 172.21.15.142:0/2264558029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0acfd0 0x7fd2ec09dd30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc02afe0 tx=0x7fd2dc003f90 comp rx=0 tx=0).stop 2024-09-21T00:13:47.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.075+0000 7fd2f1600640 1 -- 172.21.15.142:0/2264558029 shutdown_connections 2024-09-21T00:13:47.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.075+0000 7fd2f1600640 1 --2- 172.21.15.142:0/2264558029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0b0c30 0x7fd2ec0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.075+0000 7fd2f1600640 1 --2- 172.21.15.142:0/2264558029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2ec0aed40 0x7fd2ec15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.075+0000 7fd2f1600640 1 --2- 172.21.15.142:0/2264558029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0acfd0 0x7fd2ec09dd30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.075+0000 7fd2f1600640 1 -- 172.21.15.142:0/2264558029 >> 172.21.15.142:0/2264558029 conn(0x7fd2ec0b5140 msgr2=0x7fd2ec0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:47.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.075+0000 7fd2f1600640 1 -- 172.21.15.142:0/2264558029 shutdown_connections 2024-09-21T00:13:47.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.075+0000 7fd2f1600640 1 -- 172.21.15.142:0/2264558029 wait complete. 2024-09-21T00:13:47.096 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8 7 2024-09-21T00:13:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.309+0000 7ff06dc00640 1 -- 172.21.15.142:0/462871846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff068156a50 msgr2=0x7ff068074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.309+0000 7ff06dc00640 1 --2- 172.21.15.142:0/462871846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff068156a50 0x7ff068074620 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff058009860 tx=0x7ff05802a5a0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.310+0000 7ff06dc00640 1 -- 172.21.15.142:0/462871846 shutdown_connections 2024-09-21T00:13:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.310+0000 7ff06dc00640 1 --2- 172.21.15.142:0/462871846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff068156a50 0x7ff068074620 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.310+0000 7ff06dc00640 1 -- 172.21.15.142:0/462871846 >> 172.21.15.142:0/462871846 conn(0x7ff0680b1b90 msgr2=0x7ff0680b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.310+0000 7ff06dc00640 1 -- 172.21.15.142:0/462871846 shutdown_connections 2024-09-21T00:13:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.310+0000 7ff06dc00640 1 -- 172.21.15.142:0/462871846 wait complete. 2024-09-21T00:13:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.312+0000 7ff06dc00640 1 Processor -- start 2024-09-21T00:13:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.312+0000 7ff06dc00640 1 -- start start 2024-09-21T00:13:47.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.313+0000 7ff06dc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff068074b60 0x7ff06806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:47.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.313+0000 7ff06dc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff068156a50 0x7ff06806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.313+0000 7ff06dc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0681f5e00 0x7ff0681f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.313+0000 7ff06dc00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680cf790 con 0x7ff068156a50 2024-09-21T00:13:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.313+0000 7ff06dc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680cf610 con 0x7ff068074b60 2024-09-21T00:13:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.313+0000 7ff06dc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff0680cf910 con 0x7ff0681f5e00 2024-09-21T00:13:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff066a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff068074b60 0x7ff06806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff067400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0681f5e00 0x7ff0681f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff066a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff068074b60 0x7ff06806cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59636/0 (socket says 172.21.15.142:59636) 2024-09-21T00:13:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff066a00640 1 -- 172.21.15.142:0/2599371925 learned_addr learned my addr 172.21.15.142:0/2599371925 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T00:13:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff05e000640 1 --2- 172.21.15.142:0/2599371925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff068156a50 0x7ff06806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:47.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff066a00640 1 -- 172.21.15.142:0/2599371925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0681f5e00 msgr2=0x7ff0681f8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:47.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff066a00640 1 --2- 172.21.15.142:0/2599371925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0681f5e00 0x7ff0681f8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff066a00640 1 -- 172.21.15.142:0/2599371925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff068156a50 msgr2=0x7ff06806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:47.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff066a00640 1 --2- 172.21.15.142:0/2599371925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff068156a50 0x7ff06806d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff066a00640 1 -- 172.21.15.142:0/2599371925 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0680b32b0 con 0x7ff068074b60 2024-09-21T00:13:47.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.314+0000 7ff066a00640 1 --2- 172.21.15.142:0/2599371925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff068074b60 0x7ff06806cde0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff05802ab90 tx=0x7ff058033ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:47.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.315+0000 7ff05f400640 1 -- 172.21.15.142:0/2599371925 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058031b50 con 0x7ff068074b60 2024-09-21T00:13:47.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.315+0000 7ff05f400640 1 -- 172.21.15.142:0/2599371925 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff058031de0 con 0x7ff068074b60 2024-09-21T00:13:47.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.315+0000 7ff05f400640 1 -- 172.21.15.142:0/2599371925 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058005280 con 0x7ff068074b60 2024-09-21T00:13:47.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.315+0000 7ff06dc00640 1 -- 172.21.15.142:0/2599371925 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0681f5320 con 0x7ff068074b60 2024-09-21T00:13:47.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.315+0000 7ff06dc00640 1 -- 172.21.15.142:0/2599371925 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0681f58e0 con 0x7ff068074b60 2024-09-21T00:13:47.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.316+0000 7ff05f400640 1 -- 172.21.15.142:0/2599371925 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7ff058005420 con 0x7ff068074b60 2024-09-21T00:13:47.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.316+0000 7ff06dc00640 1 -- 172.21.15.142:0/2599371925 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff068074620 con 0x7ff068074b60 2024-09-21T00:13:47.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.316+0000 7ff05f400640 1 -- 172.21.15.142:0/2599371925 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff0580733f0 con 0x7ff068074b60 2024-09-21T00:13:47.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.318+0000 7ff05f400640 1 -- 172.21.15.142:0/2599371925 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff05803f030 con 0x7ff068074b60 2024-09-21T00:13:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.390+0000 7ff06dc00640 1 -- 172.21.15.142:0/2599371925 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8", "id": 7} v 0) -- 0x7ff0681f50e0 con 0x7ff068074b60 2024-09-21T00:13:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.399+0000 7ff05f400640 1 -- 172.21.15.142:0/2599371925 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff058031770 con 0x7ff068074b60 2024-09-21T00:13:47.400 INFO:teuthology.orchestra.run.smithi142.stdout:7 2024-09-21T00:13:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.401+0000 7ff06dc00640 1 -- 172.21.15.142:0/2599371925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff068074b60 msgr2=0x7ff06806cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.401+0000 7ff06dc00640 1 --2- 172.21.15.142:0/2599371925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff068074b60 0x7ff06806cde0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff05802ab90 tx=0x7ff058033ba0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.401+0000 7ff06dc00640 1 -- 172.21.15.142:0/2599371925 shutdown_connections 2024-09-21T00:13:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.401+0000 7ff06dc00640 1 --2- 172.21.15.142:0/2599371925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0681f5e00 0x7ff0681f8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.401+0000 7ff06dc00640 1 --2- 172.21.15.142:0/2599371925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff068156a50 0x7ff06806d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.401+0000 7ff06dc00640 1 --2- 172.21.15.142:0/2599371925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff068074b60 0x7ff06806cde0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.401+0000 7ff06dc00640 1 -- 172.21.15.142:0/2599371925 >> 172.21.15.142:0/2599371925 conn(0x7ff0680b1b90 msgr2=0x7ff0680c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.401+0000 7ff06dc00640 1 -- 172.21.15.142:0/2599371925 shutdown_connections 2024-09-21T00:13:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:13:47.401+0000 7ff06dc00640 1 -- 172.21.15.142:0/2599371925 wait complete. 2024-09-21T00:13:47.423 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T00:13:47.423 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T00:13:47.427 INFO:tasks.ceph.osd.0:Started 2024-09-21T00:13:47.427 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T00:13:47.427 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T00:13:47.430 INFO:tasks.ceph.osd.1:Started 2024-09-21T00:13:47.431 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T00:13:47.431 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T00:13:47.435 INFO:tasks.ceph.osd.2:Started 2024-09-21T00:13:47.435 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T00:13:47.435 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T00:13:47.442 INFO:tasks.ceph.osd.3:Started 2024-09-21T00:13:47.442 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T00:13:47.442 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T00:13:47.446 INFO:tasks.ceph.osd.4:Started 2024-09-21T00:13:47.446 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T00:13:47.446 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T00:13:47.449 INFO:tasks.ceph.osd.5:Started 2024-09-21T00:13:47.449 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T00:13:47.450 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T00:13:47.453 INFO:tasks.ceph.osd.6:Started 2024-09-21T00:13:47.453 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T00:13:47.454 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T00:13:47.458 INFO:tasks.ceph.osd.7:Started 2024-09-21T00:13:47.459 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:13:47.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.734+0000 7f3505000640 1 -- 172.21.15.83:0/3057533152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35000b4f70 msgr2=0x7f35000b2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:47.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.734+0000 7f3505000640 1 --2- 172.21.15.83:0/3057533152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35000b4f70 0x7f35000b2e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009830 tx=0x7f34f802a5c0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.734+0000 7f3505000640 1 -- 172.21.15.83:0/3057533152 shutdown_connections 2024-09-21T00:13:47.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.734+0000 7f3505000640 1 --2- 172.21.15.83:0/3057533152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35000b4f70 0x7f35000b2e60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.734+0000 7f3505000640 1 -- 172.21.15.83:0/3057533152 >> 172.21.15.83:0/3057533152 conn(0x7f35000d4440 msgr2=0x7f35000d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:47.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.734+0000 7f3505000640 1 -- 172.21.15.83:0/3057533152 shutdown_connections 2024-09-21T00:13:47.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.734+0000 7f3505000640 1 -- 172.21.15.83:0/3057533152 wait complete. 2024-09-21T00:13:47.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.736+0000 7f3505000640 1 Processor -- start 2024-09-21T00:13:47.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.736+0000 7f3505000640 1 -- start start 2024-09-21T00:13:47.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f3505000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35000b4f70 0x7f3500153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f3505000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35000cfe00 0x7f35001501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f3505000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500162590 0x7f350014e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f3505000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f35000b3730 con 0x7f3500162590 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f3505000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f35000b35b0 con 0x7f35000b4f70 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f3505000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f35000b38b0 con 0x7f35000cfe00 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f34fe800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500162590 0x7f350014e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f34fe800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500162590 0x7f350014e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52672/0 (socket says 172.21.15.83:52672) 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f34fde00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35000b4f70 0x7f3500153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f34fe800640 1 -- 172.21.15.83:0/1944167569 learned_addr learned my addr 172.21.15.83:0/1944167569 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f34f5400640 1 --2- 172.21.15.83:0/1944167569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35000cfe00 0x7f35001501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f34fde00640 1 -- 172.21.15.83:0/1944167569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35000cfe00 msgr2=0x7f35001501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f34fde00640 1 --2- 172.21.15.83:0/1944167569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35000cfe00 0x7f35001501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f34fde00640 1 -- 172.21.15.83:0/1944167569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500162590 msgr2=0x7f350014e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:47.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f34fde00640 1 --2- 172.21.15.83:0/1944167569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500162590 0x7f350014e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.738+0000 7f34fde00640 1 -- 172.21.15.83:0/1944167569 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35001f9140 con 0x7f35000b4f70 2024-09-21T00:13:47.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.739+0000 7f34fde00640 1 --2- 172.21.15.83:0/1944167569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35000b4f70 0x7f3500153f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34f000caa0 tx=0x7f34f000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:47.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.739+0000 7f34f6a00640 1 -- 172.21.15.83:0/1944167569 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f0016020 con 0x7f35000b4f70 2024-09-21T00:13:47.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.739+0000 7f34f6a00640 1 -- 172.21.15.83:0/1944167569 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34f000acf0 con 0x7f35000b4f70 2024-09-21T00:13:47.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.739+0000 7f3505000640 1 -- 172.21.15.83:0/1944167569 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35001f9420 con 0x7f35000b4f70 2024-09-21T00:13:47.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.739+0000 7f34f6a00640 1 -- 172.21.15.83:0/1944167569 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f0012680 con 0x7f35000b4f70 2024-09-21T00:13:47.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.739+0000 7f3505000640 1 -- 172.21.15.83:0/1944167569 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350014edc0 con 0x7f35000b4f70 2024-09-21T00:13:47.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.740+0000 7f3505000640 1 -- 172.21.15.83:0/1944167569 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35000b2e60 con 0x7f35000b4f70 2024-09-21T00:13:47.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.740+0000 7f34f6a00640 1 -- 172.21.15.83:0/1944167569 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f34f0019020 con 0x7f35000b4f70 2024-09-21T00:13:47.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.741+0000 7f34f6a00640 1 -- 172.21.15.83:0/1944167569 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f34f0052940 con 0x7f35000b4f70 2024-09-21T00:13:47.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.743+0000 7f34f6a00640 1 -- 172.21.15.83:0/1944167569 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f34f0020020 con 0x7f35000b4f70 2024-09-21T00:13:47.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.804+0000 7f3505000640 1 -- 172.21.15.83:0/1944167569 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35001611c0 con 0x7f35000b4f70 2024-09-21T00:13:47.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.805+0000 7f34f6a00640 1 -- 172.21.15.83:0/1944167569 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f34f001b400 con 0x7f35000b4f70 2024-09-21T00:13:47.806 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:13:47.806 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":10,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:13:47.391687+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:13:47.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.806+0000 7f3505000640 1 -- 172.21.15.83:0/1944167569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35000b4f70 msgr2=0x7f3500153f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:47.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.806+0000 7f3505000640 1 --2- 172.21.15.83:0/1944167569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35000b4f70 0x7f3500153f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34f000caa0 tx=0x7f34f000cf60 comp rx=0 tx=0).stop 2024-09-21T00:13:47.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.806+0000 7f3505000640 1 -- 172.21.15.83:0/1944167569 shutdown_connections 2024-09-21T00:13:47.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.806+0000 7f3505000640 1 --2- 172.21.15.83:0/1944167569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500162590 0x7f350014e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.806+0000 7f3505000640 1 --2- 172.21.15.83:0/1944167569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35000cfe00 0x7f35001501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.806+0000 7f3505000640 1 --2- 172.21.15.83:0/1944167569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35000b4f70 0x7f3500153f90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:47.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.806+0000 7f3505000640 1 -- 172.21.15.83:0/1944167569 >> 172.21.15.83:0/1944167569 conn(0x7f35000d4440 msgr2=0x7f3500158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:47.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.806+0000 7f3505000640 1 -- 172.21.15.83:0/1944167569 shutdown_connections 2024-09-21T00:13:47.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:13:47.806+0000 7f3505000640 1 -- 172.21.15.83:0/1944167569 wait complete. 2024-09-21T00:13:47.827 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T00:13:47.827 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T00:13:47.876 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-21T00:13:47.875+0000 7f5be5600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T00:13:47.876 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-21T00:13:47.875+0000 7f5be5600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T00:13:48.632 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T00:13:48.837 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.835+0000 7f6697e00640 1 -- 172.21.15.83:0/3330746433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66900cbc10 msgr2=0x7f66900cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:48.837 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.835+0000 7f6697e00640 1 --2- 172.21.15.83:0/3330746433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66900cbc10 0x7f66900cc020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f667c005fd0 tx=0x7f667c02a5d0 comp rx=0 tx=0).stop 2024-09-21T00:13:48.837 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.835+0000 7f6697e00640 1 -- 172.21.15.83:0/3330746433 shutdown_connections 2024-09-21T00:13:48.837 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.835+0000 7f6697e00640 1 --2- 172.21.15.83:0/3330746433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66900cbc10 0x7f66900cc020 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:48.837 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.835+0000 7f6697e00640 1 --2- 172.21.15.83:0/3330746433 >> v2:172.21.15.142:3300/0 conn(0x7f6690074cb0 0x7f6690073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:48.837 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.835+0000 7f6697e00640 1 -- 172.21.15.83:0/3330746433 >> 172.21.15.83:0/3330746433 conn(0x7f66900cca40 msgr2=0x7f66900cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:48.837 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.835+0000 7f6697e00640 1 -- 172.21.15.83:0/3330746433 shutdown_connections 2024-09-21T00:13:48.837 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.835+0000 7f6697e00640 1 -- 172.21.15.83:0/3330746433 wait complete. 2024-09-21T00:13:48.838 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.838+0000 7f6697e00640 1 Processor -- start 2024-09-21T00:13:48.839 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.838+0000 7f6697e00640 1 -- start start 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.839+0000 7f6697e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669006ddf0 0x7f669009ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.839+0000 7f6697e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6690074cb0 0x7f669009bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.839+0000 7f6697e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66900cbc10 0x7f66901f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.839+0000 7f6697e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f669006f360 con 0x7f66900cbc10 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.839+0000 7f6697e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f669006f1e0 con 0x7f669006ddf0 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.839+0000 7f6697e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f669006f4e0 con 0x7f6690074cb0 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6694a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6690074cb0 0x7f669009bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6695400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669006ddf0 0x7f669009ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6695e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66900cbc10 0x7f66901f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6694a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6690074cb0 0x7f669009bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:41070/0 (socket says 172.21.15.83:41070) 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6694a00640 1 -- 172.21.15.83:0/168466113 learned_addr learned my addr 172.21.15.83:0/168466113 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:48.841 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6695400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669006ddf0 0x7f669009ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:36036/0 (socket says 172.21.15.83:36036) 2024-09-21T00:13:48.842 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6695e00640 1 -- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6690074cb0 msgr2=0x7f669009bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:48.842 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6695e00640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6690074cb0 0x7f669009bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:48.843 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6695e00640 1 -- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669006ddf0 msgr2=0x7f669009ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:48.843 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6695e00640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669006ddf0 0x7f669009ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:48.843 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6695e00640 1 -- 172.21.15.83:0/168466113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669009fdf0 con 0x7f66900cbc10 2024-09-21T00:13:48.843 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f6695e00640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66900cbc10 0x7f66901f5910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f668800c730 tx=0x7f668800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:48.843 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.840+0000 7f668d600640 1 -- 172.21.15.83:0/168466113 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688003b70 con 0x7f66900cbc10 2024-09-21T00:13:48.843 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.841+0000 7f668d600640 1 -- 172.21.15.83:0/168466113 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6688003d10 con 0x7f66900cbc10 2024-09-21T00:13:48.843 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.841+0000 7f6697e00640 1 -- 172.21.15.83:0/168466113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66900a00d0 con 0x7f66900cbc10 2024-09-21T00:13:48.843 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.841+0000 7f668d600640 1 -- 172.21.15.83:0/168466113 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688005330 con 0x7f66900cbc10 2024-09-21T00:13:48.843 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.841+0000 7f6697e00640 1 -- 172.21.15.83:0/168466113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669009e4f0 con 0x7f66900cbc10 2024-09-21T00:13:48.844 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.842+0000 7f6697e00640 1 -- 172.21.15.83:0/168466113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669006fa00 con 0x7f66900cbc10 2024-09-21T00:13:48.844 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.843+0000 7f668d600640 1 -- 172.21.15.83:0/168466113 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 3) ==== 101279+0+0 (secure 0 0 0) 0x7f66880056e0 con 0x7f66900cbc10 2024-09-21T00:13:48.845 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.844+0000 7f668d600640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6670078a10 0x7f667007af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:48.845 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.844+0000 7f668d600640 1 -- 172.21.15.83:0/168466113 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6688099810 con 0x7f66900cbc10 2024-09-21T00:13:48.845 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.844+0000 7f6695400640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6670078a10 0x7f667007af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:48.846 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.845+0000 7f6695400640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6670078a10 0x7f667007af20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f66840095f0 tx=0x7f6684005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:48.850 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.849+0000 7f668d600640 1 -- 172.21.15.83:0/168466113 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6688062850 con 0x7f66900cbc10 2024-09-21T00:13:48.873 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:48.872+0000 7f668d600640 1 -- 172.21.15.83:0/168466113 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f668809bcd0 con 0x7f66900cbc10 2024-09-21T00:13:49.042 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.041+0000 7f6697e00640 1 -- 172.21.15.83:0/168466113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66900696c0 con 0x7f66900cbc10 2024-09-21T00:13:49.043 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-09-21T00:13:49.041+0000 7feb4d064640 -1 Falling back to public interface 2024-09-21T00:13:49.044 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.041+0000 7f668d600640 1 -- 172.21.15.83:0/168466113 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f668803b130 con 0x7f66900cbc10 2024-09-21T00:13:49.044 INFO:teuthology.misc.health.smithi083.stdout: 2024-09-21T00:13:49.044 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":10,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:13:47.391687+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:13:49.046 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 -- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6670078a10 msgr2=0x7f667007af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:49.046 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6670078a10 0x7f667007af20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f66840095f0 tx=0x7f6684005f90 comp rx=0 tx=0).stop 2024-09-21T00:13:49.046 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 -- 172.21.15.83:0/168466113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66900cbc10 msgr2=0x7f66901f5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:49.046 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66900cbc10 0x7f66901f5910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f668800c730 tx=0x7f668800cbf0 comp rx=0 tx=0).stop 2024-09-21T00:13:49.046 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 -- 172.21.15.83:0/168466113 shutdown_connections 2024-09-21T00:13:49.047 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6670078a10 0x7f667007af20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:49.047 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66900cbc10 0x7f66901f5910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:49.047 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6690074cb0 0x7f669009bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:49.047 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 --2- 172.21.15.83:0/168466113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669006ddf0 0x7f669009ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:49.047 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 -- 172.21.15.83:0/168466113 >> 172.21.15.83:0/168466113 conn(0x7f66900cca40 msgr2=0x7f66900cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:49.048 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 -- 172.21.15.83:0/168466113 shutdown_connections 2024-09-21T00:13:49.048 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:49.044+0000 7f6697e00640 1 -- 172.21.15.83:0/168466113 wait complete. 2024-09-21T00:13:49.051 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-09-21T00:13:49.050+0000 7f5644e44640 -1 Falling back to public interface 2024-09-21T00:13:49.063 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T00:13:49.078 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-09-21T00:13:49.077+0000 7fe9c63c5640 -1 Falling back to public interface 2024-09-21T00:13:49.111 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-09-21T00:13:49.110+0000 7f417ed45640 -1 Falling back to public interface 2024-09-21T00:13:49.320 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-09-21T00:13:49.319+0000 7f53f7330640 -1 Falling back to public interface 2024-09-21T00:13:49.346 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-09-21T00:13:49.345+0000 7f138f69c640 -1 Falling back to public interface 2024-09-21T00:13:49.399 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-09-21T00:13:49.398+0000 7f78e940f640 -1 Falling back to public interface 2024-09-21T00:13:49.543 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-09-21T00:13:49.542+0000 7f7429e60640 -1 Falling back to public interface 2024-09-21T00:13:52.856 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-09-21T00:13:52.855+0000 7fe9c63c5640 -1 osd.5 0 log_to_monitors true 2024-09-21T00:13:52.913 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-09-21T00:13:52.912+0000 7feb4d064640 -1 osd.2 0 log_to_monitors true 2024-09-21T00:13:53.014 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-09-21T00:13:53.013+0000 7f53f7330640 -1 osd.6 0 log_to_monitors true 2024-09-21T00:13:53.037 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-09-21T00:13:53.036+0000 7f5644e44640 -1 osd.4 0 log_to_monitors true 2024-09-21T00:13:53.067 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-09-21T00:13:53.066+0000 7f138f69c640 -1 osd.0 0 log_to_monitors true 2024-09-21T00:13:53.213 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-09-21T00:13:53.213+0000 7f7429e60640 -1 osd.7 0 log_to_monitors true 2024-09-21T00:13:53.328 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-09-21T00:13:53.327+0000 7f417ed45640 -1 osd.1 0 log_to_monitors true 2024-09-21T00:13:53.889 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-09-21T00:13:53.888+0000 7f78e940f640 -1 osd.3 0 log_to_monitors true 2024-09-21T00:13:54.880 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-09-21T00:13:54.879+0000 7fe9c1c00640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T00:13:54.892 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-09-21T00:13:54.891+0000 7fe9b7200640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:13:55.870 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T00:13:56.125 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.122+0000 7fba61800640 1 -- 172.21.15.83:0/2472144873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c160030 msgr2=0x7fba5c160440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:56.125 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.122+0000 7fba61800640 1 --2- 172.21.15.83:0/2472144873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c160030 0x7fba5c160440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fba5c073080 tx=0x7fba5402a980 comp rx=0 tx=0).stop 2024-09-21T00:13:56.125 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.122+0000 7fba61800640 1 -- 172.21.15.83:0/2472144873 shutdown_connections 2024-09-21T00:13:56.125 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.122+0000 7fba61800640 1 --2- 172.21.15.83:0/2472144873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c160030 0x7fba5c160440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:56.125 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.122+0000 7fba61800640 1 --2- 172.21.15.83:0/2472144873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c0cf700 0x7fba5c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:56.126 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.122+0000 7fba61800640 1 --2- 172.21.15.83:0/2472144873 >> v2:172.21.15.142:3300/0 conn(0x7fba5c153410 0x7fba5c0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:56.126 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.122+0000 7fba61800640 1 -- 172.21.15.83:0/2472144873 >> 172.21.15.83:0/2472144873 conn(0x7fba5c0d0a30 msgr2=0x7fba5c0d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:56.126 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.122+0000 7fba61800640 1 -- 172.21.15.83:0/2472144873 shutdown_connections 2024-09-21T00:13:56.126 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.122+0000 7fba61800640 1 -- 172.21.15.83:0/2472144873 wait complete. 2024-09-21T00:13:56.127 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.125+0000 7fba61800640 1 Processor -- start 2024-09-21T00:13:56.127 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.125+0000 7fba61800640 1 -- start start 2024-09-21T00:13:56.129 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba61800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c0cf700 0x7fba5c0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:56.129 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba61800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c153410 0x7fba5c0b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:56.129 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba61800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba5c160030 0x7fba5c159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:56.129 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba61800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c15cbc0 con 0x7fba5c0cf700 2024-09-21T00:13:56.129 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba61800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c15ca40 con 0x7fba5c160030 2024-09-21T00:13:56.129 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba61800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fba5c160980 con 0x7fba5c153410 2024-09-21T00:13:56.130 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba5aa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c0cf700 0x7fba5c0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:56.130 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba5aa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c0cf700 0x7fba5c0b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41452/0 (socket says 172.21.15.83:41452) 2024-09-21T00:13:56.130 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba5aa00640 1 -- 172.21.15.83:0/961175524 learned_addr learned my addr 172.21.15.83:0/961175524 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:13:56.130 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba5a000640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c153410 0x7fba5c0b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:56.130 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.127+0000 7fba5b400640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba5c160030 0x7fba5c159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:56.131 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.128+0000 7fba5aa00640 1 -- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c153410 msgr2=0x7fba5c0b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:56.131 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.128+0000 7fba5aa00640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c153410 0x7fba5c0b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:56.131 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.128+0000 7fba5aa00640 1 -- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba5c160030 msgr2=0x7fba5c159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:56.131 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.128+0000 7fba5aa00640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba5c160030 0x7fba5c159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:56.131 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.128+0000 7fba5aa00640 1 -- 172.21.15.83:0/961175524 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c153b70 con 0x7fba5c0cf700 2024-09-21T00:13:56.132 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.128+0000 7fba5aa00640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c0cf700 0x7fba5c0b4a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00e790 tx=0x7fba4c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:56.132 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.129+0000 7fba52a00640 1 -- 172.21.15.83:0/961175524 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00eea0 con 0x7fba5c0cf700 2024-09-21T00:13:56.132 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.129+0000 7fba52a00640 1 -- 172.21.15.83:0/961175524 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba4c00cdb0 con 0x7fba5c0cf700 2024-09-21T00:13:56.132 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.129+0000 7fba52a00640 1 -- 172.21.15.83:0/961175524 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c010690 con 0x7fba5c0cf700 2024-09-21T00:13:56.132 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.129+0000 7fba61800640 1 -- 172.21.15.83:0/961175524 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c153e50 con 0x7fba5c0cf700 2024-09-21T00:13:56.132 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.129+0000 7fba61800640 1 -- 172.21.15.83:0/961175524 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c154410 con 0x7fba5c0cf700 2024-09-21T00:13:56.133 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.130+0000 7fba61800640 1 -- 172.21.15.83:0/961175524 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5c160e30 con 0x7fba5c0cf700 2024-09-21T00:13:56.134 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.132+0000 7fba52a00640 1 -- 172.21.15.83:0/961175524 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7fba4c010830 con 0x7fba5c0cf700 2024-09-21T00:13:56.136 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.134+0000 7fba52a00640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fba3c078b00 0x7fba3c07b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:13:56.136 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.134+0000 7fba52a00640 1 -- 172.21.15.83:0/961175524 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7fba4c09a9c0 con 0x7fba5c0cf700 2024-09-21T00:13:56.138 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.136+0000 7fba5a000640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fba3c078b00 0x7fba3c07b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:13:56.139 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.137+0000 7fba5a000640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fba3c078b00 0x7fba3c07b010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0711f0 tx=0x7fba4800b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:13:56.142 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.140+0000 7fba52a00640 1 -- 172.21.15.83:0/961175524 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fba4c063470 con 0x7fba5c0cf700 2024-09-21T00:13:56.409 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.407+0000 7fba61800640 1 -- 172.21.15.83:0/961175524 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba5c069d30 con 0x7fba5c0cf700 2024-09-21T00:13:56.410 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.408+0000 7fba52a00640 1 -- 172.21.15.83:0/961175524 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7590 (secure 0 0 0) 0x7fba4c067ea0 con 0x7fba5c0cf700 2024-09-21T00:13:56.411 INFO:teuthology.misc.health.smithi083.stdout: 2024-09-21T00:13:56.411 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":14,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:13:55.954773+0000","last_up_change":"2024-09-21T00:13:54.915191+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:13:56.414 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.412+0000 7fba61800640 1 -- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fba3c078b00 msgr2=0x7fba3c07b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:56.414 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.412+0000 7fba61800640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fba3c078b00 0x7fba3c07b010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0711f0 tx=0x7fba4800b2e0 comp rx=0 tx=0).stop 2024-09-21T00:13:56.415 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.412+0000 7fba61800640 1 -- 172.21.15.83:0/961175524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c0cf700 msgr2=0x7fba5c0b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:13:56.415 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.412+0000 7fba61800640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c0cf700 0x7fba5c0b4a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00e790 tx=0x7fba4c00ec50 comp rx=0 tx=0).stop 2024-09-21T00:13:56.415 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.413+0000 7fba61800640 1 -- 172.21.15.83:0/961175524 shutdown_connections 2024-09-21T00:13:56.415 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.413+0000 7fba61800640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fba3c078b00 0x7fba3c07b010 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:56.415 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.413+0000 7fba61800640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba5c160030 0x7fba5c159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:56.415 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.413+0000 7fba61800640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c153410 0x7fba5c0b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:13:56.415 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.413+0000 7fba61800640 1 --2- 172.21.15.83:0/961175524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c0cf700 0x7fba5c0b4a00 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00e790 tx=0x7fba4c00ec50 comp rx=0 tx=0).stop 2024-09-21T00:13:56.416 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.413+0000 7fba61800640 1 -- 172.21.15.83:0/961175524 >> 172.21.15.83:0/961175524 conn(0x7fba5c0d0a30 msgr2=0x7fba5c073e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:13:56.419 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.416+0000 7fba61800640 1 -- 172.21.15.83:0/961175524 shutdown_connections 2024-09-21T00:13:56.419 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:13:56.416+0000 7fba61800640 1 -- 172.21.15.83:0/961175524 wait complete. 2024-09-21T00:13:56.460 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-21T00:13:56.809 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-09-21T00:13:56.807+0000 7f53f2200640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T00:13:56.814 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-09-21T00:13:56.813+0000 7f53e8200640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:13:56.815 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-09-21T00:13:56.814+0000 7f7424e00640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T00:13:56.826 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-09-21T00:13:56.824+0000 7f741ae00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:13:56.834 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-09-21T00:13:56.833+0000 7f563fc00640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T00:13:56.843 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-09-21T00:13:56.841+0000 7f5635c00640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:13:57.313 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-09-21T00:13:57.311+0000 7f78e4800640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T00:13:57.325 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-09-21T00:13:57.323+0000 7f78d9e00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:13:57.384 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-09-21T00:13:57.381+0000 7feb48a00640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T00:13:57.391 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-09-21T00:13:57.389+0000 7feb3e000640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:13:57.392 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-09-21T00:13:57.390+0000 7f417a600640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T00:13:57.406 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-09-21T00:13:57.404+0000 7f416fc00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:13:57.409 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-09-21T00:13:57.408+0000 7f138a600640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T00:13:57.418 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-09-21T00:13:57.416+0000 7f1380600640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:13:57.982 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:13:57.986 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:14:03.266 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:03.469 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.468+0000 7f6f27200640 1 -- 172.21.15.83:0/2749197782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f0c005300 msgr2=0x7f6f0c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:03.470 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.468+0000 7f6f27200640 1 --2- 172.21.15.83:0/2749197782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f0c005300 0x7f6f0c00b9c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c610 tx=0x7f6f0c005830 comp rx=0 tx=0).stop 2024-09-21T00:14:03.470 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.468+0000 7f6f26800640 1 -- 172.21.15.83:0/2749197782 reap_dead start 2024-09-21T00:14:03.470 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.468+0000 7f6f27200640 1 -- 172.21.15.83:0/2749197782 shutdown_connections 2024-09-21T00:14:03.470 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.468+0000 7f6f27200640 1 -- 172.21.15.83:0/2749197782 >> 172.21.15.83:0/2749197782 conn(0x7f6f280d1960 msgr2=0x7f6f280d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:03.470 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.468+0000 7f6f27200640 1 -- 172.21.15.83:0/2749197782 shutdown_connections 2024-09-21T00:14:03.470 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.468+0000 7f6f27200640 1 -- 172.21.15.83:0/2749197782 wait complete. 2024-09-21T00:14:03.471 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.470+0000 7f6f27200640 1 Processor -- start 2024-09-21T00:14:03.471 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.470+0000 7f6f27200640 1 -- start start 2024-09-21T00:14:03.474 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f27200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f0c005300 0x7f6f281514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f27200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f28150ea0 0x7f6f2814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f27200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f28156ae0 0x7f6f28156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f27200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6f281621d0 con 0x7f6f28156ae0 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f27200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280d35a0 con 0x7f6f28150ea0 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f27200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6f28162350 con 0x7f6f0c005300 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f26800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f28156ae0 0x7f6f28156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f26800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f28156ae0 0x7f6f28156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49202/0 (socket says 172.21.15.83:49202) 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f26800640 1 -- 172.21.15.83:0/1243746842 learned_addr learned my addr 172.21.15.83:0/1243746842 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f1fe00640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f28150ea0 0x7f6f2814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f25e00640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f0c005300 0x7f6f281514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f26800640 1 -- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f0c005300 msgr2=0x7f6f281514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:03.475 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f26800640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f0c005300 0x7f6f281514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f26800640 1 -- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f28150ea0 msgr2=0x7f6f2814e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.472+0000 7f6f26800640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f28150ea0 0x7f6f2814e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.473+0000 7f6f26800640 1 -- 172.21.15.83:0/1243746842 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f28157430 con 0x7f6f28156ae0 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.473+0000 7f6f1fe00640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f28150ea0 0x7f6f2814e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.473+0000 7f6f25e00640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f0c005300 0x7f6f281514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.473+0000 7f6f26800640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f28156ae0 0x7f6f28156ef0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f20000f80 tx=0x7f6f2000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.473+0000 7f6f1e000640 1 -- 172.21.15.83:0/1243746842 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20039070 con 0x7f6f28156ae0 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.473+0000 7f6f1e000640 1 -- 172.21.15.83:0/1243746842 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f2002b720 con 0x7f6f28156ae0 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.473+0000 7f6f27200640 1 -- 172.21.15.83:0/1243746842 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f28155b70 con 0x7f6f28156ae0 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.473+0000 7f6f1e000640 1 -- 172.21.15.83:0/1243746842 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2002bb30 con 0x7f6f28156ae0 2024-09-21T00:14:03.476 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.473+0000 7f6f27200640 1 -- 172.21.15.83:0/1243746842 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f28156130 con 0x7f6f28156ae0 2024-09-21T00:14:03.477 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.474+0000 7f6f27200640 1 -- 172.21.15.83:0/1243746842 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f280ce2c0 con 0x7f6f28156ae0 2024-09-21T00:14:03.477 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.475+0000 7f6f1e000640 1 -- 172.21.15.83:0/1243746842 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f20006140 con 0x7f6f28156ae0 2024-09-21T00:14:03.477 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.476+0000 7f6f1e000640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f04078b90 0x7f6f0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:03.478 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.476+0000 7f6f1e000640 1 -- 172.21.15.83:0/1243746842 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f6f200ba550 con 0x7f6f28156ae0 2024-09-21T00:14:03.478 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.477+0000 7f6f25e00640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f04078b90 0x7f6f0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:03.478 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.477+0000 7f6f25e00640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f04078b90 0x7f6f0407b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6f2808cea0 tx=0x7f6f18005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:03.482 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.481+0000 7f6f1e000640 1 -- 172.21.15.83:0/1243746842 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6f28157430 con 0x7f6f28156ae0 2024-09-21T00:14:03.668 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.667+0000 7f6f27200640 1 -- 172.21.15.83:0/1243746842 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f280cf610 con 0x7f6f28156ae0 2024-09-21T00:14:03.669 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.668+0000 7f6f1e000640 1 -- 172.21.15.83:0/1243746842 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12920 (secure 0 0 0) 0x7f6f20082d50 con 0x7f6f28156ae0 2024-09-21T00:14:03.670 INFO:teuthology.misc.health.smithi083.stdout: 2024-09-21T00:14:03.670 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":19,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:01.858908+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:03.672 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.670+0000 7f6f27200640 1 -- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f04078b90 msgr2=0x7f6f0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:03.672 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.670+0000 7f6f27200640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f04078b90 0x7f6f0407b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6f2808cea0 tx=0x7f6f18005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:03.672 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.670+0000 7f6f27200640 1 -- 172.21.15.83:0/1243746842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f28156ae0 msgr2=0x7f6f28156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:03.672 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.670+0000 7f6f27200640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f28156ae0 0x7f6f28156ef0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f20000f80 tx=0x7f6f2000c330 comp rx=0 tx=0).stop 2024-09-21T00:14:03.672 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.670+0000 7f6f27200640 1 -- 172.21.15.83:0/1243746842 shutdown_connections 2024-09-21T00:14:03.672 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.670+0000 7f6f27200640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f04078b90 0x7f6f0407b0a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:03.672 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.670+0000 7f6f27200640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f28156ae0 0x7f6f28156ef0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:03.673 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.670+0000 7f6f27200640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f28150ea0 0x7f6f2814e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:03.673 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.670+0000 7f6f27200640 1 --2- 172.21.15.83:0/1243746842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f0c005300 0x7f6f281514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:03.673 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.670+0000 7f6f27200640 1 -- 172.21.15.83:0/1243746842 >> 172.21.15.83:0/1243746842 conn(0x7f6f280d1960 msgr2=0x7f6f280b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:03.673 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.671+0000 7f6f27200640 1 -- 172.21.15.83:0/1243746842 shutdown_connections 2024-09-21T00:14:03.673 INFO:teuthology.misc.health.smithi083.stderr:2024-09-21T00:14:03.671+0000 7f6f27200640 1 -- 172.21.15.83:0/1243746842 wait complete. 2024-09-21T00:14:03.690 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T00:14:03.690 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T00:14:03.690 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T00:14:03.691 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T00:14:03.695 INFO:tasks.ceph.mds.a:Started 2024-09-21T00:14:03.695 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T00:14:03.695 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T00:14:03.698 INFO:tasks.ceph.mds.c:Started 2024-09-21T00:14:03.698 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T00:14:03.699 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T00:14:03.703 INFO:tasks.ceph.mds.b:Started 2024-09-21T00:14:03.703 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T00:14:03.703 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T00:14:03.706 INFO:tasks.ceph.mds.d:Started 2024-09-21T00:14:03.707 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-21T00:14:03.707 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:14:03.891 INFO:tasks.ceph.mds.a.smithi083.stdout:starting mds.a at 2024-09-21T00:14:03.892 INFO:tasks.ceph.mds.c.smithi083.stdout:starting mds.c at 2024-09-21T00:14:03.901 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-09-21T00:14:03.901 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-09-21T00:14:03.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.937+0000 7fe31a600640 1 -- 172.21.15.83:0/1138375812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe31406d9c0 msgr2=0x7fe314154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:03.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.938+0000 7fe31a600640 1 --2- 172.21.15.83:0/1138375812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe31406d9c0 0x7fe314154ea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009be0 tx=0x7fe30c02a920 comp rx=0 tx=0).stop 2024-09-21T00:14:03.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.938+0000 7fe31a600640 1 -- 172.21.15.83:0/1138375812 shutdown_connections 2024-09-21T00:14:03.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.938+0000 7fe31a600640 1 --2- 172.21.15.83:0/1138375812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe31406d9c0 0x7fe314154ea0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:03.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.938+0000 7fe31a600640 1 -- 172.21.15.83:0/1138375812 >> 172.21.15.83:0/1138375812 conn(0x7fe3140d1930 msgr2=0x7fe3140d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:03.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.938+0000 7fe31a600640 1 -- 172.21.15.83:0/1138375812 shutdown_connections 2024-09-21T00:14:03.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.938+0000 7fe31a600640 1 -- 172.21.15.83:0/1138375812 wait complete. 2024-09-21T00:14:03.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.940+0000 7fe31a600640 1 Processor -- start 2024-09-21T00:14:03.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.940+0000 7fe31a600640 1 -- start start 2024-09-21T00:14:03.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.941+0000 7fe31a600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe31406d9c0 0x7fe3140c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:03.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.941+0000 7fe31a600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140b9e40 0x7fe3141f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.941+0000 7fe31a600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3140c9100 0x7fe3141f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.941+0000 7fe31a600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe314155560 con 0x7fe3140b9e40 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.941+0000 7fe31a600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe3141553e0 con 0x7fe31406d9c0 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.941+0000 7fe31a600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe3141556e0 con 0x7fe3140c9100 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe30be00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140b9e40 0x7fe3141f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe30be00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140b9e40 0x7fe3141f7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49242/0 (socket says 172.21.15.83:49242) 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe30be00640 1 -- 172.21.15.83:0/965696030 learned_addr learned my addr 172.21.15.83:0/965696030 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe319200640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe31406d9c0 0x7fe3140c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe319c00640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3140c9100 0x7fe3141f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe30be00640 1 -- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3140c9100 msgr2=0x7fe3141f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe30be00640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3140c9100 0x7fe3141f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe30be00640 1 -- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe31406d9c0 msgr2=0x7fe3140c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:03.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe30be00640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe31406d9c0 0x7fe3140c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:03.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe30be00640 1 -- 172.21.15.83:0/965696030 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3140c8060 con 0x7fe3140b9e40 2024-09-21T00:14:03.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.942+0000 7fe319200640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe31406d9c0 0x7fe3140c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:14:03.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.943+0000 7fe30be00640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140b9e40 0x7fe3141f7170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00c3c0 tx=0x7fe2fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:03.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.943+0000 7fe311600640 1 -- 172.21.15.83:0/965696030 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc017070 con 0x7fe3140b9e40 2024-09-21T00:14:03.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.943+0000 7fe311600640 1 -- 172.21.15.83:0/965696030 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2fc0053c0 con 0x7fe3140b9e40 2024-09-21T00:14:03.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.943+0000 7fe31a600640 1 -- 172.21.15.83:0/965696030 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3140c7680 con 0x7fe3140b9e40 2024-09-21T00:14:03.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.943+0000 7fe311600640 1 -- 172.21.15.83:0/965696030 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc003850 con 0x7fe3140b9e40 2024-09-21T00:14:03.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.943+0000 7fe31a600640 1 -- 172.21.15.83:0/965696030 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3140c8620 con 0x7fe3140b9e40 2024-09-21T00:14:03.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.944+0000 7fe31a600640 1 -- 172.21.15.83:0/965696030 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe314154ea0 con 0x7fe3140b9e40 2024-09-21T00:14:03.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.945+0000 7fe311600640 1 -- 172.21.15.83:0/965696030 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe2fc01a070 con 0x7fe3140b9e40 2024-09-21T00:14:03.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.946+0000 7fe311600640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe2f0078b90 0x7fe2f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:03.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.946+0000 7fe311600640 1 -- 172.21.15.83:0/965696030 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe2fc099e20 con 0x7fe3140b9e40 2024-09-21T00:14:03.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.946+0000 7fe319200640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe2f0078b90 0x7fe2f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:03.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.947+0000 7fe319200640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe2f0078b90 0x7fe2f007b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe304007fd0 tx=0x7fe304001930 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:03.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:03.951+0000 7fe311600640 1 -- 172.21.15.83:0/965696030 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe2fc061ec0 con 0x7fe3140b9e40 2024-09-21T00:14:04.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.173+0000 7fe31a600640 1 -- 172.21.15.83:0/965696030 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3140b82b0 con 0x7fe3140b9e40 2024-09-21T00:14:04.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.173+0000 7fe311600640 1 -- 172.21.15.83:0/965696030 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1431 (secure 0 0 0) 0x7fe2fc0668f0 con 0x7fe3140b9e40 2024-09-21T00:14:04.175 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:04.175 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":2,"btime":"2024-09-21T00:14:03:899143+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T00:14:04.175 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 2 2024-09-21T00:14:04.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.175+0000 7fe31a600640 1 -- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe2f0078b90 msgr2=0x7fe2f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:04.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.175+0000 7fe31a600640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe2f0078b90 0x7fe2f007b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe304007fd0 tx=0x7fe304001930 comp rx=0 tx=0).stop 2024-09-21T00:14:04.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.175+0000 7fe31a600640 1 -- 172.21.15.83:0/965696030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140b9e40 msgr2=0x7fe3141f7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:04.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.175+0000 7fe31a600640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140b9e40 0x7fe3141f7170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00c3c0 tx=0x7fe2fc00c880 comp rx=0 tx=0).stop 2024-09-21T00:14:04.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.176+0000 7fe31a600640 1 -- 172.21.15.83:0/965696030 shutdown_connections 2024-09-21T00:14:04.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.176+0000 7fe31a600640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe2f0078b90 0x7fe2f007b0a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:04.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.176+0000 7fe31a600640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3140c9100 0x7fe3141f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:04.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.176+0000 7fe31a600640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140b9e40 0x7fe3141f7170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:04.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.176+0000 7fe31a600640 1 --2- 172.21.15.83:0/965696030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe31406d9c0 0x7fe3140c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:04.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.176+0000 7fe31a600640 1 -- 172.21.15.83:0/965696030 >> 172.21.15.83:0/965696030 conn(0x7fe3140d1930 msgr2=0x7fe31414d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:04.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.176+0000 7fe31a600640 1 -- 172.21.15.83:0/965696030 shutdown_connections 2024-09-21T00:14:04.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:04.176+0000 7fe31a600640 1 -- 172.21.15.83:0/965696030 wait complete. 2024-09-21T00:14:06.199 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:14:06.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.426+0000 7fcff6c00640 1 -- 172.21.15.83:0/781617820 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcff015f5a0 msgr2=0x7fcff015f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:06.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.426+0000 7fcff6c00640 1 --2- 172.21.15.83:0/781617820 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcff015f5a0 0x7fcff015f9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8005fd0 tx=0x7fcfe802aa90 comp rx=0 tx=0).stop 2024-09-21T00:14:06.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.426+0000 7fcff6c00640 1 -- 172.21.15.83:0/781617820 shutdown_connections 2024-09-21T00:14:06.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.426+0000 7fcff6c00640 1 --2- 172.21.15.83:0/781617820 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcff015f5a0 0x7fcff015f9b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.426+0000 7fcff6c00640 1 --2- 172.21.15.83:0/781617820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff015b9f0 0x7fcff00cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.426+0000 7fcff6c00640 1 -- 172.21.15.83:0/781617820 >> 172.21.15.83:0/781617820 conn(0x7fcff00cca40 msgr2=0x7fcff00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:06.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.426+0000 7fcff6c00640 1 -- 172.21.15.83:0/781617820 shutdown_connections 2024-09-21T00:14:06.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.426+0000 7fcff6c00640 1 -- 172.21.15.83:0/781617820 wait complete. 2024-09-21T00:14:06.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.429+0000 7fcff6c00640 1 Processor -- start 2024-09-21T00:14:06.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.429+0000 7fcff6c00640 1 -- start start 2024-09-21T00:14:06.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.430+0000 7fcff6c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff00cefa0 0x7fcff00b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:06.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.430+0000 7fcff6c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff015b9f0 0x7fcff009b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.430+0000 7fcff6c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcff015f5a0 0x7fcff009b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.430+0000 7fcff6c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcff006df70 con 0x7fcff015f5a0 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.430+0000 7fcff6c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcff006ddf0 con 0x7fcff00cefa0 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.430+0000 7fcff6c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcff006e0f0 con 0x7fcff015b9f0 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.430+0000 7fcff4c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcff015f5a0 0x7fcff009b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.430+0000 7fcff4c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcff015f5a0 0x7fcff009b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49252/0 (socket says 172.21.15.83:49252) 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.430+0000 7fcff4c00640 1 -- 172.21.15.83:0/2059166588 learned_addr learned my addr 172.21.15.83:0/2059166588 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcfefe00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff00cefa0 0x7fcff00b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcfef400640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff015b9f0 0x7fcff009b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcff4c00640 1 -- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff015b9f0 msgr2=0x7fcff009b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcff4c00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff015b9f0 0x7fcff009b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcff4c00640 1 -- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff00cefa0 msgr2=0x7fcff00b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:06.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcff4c00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff00cefa0 0x7fcff00b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcff4c00640 1 -- 172.21.15.83:0/2059166588 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff00cb520 con 0x7fcff015f5a0 2024-09-21T00:14:06.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcfefe00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff00cefa0 0x7fcff00b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:06.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcff4c00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcff015f5a0 0x7fcff009b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009d90 tx=0x7fcfe8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:06.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcfe7e00640 1 -- 172.21.15.83:0/2059166588 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8044070 con 0x7fcff015f5a0 2024-09-21T00:14:06.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcfe7e00640 1 -- 172.21.15.83:0/2059166588 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfe8004040 con 0x7fcff015f5a0 2024-09-21T00:14:06.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcfe7e00640 1 -- 172.21.15.83:0/2059166588 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8004430 con 0x7fcff015f5a0 2024-09-21T00:14:06.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcff6c00640 1 -- 172.21.15.83:0/2059166588 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff015ce00 con 0x7fcff015f5a0 2024-09-21T00:14:06.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.431+0000 7fcff6c00640 1 -- 172.21.15.83:0/2059166588 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff015d3c0 con 0x7fcff015f5a0 2024-09-21T00:14:06.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.432+0000 7fcff6c00640 1 -- 172.21.15.83:0/2059166588 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff006e5f0 con 0x7fcff015f5a0 2024-09-21T00:14:06.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.434+0000 7fcfe7e00640 1 -- 172.21.15.83:0/2059166588 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcfe8047070 con 0x7fcff015f5a0 2024-09-21T00:14:06.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.434+0000 7fcfe7e00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcfd0078b90 0x7fcfd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:06.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.435+0000 7fcfe7e00640 1 -- 172.21.15.83:0/2059166588 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fcfe80bb860 con 0x7fcff015f5a0 2024-09-21T00:14:06.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.435+0000 7fcfefe00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcfd0078b90 0x7fcfd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:06.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.436+0000 7fcfefe00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcfd0078b90 0x7fcfd007b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009b80 tx=0x7fcfe0005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:06.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.439+0000 7fcfe7e00640 1 -- 172.21.15.83:0/2059166588 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcfe8032030 con 0x7fcff015f5a0 2024-09-21T00:14:06.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.662+0000 7fcff6c00640 1 -- 172.21.15.83:0/2059166588 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcff015cb90 con 0x7fcff015f5a0 2024-09-21T00:14:06.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.662+0000 7fcfe7e00640 1 -- 172.21.15.83:0/2059166588 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3909 (secure 0 0 0) 0x7fcfe8083fe0 con 0x7fcff015f5a0 2024-09-21T00:14:06.664 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:06.664 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":3,"btime":"2024-09-21T00:14:04:901348+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T00:14:06.664 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 3 2024-09-21T00:14:06.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.664+0000 7fcff6c00640 1 -- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcfd0078b90 msgr2=0x7fcfd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:06.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.664+0000 7fcff6c00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcfd0078b90 0x7fcfd007b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009b80 tx=0x7fcfe0005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:06.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.664+0000 7fcff6c00640 1 -- 172.21.15.83:0/2059166588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcff015f5a0 msgr2=0x7fcff009b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:06.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.665+0000 7fcff6c00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcff015f5a0 0x7fcff009b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009d90 tx=0x7fcfe8003ce0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.665+0000 7fcff6c00640 1 -- 172.21.15.83:0/2059166588 shutdown_connections 2024-09-21T00:14:06.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.665+0000 7fcff6c00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcfd0078b90 0x7fcfd007b0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.665+0000 7fcff6c00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcff015f5a0 0x7fcff009b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.665+0000 7fcff6c00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff015b9f0 0x7fcff009b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.665+0000 7fcff6c00640 1 --2- 172.21.15.83:0/2059166588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff00cefa0 0x7fcff00b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.665+0000 7fcff6c00640 1 -- 172.21.15.83:0/2059166588 >> 172.21.15.83:0/2059166588 conn(0x7fcff00cca40 msgr2=0x7fcff006ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:06.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.665+0000 7fcff6c00640 1 -- 172.21.15.83:0/2059166588 shutdown_connections 2024-09-21T00:14:06.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.665+0000 7fcff6c00640 1 -- 172.21.15.83:0/2059166588 wait complete. 2024-09-21T00:14:06.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T00:14:06.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.908+0000 7fe72a400640 1 -- 172.21.15.83:0/1079753384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe708004800 msgr2=0x7fe708004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:06.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.908+0000 7fe72a400640 1 --2- 172.21.15.83:0/1079753384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe708004800 0x7fe708004c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe724072990 tx=0x7fe708005830 comp rx=0 tx=0).stop 2024-09-21T00:14:06.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.908+0000 7fe723e00640 1 -- 172.21.15.83:0/1079753384 reap_dead start 2024-09-21T00:14:06.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.909+0000 7fe72a400640 1 -- 172.21.15.83:0/1079753384 shutdown_connections 2024-09-21T00:14:06.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.909+0000 7fe72a400640 1 -- 172.21.15.83:0/1079753384 >> 172.21.15.83:0/1079753384 conn(0x7fe7240cca40 msgr2=0x7fe7240cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:06.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.909+0000 7fe72a400640 1 -- 172.21.15.83:0/1079753384 shutdown_connections 2024-09-21T00:14:06.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.909+0000 7fe72a400640 1 -- 172.21.15.83:0/1079753384 wait complete. 2024-09-21T00:14:06.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.912+0000 7fe72a400640 1 Processor -- start 2024-09-21T00:14:06.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.912+0000 7fe72a400640 1 -- start start 2024-09-21T00:14:06.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe72a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe708004800 0x7fe7241f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:06.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe72a400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe724074e10 0x7fe72409e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:06.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe72a400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7240aefb0 0x7fe72409e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:06.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe72a400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe7240cf930 con 0x7fe724074e10 2024-09-21T00:14:06.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe72a400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe72406e710 con 0x7fe7240aefb0 2024-09-21T00:14:06.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe72a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe7240cfab0 con 0x7fe708004800 2024-09-21T00:14:06.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe722a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe724074e10 0x7fe72409e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:06.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe722a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe724074e10 0x7fe72409e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49266/0 (socket says 172.21.15.83:49266) 2024-09-21T00:14:06.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe722a00640 1 -- 172.21.15.83:0/1783422523 learned_addr learned my addr 172.21.15.83:0/1783422523 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:06.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe723e00640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7240aefb0 0x7fe72409e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:06.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.914+0000 7fe723400640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe708004800 0x7fe7241f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:06.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.915+0000 7fe722a00640 1 -- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe708004800 msgr2=0x7fe7241f29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:06.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.915+0000 7fe722a00640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe708004800 0x7fe7241f29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.915+0000 7fe722a00640 1 -- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7240aefb0 msgr2=0x7fe72409e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:06.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.915+0000 7fe722a00640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7240aefb0 0x7fe72409e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:06.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.915+0000 7fe722a00640 1 -- 172.21.15.83:0/1783422523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7240c0620 con 0x7fe724074e10 2024-09-21T00:14:06.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.915+0000 7fe722a00640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe724074e10 0x7fe72409e1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe710000c00 tx=0x7fe710003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:06.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.917+0000 7fe71b400640 1 -- 172.21.15.83:0/1783422523 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710001d40 con 0x7fe724074e10 2024-09-21T00:14:06.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.917+0000 7fe71b400640 1 -- 172.21.15.83:0/1783422523 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7100015e0 con 0x7fe724074e10 2024-09-21T00:14:06.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.917+0000 7fe72a400640 1 -- 172.21.15.83:0/1783422523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7240c0a90 con 0x7fe724074e10 2024-09-21T00:14:06.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.917+0000 7fe71b400640 1 -- 172.21.15.83:0/1783422523 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710038690 con 0x7fe724074e10 2024-09-21T00:14:06.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.917+0000 7fe72a400640 1 -- 172.21.15.83:0/1783422523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7240c1050 con 0x7fe724074e10 2024-09-21T00:14:06.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.918+0000 7fe72a400640 1 -- 172.21.15.83:0/1783422523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72415f9b0 con 0x7fe724074e10 2024-09-21T00:14:06.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.920+0000 7fe71b400640 1 -- 172.21.15.83:0/1783422523 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe710035020 con 0x7fe724074e10 2024-09-21T00:14:06.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.921+0000 7fe71b400640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe704078bc0 0x7fe70407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:06.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.921+0000 7fe71b400640 1 -- 172.21.15.83:0/1783422523 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe7100bad00 con 0x7fe724074e10 2024-09-21T00:14:06.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.921+0000 7fe723400640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe704078bc0 0x7fe70407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:06.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.922+0000 7fe723400640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe704078bc0 0x7fe70407b0d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe714009c50 tx=0x7fe714005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:06.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:06.925+0000 7fe71b400640 1 -- 172.21.15.83:0/1783422523 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe710047030 con 0x7fe724074e10 2024-09-21T00:14:07.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.115+0000 7fe72a400640 1 -- 172.21.15.83:0/1783422523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe7240c0820 con 0x7fe724074e10 2024-09-21T00:14:07.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.116+0000 7fe71b400640 1 -- 172.21.15.83:0/1783422523 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fe71003e070 con 0x7fe724074e10 2024-09-21T00:14:07.117 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:07.117 INFO:teuthology.orchestra.run.smithi083.stdout:[ 2024-09-21T00:14:07.118 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:14:07.118 INFO:teuthology.orchestra.run.smithi083.stdout: "poolnum": 1, 2024-09-21T00:14:07.118 INFO:teuthology.orchestra.run.smithi083.stdout: "poolname": ".mgr" 2024-09-21T00:14:07.118 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:14:07.118 INFO:teuthology.orchestra.run.smithi083.stdout:] 2024-09-21T00:14:07.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.118+0000 7fe72a400640 1 -- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe704078bc0 msgr2=0x7fe70407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:07.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.118+0000 7fe72a400640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe704078bc0 0x7fe70407b0d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe714009c50 tx=0x7fe714005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:07.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.118+0000 7fe72a400640 1 -- 172.21.15.83:0/1783422523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe724074e10 msgr2=0x7fe72409e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:07.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.118+0000 7fe72a400640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe724074e10 0x7fe72409e1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe710000c00 tx=0x7fe710003f30 comp rx=0 tx=0).stop 2024-09-21T00:14:07.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.118+0000 7fe72a400640 1 -- 172.21.15.83:0/1783422523 shutdown_connections 2024-09-21T00:14:07.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.118+0000 7fe72a400640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe704078bc0 0x7fe70407b0d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.118+0000 7fe72a400640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7240aefb0 0x7fe72409e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.118+0000 7fe72a400640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe724074e10 0x7fe72409e1a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.118+0000 7fe72a400640 1 --2- 172.21.15.83:0/1783422523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe708004800 0x7fe7241f29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.118+0000 7fe72a400640 1 -- 172.21.15.83:0/1783422523 >> 172.21.15.83:0/1783422523 conn(0x7fe7240cca40 msgr2=0x7fe72406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:07.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.119+0000 7fe72a400640 1 -- 172.21.15.83:0/1783422523 shutdown_connections 2024-09-21T00:14:07.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.119+0000 7fe72a400640 1 -- 172.21.15.83:0/1783422523 wait complete. 2024-09-21T00:14:07.142 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T00:14:07.143 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T00:14:07.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.364+0000 7f06f7000640 1 -- 172.21.15.83:0/2028843291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06f00b4a20 msgr2=0x7f06f00b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:07.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.364+0000 7f06f7000640 1 --2- 172.21.15.83:0/2028843291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06f00b4a20 0x7f06f00b4e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009830 tx=0x7f06dc02a510 comp rx=0 tx=0).stop 2024-09-21T00:14:07.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.364+0000 7f06f7000640 1 -- 172.21.15.83:0/2028843291 shutdown_connections 2024-09-21T00:14:07.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.364+0000 7f06f7000640 1 --2- 172.21.15.83:0/2028843291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06f00b4a20 0x7f06f00b4e30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.364+0000 7f06f7000640 1 -- 172.21.15.83:0/2028843291 >> 172.21.15.83:0/2028843291 conn(0x7f06f00d18c0 msgr2=0x7f06f00d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:07.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.364+0000 7f06f7000640 1 -- 172.21.15.83:0/2028843291 shutdown_connections 2024-09-21T00:14:07.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.364+0000 7f06f7000640 1 -- 172.21.15.83:0/2028843291 wait complete. 2024-09-21T00:14:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.366+0000 7f06f7000640 1 Processor -- start 2024-09-21T00:14:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.366+0000 7f06f7000640 1 -- start start 2024-09-21T00:14:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f7000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06f00b4a20 0x7f06f015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f7000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06f00b5370 0x7f06f014b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f7000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06f00ced00 0x7f06f014bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f7000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f06f0169aa0 con 0x7f06f00ced00 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f7000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f06f0169920 con 0x7f06f00b5370 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f7000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f06f0169c20 con 0x7f06f00b4a20 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f6600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06f00ced00 0x7f06f014bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f6600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06f00ced00 0x7f06f014bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49296/0 (socket says 172.21.15.83:49296) 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f6600640 1 -- 172.21.15.83:0/622876140 learned_addr learned my addr 172.21.15.83:0/622876140 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f5200640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06f00b5370 0x7f06f014b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f5c00640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06f00b4a20 0x7f06f015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f6600640 1 -- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06f00b4a20 msgr2=0x7f06f015a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f6600640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06f00b4a20 0x7f06f015a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f6600640 1 -- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06f00b5370 msgr2=0x7f06f014b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:07.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f6600640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06f00b5370 0x7f06f014b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.368+0000 7f06f6600640 1 -- 172.21.15.83:0/622876140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f00b77c0 con 0x7f06f00ced00 2024-09-21T00:14:07.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.369+0000 7f06f6600640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06f00ced00 0x7f06f014bc90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f06e800b970 tx=0x7f06e800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:07.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.369+0000 7f06ed600640 1 -- 172.21.15.83:0/622876140 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8019070 con 0x7f06f00ced00 2024-09-21T00:14:07.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.369+0000 7f06ed600640 1 -- 172.21.15.83:0/622876140 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06e800cc30 con 0x7f06f00ced00 2024-09-21T00:14:07.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.369+0000 7f06f7000640 1 -- 172.21.15.83:0/622876140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f00b7aa0 con 0x7f06f00ced00 2024-09-21T00:14:07.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.369+0000 7f06ed600640 1 -- 172.21.15.83:0/622876140 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80146a0 con 0x7f06f00ced00 2024-09-21T00:14:07.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.369+0000 7f06f7000640 1 -- 172.21.15.83:0/622876140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f00b8490 con 0x7f06f00ced00 2024-09-21T00:14:07.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.370+0000 7f06f7000640 1 -- 172.21.15.83:0/622876140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f00b7fa0 con 0x7f06f00ced00 2024-09-21T00:14:07.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.371+0000 7f06ed600640 1 -- 172.21.15.83:0/622876140 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06e801c070 con 0x7f06f00ced00 2024-09-21T00:14:07.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.372+0000 7f06ed600640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f06d0078b90 0x7f06d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:07.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.372+0000 7f06ed600640 1 -- 172.21.15.83:0/622876140 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f06e809a6a0 con 0x7f06f00ced00 2024-09-21T00:14:07.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.373+0000 7f06f5c00640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f06d0078b90 0x7f06d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:07.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.373+0000 7f06f5c00640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f06d0078b90 0x7f06d007b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f06e4001720 tx=0x7f06e4007e90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:07.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.377+0000 7f06ed600640 1 -- 172.21.15.83:0/622876140 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f06e8062740 con 0x7f06f00ced00 2024-09-21T00:14:07.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.565+0000 7f06f7000640 1 -- 172.21.15.83:0/622876140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f06f00b5150 con 0x7f06f00ced00 2024-09-21T00:14:07.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.923+0000 7f06ed600640 1 -- 172.21.15.83:0/622876140 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f06e8067170 con 0x7f06f00ced00 2024-09-21T00:14:07.924 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' created 2024-09-21T00:14:07.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 -- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f06d0078b90 msgr2=0x7f06d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:07.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f06d0078b90 0x7f06d007b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f06e4001720 tx=0x7f06e4007e90 comp rx=0 tx=0).stop 2024-09-21T00:14:07.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 -- 172.21.15.83:0/622876140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06f00ced00 msgr2=0x7f06f014bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:07.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06f00ced00 0x7f06f014bc90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f06e800b970 tx=0x7f06e800be30 comp rx=0 tx=0).stop 2024-09-21T00:14:07.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 -- 172.21.15.83:0/622876140 shutdown_connections 2024-09-21T00:14:07.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f06d0078b90 0x7f06d007b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06f00ced00 0x7f06f014bc90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06f00b5370 0x7f06f014b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 --2- 172.21.15.83:0/622876140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06f00b4a20 0x7f06f015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:07.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 -- 172.21.15.83:0/622876140 >> 172.21.15.83:0/622876140 conn(0x7f06f00d18c0 msgr2=0x7f06f00d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:07.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 -- 172.21.15.83:0/622876140 shutdown_connections 2024-09-21T00:14:07.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:07.926+0000 7f06f7000640 1 -- 172.21.15.83:0/622876140 wait complete. 2024-09-21T00:14:07.954 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T00:14:08.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.180+0000 7f3805000640 1 -- 172.21.15.83:0/3363615939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000cbc10 msgr2=0x7f38000cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:08.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.180+0000 7f3805000640 1 --2- 172.21.15.83:0/3363615939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000cbc10 0x7f38000cc020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3800076390 tx=0x7f37ec02a560 comp rx=0 tx=0).stop 2024-09-21T00:14:08.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.180+0000 7f3805000640 1 -- 172.21.15.83:0/3363615939 shutdown_connections 2024-09-21T00:14:08.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.180+0000 7f3805000640 1 --2- 172.21.15.83:0/3363615939 >> v2:172.21.15.142:3300/0 conn(0x7f380006ddf0 0x7f380006e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:08.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.180+0000 7f3805000640 1 --2- 172.21.15.83:0/3363615939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38000cbc10 0x7f38000cc020 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:08.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.180+0000 7f3805000640 1 --2- 172.21.15.83:0/3363615939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3800074cb0 0x7f3800073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:08.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.180+0000 7f3805000640 1 -- 172.21.15.83:0/3363615939 >> 172.21.15.83:0/3363615939 conn(0x7f38000cca40 msgr2=0x7f38000cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:08.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.180+0000 7f3805000640 1 -- 172.21.15.83:0/3363615939 shutdown_connections 2024-09-21T00:14:08.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.180+0000 7f3805000640 1 -- 172.21.15.83:0/3363615939 wait complete. 2024-09-21T00:14:08.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.182+0000 7f3805000640 1 Processor -- start 2024-09-21T00:14:08.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.183+0000 7f3805000640 1 -- start start 2024-09-21T00:14:08.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.184+0000 7f3805000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380006ddf0 0x7f38001f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:08.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.184+0000 7f3805000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3800074cb0 0x7f38000b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.184+0000 7f3805000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38000cbc10 0x7f38001e9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.184+0000 7f3805000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f380006f170 con 0x7f380006ddf0 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.184+0000 7f3805000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f380006eff0 con 0x7f38000cbc10 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.184+0000 7f3805000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f380006f2f0 con 0x7f3800074cb0 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.184+0000 7f37fde00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380006ddf0 0x7f38001f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.184+0000 7f37fde00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380006ddf0 0x7f38001f65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49320/0 (socket says 172.21.15.83:49320) 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.184+0000 7f37fde00640 1 -- 172.21.15.83:0/84196349 learned_addr learned my addr 172.21.15.83:0/84196349 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37fd400640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3800074cb0 0x7f38000b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37fe800640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38000cbc10 0x7f38001e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37fde00640 1 -- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3800074cb0 msgr2=0x7f38000b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:08.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37fde00640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3800074cb0 0x7f38000b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:08.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37fde00640 1 -- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38000cbc10 msgr2=0x7f38001e9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:08.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37fde00640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38000cbc10 0x7f38001e9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:08.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37fde00640 1 -- 172.21.15.83:0/84196349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380009e840 con 0x7f380006ddf0 2024-09-21T00:14:08.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37fd400640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3800074cb0 0x7f38000b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:08.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37fde00640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380006ddf0 0x7f38001f65a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f37f000e770 tx=0x7f37f000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:08.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37f6000640 1 -- 172.21.15.83:0/84196349 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f000ccc0 con 0x7f380006ddf0 2024-09-21T00:14:08.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37f6000640 1 -- 172.21.15.83:0/84196349 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37f000ee80 con 0x7f380006ddf0 2024-09-21T00:14:08.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f37f6000640 1 -- 172.21.15.83:0/84196349 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f0004290 con 0x7f380006ddf0 2024-09-21T00:14:08.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f3805000640 1 -- 172.21.15.83:0/84196349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380009eb20 con 0x7f380006ddf0 2024-09-21T00:14:08.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.185+0000 7f3805000640 1 -- 172.21.15.83:0/84196349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f380009f0e0 con 0x7f380006ddf0 2024-09-21T00:14:08.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.186+0000 7f3805000640 1 -- 172.21.15.83:0/84196349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3800073dd0 con 0x7f380006ddf0 2024-09-21T00:14:08.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.188+0000 7f37f6000640 1 -- 172.21.15.83:0/84196349 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f37f00035f0 con 0x7f380006ddf0 2024-09-21T00:14:08.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.189+0000 7f37f6000640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f37e0078b90 0x7f37e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:08.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.189+0000 7f37f6000640 1 -- 172.21.15.83:0/84196349 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f37f009b570 con 0x7f380006ddf0 2024-09-21T00:14:08.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.189+0000 7f37fd400640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f37e0078b90 0x7f37e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:08.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.190+0000 7f37fd400640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f37e0078b90 0x7f37e007b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37ec033000 tx=0x7f37ec004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:08.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.194+0000 7f37f6000640 1 -- 172.21.15.83:0/84196349 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f37f0063b80 con 0x7f380006ddf0 2024-09-21T00:14:08.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.380+0000 7f3805000640 1 -- 172.21.15.83:0/84196349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f38000b5c20 con 0x7f380006ddf0 2024-09-21T00:14:08.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.929+0000 7f37f6000640 1 -- 172.21.15.83:0/84196349 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7f37f0063480 con 0x7f380006ddf0 2024-09-21T00:14:08.930 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' created 2024-09-21T00:14:08.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.932+0000 7f3805000640 1 -- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f37e0078b90 msgr2=0x7f37e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:08.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.932+0000 7f3805000640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f37e0078b90 0x7f37e007b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37ec033000 tx=0x7f37ec004730 comp rx=0 tx=0).stop 2024-09-21T00:14:08.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.932+0000 7f3805000640 1 -- 172.21.15.83:0/84196349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380006ddf0 msgr2=0x7f38001f65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:08.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.932+0000 7f3805000640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380006ddf0 0x7f38001f65a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f37f000e770 tx=0x7f37f000ec30 comp rx=0 tx=0).stop 2024-09-21T00:14:08.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.933+0000 7f3805000640 1 -- 172.21.15.83:0/84196349 shutdown_connections 2024-09-21T00:14:08.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.933+0000 7f3805000640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f37e0078b90 0x7f37e007b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:08.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.933+0000 7f3805000640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38000cbc10 0x7f38001e9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:08.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.933+0000 7f3805000640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3800074cb0 0x7f38000b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:08.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.933+0000 7f3805000640 1 --2- 172.21.15.83:0/84196349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380006ddf0 0x7f38001f65a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:08.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.933+0000 7f3805000640 1 -- 172.21.15.83:0/84196349 >> 172.21.15.83:0/84196349 conn(0x7f38000cca40 msgr2=0x7f380015a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:08.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.933+0000 7f3805000640 1 -- 172.21.15.83:0/84196349 shutdown_connections 2024-09-21T00:14:08.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:08.934+0000 7f3805000640 1 -- 172.21.15.83:0/84196349 wait complete. 2024-09-21T00:14:08.977 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T00:14:09.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.199+0000 7f48aee00640 1 -- 172.21.15.83:0/2522589901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a80d0d80 msgr2=0x7f48a8167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:09.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.199+0000 7f48aee00640 1 --2- 172.21.15.83:0/2522589901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a80d0d80 0x7f48a8167550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f48a0005fd0 tx=0x7f48a002a8b0 comp rx=0 tx=0).stop 2024-09-21T00:14:09.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.199+0000 7f48aee00640 1 -- 172.21.15.83:0/2522589901 shutdown_connections 2024-09-21T00:14:09.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.199+0000 7f48aee00640 1 --2- 172.21.15.83:0/2522589901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a80d0d80 0x7f48a8167550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:09.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.199+0000 7f48aee00640 1 -- 172.21.15.83:0/2522589901 >> 172.21.15.83:0/2522589901 conn(0x7f48a80b46e0 msgr2=0x7f48a80d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:09.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.200+0000 7f48aee00640 1 -- 172.21.15.83:0/2522589901 shutdown_connections 2024-09-21T00:14:09.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.200+0000 7f48aee00640 1 -- 172.21.15.83:0/2522589901 wait complete. 2024-09-21T00:14:09.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.202+0000 7f48aee00640 1 Processor -- start 2024-09-21T00:14:09.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.202+0000 7f48aee00640 1 -- start start 2024-09-21T00:14:09.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.203+0000 7f48aee00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48a80ccc40 0x7f48a815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:09.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.203+0000 7f48aee00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a815ca90 0x7f48a814fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:09.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.203+0000 7f48aee00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48a8166ff0 0x7f48a815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.203+0000 7f48aee00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f48a8167e20 con 0x7f48a815ca90 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.203+0000 7f48aee00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f48a8167ca0 con 0x7f48a8166ff0 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.203+0000 7f48aee00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f48a8167fa0 con 0x7f48a80ccc40 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f489f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a815ca90 0x7f48a814fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f489f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a815ca90 0x7f48a814fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49334/0 (socket says 172.21.15.83:49334) 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f489f400640 1 -- 172.21.15.83:0/2861666840 learned_addr learned my addr 172.21.15.83:0/2861666840 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f48ace00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48a8166ff0 0x7f48a815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f48a7e00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48a80ccc40 0x7f48a815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f489f400640 1 -- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48a80ccc40 msgr2=0x7f48a815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f489f400640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48a80ccc40 0x7f48a815ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f489f400640 1 -- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48a8166ff0 msgr2=0x7f48a815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f489f400640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48a8166ff0 0x7f48a815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:09.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f489f400640 1 -- 172.21.15.83:0/2861666840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a8154d10 con 0x7f48a815ca90 2024-09-21T00:14:09.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.204+0000 7f489f400640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a815ca90 0x7f48a814fae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f489000c370 tx=0x7f489000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:09.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.205+0000 7f48a4c00640 1 -- 172.21.15.83:0/2861666840 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4890017070 con 0x7f48a815ca90 2024-09-21T00:14:09.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.205+0000 7f48a4c00640 1 -- 172.21.15.83:0/2861666840 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48900035f0 con 0x7f48a815ca90 2024-09-21T00:14:09.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.205+0000 7f48a4c00640 1 -- 172.21.15.83:0/2861666840 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4890003a40 con 0x7f48a815ca90 2024-09-21T00:14:09.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.205+0000 7f48aee00640 1 -- 172.21.15.83:0/2861666840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a81f61a0 con 0x7f48a815ca90 2024-09-21T00:14:09.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.205+0000 7f48aee00640 1 -- 172.21.15.83:0/2861666840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a81546c0 con 0x7f48a815ca90 2024-09-21T00:14:09.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.206+0000 7f48aee00640 1 -- 172.21.15.83:0/2861666840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a815a930 con 0x7f48a815ca90 2024-09-21T00:14:09.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.207+0000 7f48a4c00640 1 -- 172.21.15.83:0/2861666840 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f489001a070 con 0x7f48a815ca90 2024-09-21T00:14:09.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.208+0000 7f48a4c00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4884078b90 0x7f488407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:09.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.209+0000 7f48a4c00640 1 -- 172.21.15.83:0/2861666840 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f489009a2c0 con 0x7f48a815ca90 2024-09-21T00:14:09.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.209+0000 7f48a7e00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4884078b90 0x7f488407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:09.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.210+0000 7f48a7e00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4884078b90 0x7f488407b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4898000f60 tx=0x7f4898009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:09.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.212+0000 7f48a4c00640 1 -- 172.21.15.83:0/2861666840 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4890021020 con 0x7f48a815ca90 2024-09-21T00:14:09.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.436+0000 7f48aee00640 1 -- 172.21.15.83:0/2861666840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f48a80b82b0 con 0x7f48a815ca90 2024-09-21T00:14:09.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.946+0000 7f48a4c00640 1 -- 172.21.15.83:0/2861666840 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f48900690d0 con 0x7f48a815ca90 2024-09-21T00:14:09.952 INFO:teuthology.orchestra.run.smithi083.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T00:14:09.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.958+0000 7f48aee00640 1 -- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4884078b90 msgr2=0x7f488407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.958+0000 7f48aee00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4884078b90 0x7f488407b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4898000f60 tx=0x7f4898009040 comp rx=0 tx=0).stop 2024-09-21T00:14:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.958+0000 7f48aee00640 1 -- 172.21.15.83:0/2861666840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a815ca90 msgr2=0x7f48a814fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.958+0000 7f48aee00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a815ca90 0x7f48a814fae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f489000c370 tx=0x7f489000c830 comp rx=0 tx=0).stop 2024-09-21T00:14:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.959+0000 7f48aee00640 1 -- 172.21.15.83:0/2861666840 shutdown_connections 2024-09-21T00:14:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.959+0000 7f48aee00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4884078b90 0x7f488407b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.959+0000 7f48aee00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48a8166ff0 0x7f48a815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.959+0000 7f48aee00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a815ca90 0x7f48a814fae0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f489000c370 tx=0x7f489000c830 comp rx=0 tx=0).stop 2024-09-21T00:14:09.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.959+0000 7f48aee00640 1 --2- 172.21.15.83:0/2861666840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48a80ccc40 0x7f48a815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:09.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.959+0000 7f48aee00640 1 -- 172.21.15.83:0/2861666840 >> 172.21.15.83:0/2861666840 conn(0x7f48a80b46e0 msgr2=0x7f48a8070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:09.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.960+0000 7f48aee00640 1 -- 172.21.15.83:0/2861666840 shutdown_connections 2024-09-21T00:14:09.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:09.960+0000 7f48aee00640 1 -- 172.21.15.83:0/2861666840 wait complete. 2024-09-21T00:14:10.000 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T00:14:10.001 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T00:14:10.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.227+0000 7f92a3200640 1 -- 172.21.15.83:0/4182414035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9288003ac0 msgr2=0x7f9288003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:10.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.227+0000 7f92a3200640 1 --2- 172.21.15.83:0/4182414035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9288003ac0 0x7f9288003f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f929400c4a0 tx=0x7f9288005830 comp rx=0 tx=0).stop 2024-09-21T00:14:10.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.227+0000 7f92a3200640 1 -- 172.21.15.83:0/4182414035 shutdown_connections 2024-09-21T00:14:10.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.227+0000 7f92a3200640 1 --2- 172.21.15.83:0/4182414035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9288003ac0 0x7f9288003f30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:10.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.227+0000 7f92a3200640 1 -- 172.21.15.83:0/4182414035 >> 172.21.15.83:0/4182414035 conn(0x7f92a40d1210 msgr2=0x7f92a40cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:10.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.227+0000 7f92a3200640 1 -- 172.21.15.83:0/4182414035 shutdown_connections 2024-09-21T00:14:10.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.227+0000 7f92a3200640 1 -- 172.21.15.83:0/4182414035 wait complete. 2024-09-21T00:14:10.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.229+0000 7f92a3200640 1 Processor -- start 2024-09-21T00:14:10.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.230+0000 7f92a3200640 1 -- start start 2024-09-21T00:14:10.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f92a3200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9288003ac0 0x7f92a413e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:10.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f92a3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92a41e6540 0x7f92a41f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f92a3200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a41f35a0 0x7f92a41f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f92a3200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f92a40712d0 con 0x7f9288003ac0 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f92a3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f92a40cec70 con 0x7f92a41e6540 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f92a3200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f92a4071450 con 0x7f92a41f35a0 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f92a1e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9288003ac0 0x7f92a413e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f92a1e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9288003ac0 0x7f92a413e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49358/0 (socket says 172.21.15.83:49358) 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f92a1e00640 1 -- 172.21.15.83:0/815010465 learned_addr learned my addr 172.21.15.83:0/815010465 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f9299400640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92a41e6540 0x7f92a41f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.231+0000 7f92a2800640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a41f35a0 0x7f92a41f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f92a1e00640 1 -- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a41f35a0 msgr2=0x7f92a41f39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f92a1e00640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a41f35a0 0x7f92a41f39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f92a1e00640 1 -- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92a41e6540 msgr2=0x7f92a41f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:10.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f92a1e00640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92a41e6540 0x7f92a41f3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:10.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f92a1e00640 1 -- 172.21.15.83:0/815010465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a4156050 con 0x7f9288003ac0 2024-09-21T00:14:10.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f92a2800640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a41f35a0 0x7f92a41f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:10.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f92a1e00640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9288003ac0 0x7f92a413e4e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f929402b300 tx=0x7f9294000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:10.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f929aa00640 1 -- 172.21.15.83:0/815010465 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294042070 con 0x7f9288003ac0 2024-09-21T00:14:10.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f929aa00640 1 -- 172.21.15.83:0/815010465 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f929402b610 con 0x7f9288003ac0 2024-09-21T00:14:10.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f929aa00640 1 -- 172.21.15.83:0/815010465 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294039070 con 0x7f9288003ac0 2024-09-21T00:14:10.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f92a3200640 1 -- 172.21.15.83:0/815010465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a413ea20 con 0x7f9288003ac0 2024-09-21T00:14:10.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.232+0000 7f92a3200640 1 -- 172.21.15.83:0/815010465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a41e8d90 con 0x7f9288003ac0 2024-09-21T00:14:10.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.233+0000 7f92a3200640 1 -- 172.21.15.83:0/815010465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a40cd8e0 con 0x7f9288003ac0 2024-09-21T00:14:10.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.234+0000 7f929aa00640 1 -- 172.21.15.83:0/815010465 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f929402ba20 con 0x7f9288003ac0 2024-09-21T00:14:10.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.235+0000 7f929aa00640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9280078b90 0x7f928007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:10.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.235+0000 7f929aa00640 1 -- 172.21.15.83:0/815010465 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f92940ba8b0 con 0x7f9288003ac0 2024-09-21T00:14:10.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.236+0000 7f9299400640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9280078b90 0x7f928007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:10.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.237+0000 7f9299400640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9280078b90 0x7f928007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92a41e6050 tx=0x7f928c006b20 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:10.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.240+0000 7f929aa00640 1 -- 172.21.15.83:0/815010465 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92a4071df0 con 0x7f9288003ac0 2024-09-21T00:14:10.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.431+0000 7f92a3200640 1 -- 172.21.15.83:0/815010465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f92a40cf610 con 0x7f9288003ac0 2024-09-21T00:14:10.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.946+0000 7f929aa00640 1 -- 172.21.15.83:0/815010465 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7f9294082cd0 con 0x7f9288003ac0 2024-09-21T00:14:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.949+0000 7f92a3200640 1 -- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9280078b90 msgr2=0x7f928007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.949+0000 7f92a3200640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9280078b90 0x7f928007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92a41e6050 tx=0x7f928c006b20 comp rx=0 tx=0).stop 2024-09-21T00:14:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.949+0000 7f92a3200640 1 -- 172.21.15.83:0/815010465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9288003ac0 msgr2=0x7f92a413e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.949+0000 7f92a3200640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9288003ac0 0x7f92a413e4e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f929402b300 tx=0x7f9294000f50 comp rx=0 tx=0).stop 2024-09-21T00:14:10.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.949+0000 7f92a3200640 1 -- 172.21.15.83:0/815010465 shutdown_connections 2024-09-21T00:14:10.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.949+0000 7f92a3200640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9280078b90 0x7f928007b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:10.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.949+0000 7f92a3200640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a41f35a0 0x7f92a41f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:10.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.949+0000 7f92a3200640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92a41e6540 0x7f92a41f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:10.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.949+0000 7f92a3200640 1 --2- 172.21.15.83:0/815010465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9288003ac0 0x7f92a413e4e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:10.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.949+0000 7f92a3200640 1 -- 172.21.15.83:0/815010465 >> 172.21.15.83:0/815010465 conn(0x7f92a40d1210 msgr2=0x7f92a40cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:10.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.950+0000 7f92a3200640 1 -- 172.21.15.83:0/815010465 shutdown_connections 2024-09-21T00:14:10.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:10.950+0000 7f92a3200640 1 -- 172.21.15.83:0/815010465 wait complete. 2024-09-21T00:14:10.975 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T00:14:11.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.207+0000 7ff8cc800640 1 -- 172.21.15.83:0/4054693143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8c40cd660 msgr2=0x7ff8c4074b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:11.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.207+0000 7ff8cc800640 1 --2- 172.21.15.83:0/4054693143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8c40cd660 0x7ff8c4074b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40cabd0 tx=0x7ff8b802a530 comp rx=0 tx=0).stop 2024-09-21T00:14:11.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.207+0000 7ff8cc800640 1 -- 172.21.15.83:0/4054693143 shutdown_connections 2024-09-21T00:14:11.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.207+0000 7ff8cc800640 1 --2- 172.21.15.83:0/4054693143 >> v2:172.21.15.142:3300/0 conn(0x7ff8c406e3b0 0x7ff8c41662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:11.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.207+0000 7ff8cc800640 1 --2- 172.21.15.83:0/4054693143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8c40cd660 0x7ff8c4074b10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:11.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.207+0000 7ff8cc800640 1 -- 172.21.15.83:0/4054693143 >> 172.21.15.83:0/4054693143 conn(0x7ff8c40ccb40 msgr2=0x7ff8c40ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:11.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.207+0000 7ff8cc800640 1 -- 172.21.15.83:0/4054693143 shutdown_connections 2024-09-21T00:14:11.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.207+0000 7ff8cc800640 1 -- 172.21.15.83:0/4054693143 wait complete. 2024-09-21T00:14:11.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.209+0000 7ff8cc800640 1 Processor -- start 2024-09-21T00:14:11.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.209+0000 7ff8cc800640 1 -- start start 2024-09-21T00:14:11.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8cc800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8c406e3b0 0x7ff8c4158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:11.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8cc800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c4072ed0 0x7ff8c41f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:11.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8cc800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40cd660 0x7ff8c40c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:11.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8cc800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4166970 con 0x7ff8c406e3b0 2024-09-21T00:14:11.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8cc800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c41667f0 con 0x7ff8c4072ed0 2024-09-21T00:14:11.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8cc800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c4166af0 con 0x7ff8c40cd660 2024-09-21T00:14:11.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8c9e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8c406e3b0 0x7ff8c4158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:11.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8c9e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8c406e3b0 0x7ff8c4158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49376/0 (socket says 172.21.15.83:49376) 2024-09-21T00:14:11.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8c9e00640 1 -- 172.21.15.83:0/1446683194 learned_addr learned my addr 172.21.15.83:0/1446683194 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:11.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8c9400640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c4072ed0 0x7ff8c41f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:11.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.211+0000 7ff8ca800640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40cd660 0x7ff8c40c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:11.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8c9e00640 1 -- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40cd660 msgr2=0x7ff8c40c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:11.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8c9e00640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40cd660 0x7ff8c40c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:11.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8c9e00640 1 -- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c4072ed0 msgr2=0x7ff8c41f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:11.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8c9e00640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c4072ed0 0x7ff8c41f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:11.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8c9e00640 1 -- 172.21.15.83:0/1446683194 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c41f5820 con 0x7ff8c406e3b0 2024-09-21T00:14:11.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8c9e00640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8c406e3b0 0x7ff8c4158030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80098f0 tx=0x7ff8b8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:11.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8be000640 1 -- 172.21.15.83:0/1446683194 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8005c90 con 0x7ff8c406e3b0 2024-09-21T00:14:11.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8be000640 1 -- 172.21.15.83:0/1446683194 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8b8031e50 con 0x7ff8c406e3b0 2024-09-21T00:14:11.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8cc800640 1 -- 172.21.15.83:0/1446683194 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c41f62c0 con 0x7ff8c406e3b0 2024-09-21T00:14:11.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8be000640 1 -- 172.21.15.83:0/1446683194 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8005260 con 0x7ff8c406e3b0 2024-09-21T00:14:11.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.212+0000 7ff8cc800640 1 -- 172.21.15.83:0/1446683194 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c41f5fe0 con 0x7ff8c406e3b0 2024-09-21T00:14:11.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.213+0000 7ff8cc800640 1 -- 172.21.15.83:0/1446683194 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c4157530 con 0x7ff8c406e3b0 2024-09-21T00:14:11.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.215+0000 7ff8be000640 1 -- 172.21.15.83:0/1446683194 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8b8005400 con 0x7ff8c406e3b0 2024-09-21T00:14:11.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.216+0000 7ff8be000640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8a8078bc0 0x7ff8a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:11.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.216+0000 7ff8be000640 1 -- 172.21.15.83:0/1446683194 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7ff8b80bbf80 con 0x7ff8c406e3b0 2024-09-21T00:14:11.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.217+0000 7ff8c9400640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8a8078bc0 0x7ff8a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:11.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.217+0000 7ff8c9400640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8a8078bc0 0x7ff8a807b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4007fd0 tx=0x7ff8b4001370 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:11.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.221+0000 7ff8be000640 1 -- 172.21.15.83:0/1446683194 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff8c4157530 con 0x7ff8c406e3b0 2024-09-21T00:14:11.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:11.408+0000 7ff8cc800640 1 -- 172.21.15.83:0/1446683194 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff8c4074b10 con 0x7ff8c406e3b0 2024-09-21T00:14:12.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.960+0000 7ff8be000640 1 -- 172.21.15.83:0/1446683194 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7ff8c41f5820 con 0x7ff8c406e3b0 2024-09-21T00:14:12.961 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data_ec' created 2024-09-21T00:14:12.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.963+0000 7ff8cc800640 1 -- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8a8078bc0 msgr2=0x7ff8a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:12.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.963+0000 7ff8cc800640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8a8078bc0 0x7ff8a807b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4007fd0 tx=0x7ff8b4001370 comp rx=0 tx=0).stop 2024-09-21T00:14:12.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.963+0000 7ff8cc800640 1 -- 172.21.15.83:0/1446683194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8c406e3b0 msgr2=0x7ff8c4158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:12.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.963+0000 7ff8cc800640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8c406e3b0 0x7ff8c4158030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80098f0 tx=0x7ff8b8033c20 comp rx=0 tx=0).stop 2024-09-21T00:14:12.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.963+0000 7ff8cc800640 1 -- 172.21.15.83:0/1446683194 shutdown_connections 2024-09-21T00:14:12.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.963+0000 7ff8cc800640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8a8078bc0 0x7ff8a807b0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:12.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.963+0000 7ff8cc800640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40cd660 0x7ff8c40c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:12.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.963+0000 7ff8cc800640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c4072ed0 0x7ff8c41f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:12.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.963+0000 7ff8cc800640 1 --2- 172.21.15.83:0/1446683194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8c406e3b0 0x7ff8c4158030 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:12.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.963+0000 7ff8cc800640 1 -- 172.21.15.83:0/1446683194 >> 172.21.15.83:0/1446683194 conn(0x7ff8c40ccb40 msgr2=0x7ff8c40afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:12.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.964+0000 7ff8cc800640 1 -- 172.21.15.83:0/1446683194 shutdown_connections 2024-09-21T00:14:12.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:12.964+0000 7ff8cc800640 1 -- 172.21.15.83:0/1446683194 wait complete. 2024-09-21T00:14:12.999 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T00:14:13.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.226+0000 7fc97b200640 1 -- 172.21.15.83:0/319438592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc97c0cf200 msgr2=0x7fc97c1604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:13.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.226+0000 7fc97b200640 1 --2- 172.21.15.83:0/319438592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc97c0cf200 0x7fc97c1604a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0d0d60 tx=0x7fc97402aac0 comp rx=0 tx=0).stop 2024-09-21T00:14:13.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.226+0000 7fc97b200640 1 -- 172.21.15.83:0/319438592 shutdown_connections 2024-09-21T00:14:13.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.226+0000 7fc97b200640 1 --2- 172.21.15.83:0/319438592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc97c0cf200 0x7fc97c1604a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:13.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.226+0000 7fc97b200640 1 --2- 172.21.15.83:0/319438592 >> v2:172.21.15.142:3300/0 conn(0x7fc97c0b2e60 0x7fc97c15ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:13.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.226+0000 7fc97b200640 1 -- 172.21.15.83:0/319438592 >> 172.21.15.83:0/319438592 conn(0x7fc97c0d0460 msgr2=0x7fc97c06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:13.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.226+0000 7fc97b200640 1 -- 172.21.15.83:0/319438592 shutdown_connections 2024-09-21T00:14:13.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.226+0000 7fc97b200640 1 -- 172.21.15.83:0/319438592 wait complete. 2024-09-21T00:14:13.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.228+0000 7fc97b200640 1 Processor -- start 2024-09-21T00:14:13.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.229+0000 7fc97b200640 1 -- start start 2024-09-21T00:14:13.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.230+0000 7fc97b200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc97c0b2e60 0x7fc97c13ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:13.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.230+0000 7fc97b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c0cf200 0x7fc97c0b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:13.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.230+0000 7fc97b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97c145cc0 0x7fc97c0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:13.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.230+0000 7fc97b200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c06fe60 con 0x7fc97c0b2e60 2024-09-21T00:14:13.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.230+0000 7fc97b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c06fce0 con 0x7fc97c0cf200 2024-09-21T00:14:13.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.230+0000 7fc97b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc97c06ffe0 con 0x7fc97c145cc0 2024-09-21T00:14:13.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.230+0000 7fc979e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc97c0b2e60 0x7fc97c13ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:13.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.230+0000 7fc979e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc97c0b2e60 0x7fc97c13ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59768/0 (socket says 172.21.15.83:59768) 2024-09-21T00:14:13.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.230+0000 7fc979e00640 1 -- 172.21.15.83:0/3261677354 learned_addr learned my addr 172.21.15.83:0/3261677354 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:13.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc971400640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c0cf200 0x7fc97c0b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:13.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc97a800640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97c145cc0 0x7fc97c0b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc979e00640 1 -- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97c145cc0 msgr2=0x7fc97c0b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc979e00640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97c145cc0 0x7fc97c0b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc979e00640 1 -- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c0cf200 msgr2=0x7fc97c0b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc979e00640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c0cf200 0x7fc97c0b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc979e00640 1 -- 172.21.15.83:0/3261677354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c142120 con 0x7fc97c0b2e60 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc971400640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c0cf200 0x7fc97c0b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc97a800640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97c145cc0 0x7fc97c0b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc979e00640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc97c0b2e60 0x7fc97c13ba20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00e790 tx=0x7fc96c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc972a00640 1 -- 172.21.15.83:0/3261677354 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00eea0 con 0x7fc97c0b2e60 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc972a00640 1 -- 172.21.15.83:0/3261677354 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc96c00cdb0 con 0x7fc97c0b2e60 2024-09-21T00:14:13.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.231+0000 7fc972a00640 1 -- 172.21.15.83:0/3261677354 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c010690 con 0x7fc97c0b2e60 2024-09-21T00:14:13.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.232+0000 7fc97b200640 1 -- 172.21.15.83:0/3261677354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97c142400 con 0x7fc97c0b2e60 2024-09-21T00:14:13.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.232+0000 7fc97b200640 1 -- 172.21.15.83:0/3261677354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97c1429c0 con 0x7fc97c0b2e60 2024-09-21T00:14:13.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.233+0000 7fc97b200640 1 -- 172.21.15.83:0/3261677354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97c070500 con 0x7fc97c0b2e60 2024-09-21T00:14:13.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.234+0000 7fc972a00640 1 -- 172.21.15.83:0/3261677354 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc96c010830 con 0x7fc97c0b2e60 2024-09-21T00:14:13.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.235+0000 7fc972a00640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc958078bc0 0x7fc95807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:13.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.235+0000 7fc972a00640 1 -- 172.21.15.83:0/3261677354 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fc96c09c2b0 con 0x7fc97c0b2e60 2024-09-21T00:14:13.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.236+0000 7fc971400640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc958078bc0 0x7fc95807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:13.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.236+0000 7fc971400640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc958078bc0 0x7fc95807b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc97c06e2e0 tx=0x7fc964009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:13.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.239+0000 7fc972a00640 1 -- 172.21.15.83:0/3261677354 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc96c064440 con 0x7fc97c0b2e60 2024-09-21T00:14:13.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.427+0000 7fc97b200640 1 -- 172.21.15.83:0/3261677354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fc97c15f840 con 0x7fc97c0b2e60 2024-09-21T00:14:13.910 INFO:tasks.ceph.mds.a.smithi083.stderr:2024-09-21T00:14:13.909+0000 7f1d82800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T00:14:13.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.968+0000 7fc972a00640 1 -- 172.21.15.83:0/3261677354 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7fc96c063d40 con 0x7fc97c0b2e60 2024-09-21T00:14:13.969 INFO:teuthology.orchestra.run.smithi083.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T00:14:13.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.973+0000 7fc97b200640 1 -- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc958078bc0 msgr2=0x7fc95807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:13.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.973+0000 7fc97b200640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc958078bc0 0x7fc95807b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc97c06e2e0 tx=0x7fc964009040 comp rx=0 tx=0).stop 2024-09-21T00:14:13.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.973+0000 7fc97b200640 1 -- 172.21.15.83:0/3261677354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc97c0b2e60 msgr2=0x7fc97c13ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:13.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.973+0000 7fc97b200640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc97c0b2e60 0x7fc97c13ba20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00e790 tx=0x7fc96c00ec50 comp rx=0 tx=0).stop 2024-09-21T00:14:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.974+0000 7fc97b200640 1 -- 172.21.15.83:0/3261677354 shutdown_connections 2024-09-21T00:14:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.974+0000 7fc97b200640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc958078bc0 0x7fc95807b0d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.974+0000 7fc97b200640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97c145cc0 0x7fc97c0b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.974+0000 7fc97b200640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c0cf200 0x7fc97c0b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.974+0000 7fc97b200640 1 --2- 172.21.15.83:0/3261677354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc97c0b2e60 0x7fc97c13ba20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.974+0000 7fc97b200640 1 -- 172.21.15.83:0/3261677354 >> 172.21.15.83:0/3261677354 conn(0x7fc97c0d0460 msgr2=0x7fc97c0cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.976+0000 7fc97b200640 1 -- 172.21.15.83:0/3261677354 shutdown_connections 2024-09-21T00:14:13.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:13.978+0000 7fc97b200640 1 -- 172.21.15.83:0/3261677354 wait complete. 2024-09-21T00:14:14.023 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T00:14:14.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.244+0000 7f559a800640 1 -- 172.21.15.83:0/424069318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f559406e500 msgr2=0x7f55940ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:14.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.244+0000 7f559a800640 1 --2- 172.21.15.83:0/424069318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f559406e500 0x7f55940ce510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f558c005fd0 tx=0x7f558c02aaa0 comp rx=0 tx=0).stop 2024-09-21T00:14:14.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.244+0000 7f559a800640 1 -- 172.21.15.83:0/424069318 shutdown_connections 2024-09-21T00:14:14.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.244+0000 7f559a800640 1 --2- 172.21.15.83:0/424069318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f559406e500 0x7f55940ce510 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:14.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.244+0000 7f559a800640 1 --2- 172.21.15.83:0/424069318 >> v2:172.21.15.142:3300/0 conn(0x7f55940cc530 0x7f559415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:14.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.244+0000 7f559a800640 1 -- 172.21.15.83:0/424069318 >> 172.21.15.83:0/424069318 conn(0x7f55940b1b90 msgr2=0x7f55940b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:14.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.244+0000 7f559a800640 1 -- 172.21.15.83:0/424069318 shutdown_connections 2024-09-21T00:14:14.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.244+0000 7f559a800640 1 -- 172.21.15.83:0/424069318 wait complete. 2024-09-21T00:14:14.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.246+0000 7f559a800640 1 Processor -- start 2024-09-21T00:14:14.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.246+0000 7f559a800640 1 -- start start 2024-09-21T00:14:14.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.247+0000 7f559a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55940af5b0 0x7f559415d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:14.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.247+0000 7f559a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55940cc530 0x7f559409aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:14.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.247+0000 7f559a800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55941f5ee0 0x7f559406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.247+0000 7f559a800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f55940cede0 con 0x7f55941f5ee0 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.247+0000 7f559a800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f55940cec60 con 0x7f55940af5b0 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.247+0000 7f559a800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f55940cef60 con 0x7f55940cc530 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.248+0000 7f5593e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55941f5ee0 0x7f559406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.248+0000 7f5593e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55941f5ee0 0x7f559406eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59772/0 (socket says 172.21.15.83:59772) 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.248+0000 7f5593e00640 1 -- 172.21.15.83:0/3946106047 learned_addr learned my addr 172.21.15.83:0/3946106047 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.248+0000 7f5592a00640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55940cc530 0x7f559409aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.248+0000 7f5593400640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55940af5b0 0x7f559415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.248+0000 7f5593e00640 1 -- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55940cc530 msgr2=0x7f559409aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.248+0000 7f5593e00640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55940cc530 0x7f559409aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:14.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.248+0000 7f5593e00640 1 -- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55940af5b0 msgr2=0x7f559415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:14.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.248+0000 7f5593e00640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55940af5b0 0x7f559415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:14.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.248+0000 7f5593e00640 1 -- 172.21.15.83:0/3946106047 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559415d860 con 0x7f55941f5ee0 2024-09-21T00:14:14.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.249+0000 7f5593e00640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55941f5ee0 0x7f559406eea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f558c006010 tx=0x7f558c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:14.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.249+0000 7f558b400640 1 -- 172.21.15.83:0/3946106047 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c044070 con 0x7f55941f5ee0 2024-09-21T00:14:14.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.249+0000 7f558b400640 1 -- 172.21.15.83:0/3946106047 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f558c004040 con 0x7f55941f5ee0 2024-09-21T00:14:14.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.249+0000 7f558b400640 1 -- 172.21.15.83:0/3946106047 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c004430 con 0x7f55941f5ee0 2024-09-21T00:14:14.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.249+0000 7f559a800640 1 -- 172.21.15.83:0/3946106047 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559409b8f0 con 0x7f55941f5ee0 2024-09-21T00:14:14.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.249+0000 7f559a800640 1 -- 172.21.15.83:0/3946106047 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55941f56e0 con 0x7f55941f5ee0 2024-09-21T00:14:14.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.250+0000 7f559a800640 1 -- 172.21.15.83:0/3946106047 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55941f51f0 con 0x7f55941f5ee0 2024-09-21T00:14:14.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.251+0000 7f558b400640 1 -- 172.21.15.83:0/3946106047 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f558c047070 con 0x7f55941f5ee0 2024-09-21T00:14:14.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.252+0000 7f558b400640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5574078b90 0x7f557407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:14.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.253+0000 7f558b400640 1 -- 172.21.15.83:0/3946106047 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f558c0bbf60 con 0x7f55941f5ee0 2024-09-21T00:14:14.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.253+0000 7f5593400640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5574078b90 0x7f557407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:14.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.253+0000 7f5593400640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5574078b90 0x7f557407b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5584009b30 tx=0x7f5584005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:14.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.257+0000 7f558b400640 1 -- 172.21.15.83:0/3946106047 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f558c032030 con 0x7f55941f5ee0 2024-09-21T00:14:14.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.482+0000 7f559a800640 1 -- 172.21.15.83:0/3946106047 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f55940cb2e0 con 0x7f55941f5ee0 2024-09-21T00:14:14.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.979+0000 7f558b400640 1 -- 172.21.15.83:0/3946106047 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f558c083990 con 0x7f55941f5ee0 2024-09-21T00:14:14.980 INFO:teuthology.orchestra.run.smithi083.stderr:added data pool 4 to fsmap 2024-09-21T00:14:14.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.981+0000 7f559a800640 1 -- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5574078b90 msgr2=0x7f557407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:14.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.981+0000 7f559a800640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5574078b90 0x7f557407b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5584009b30 tx=0x7f5584005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:14.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.981+0000 7f559a800640 1 -- 172.21.15.83:0/3946106047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55941f5ee0 msgr2=0x7f559406eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:14.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.981+0000 7f559a800640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55941f5ee0 0x7f559406eea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f558c006010 tx=0x7f558c003ce0 comp rx=0 tx=0).stop 2024-09-21T00:14:14.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.981+0000 7f559a800640 1 -- 172.21.15.83:0/3946106047 shutdown_connections 2024-09-21T00:14:14.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.981+0000 7f559a800640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5574078b90 0x7f557407b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:14.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.981+0000 7f559a800640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55941f5ee0 0x7f559406eea0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:14.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.981+0000 7f559a800640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55940cc530 0x7f559409aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:14.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.981+0000 7f559a800640 1 --2- 172.21.15.83:0/3946106047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55940af5b0 0x7f559415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:14.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.981+0000 7f559a800640 1 -- 172.21.15.83:0/3946106047 >> 172.21.15.83:0/3946106047 conn(0x7f55940b1b90 msgr2=0x7f5594161d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:14.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.982+0000 7f559a800640 1 -- 172.21.15.83:0/3946106047 shutdown_connections 2024-09-21T00:14:14.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:14.982+0000 7f559a800640 1 -- 172.21.15.83:0/3946106047 wait complete. 2024-09-21T00:14:15.007 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:14:15.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.226+0000 7ff4ea200640 1 -- 172.21.15.83:0/730118448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e415b9f0 msgr2=0x7ff4e40cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:15.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.226+0000 7ff4ea200640 1 --2- 172.21.15.83:0/730118448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e415b9f0 0x7ff4e40cf930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009830 tx=0x7ff4d402a510 comp rx=0 tx=0).stop 2024-09-21T00:14:15.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.226+0000 7ff4ea200640 1 -- 172.21.15.83:0/730118448 shutdown_connections 2024-09-21T00:14:15.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.226+0000 7ff4ea200640 1 --2- 172.21.15.83:0/730118448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e415f5a0 0x7ff4e415f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.226+0000 7ff4ea200640 1 --2- 172.21.15.83:0/730118448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e415b9f0 0x7ff4e40cf930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.226+0000 7ff4ea200640 1 -- 172.21.15.83:0/730118448 >> 172.21.15.83:0/730118448 conn(0x7ff4e40cca40 msgr2=0x7ff4e40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:15.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.227+0000 7ff4ea200640 1 -- 172.21.15.83:0/730118448 shutdown_connections 2024-09-21T00:14:15.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.227+0000 7ff4ea200640 1 -- 172.21.15.83:0/730118448 wait complete. 2024-09-21T00:14:15.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.229+0000 7ff4ea200640 1 Processor -- start 2024-09-21T00:14:15.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.229+0000 7ff4ea200640 1 -- start start 2024-09-21T00:14:15.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.230+0000 7ff4ea200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e40cefa0 0x7ff4e4156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:15.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.230+0000 7ff4ea200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e415b9f0 0x7ff4e41f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:15.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.230+0000 7ff4ea200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4e415f5a0 0x7ff4e4158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:15.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.230+0000 7ff4ea200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e406df70 con 0x7ff4e415f5a0 2024-09-21T00:14:15.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.230+0000 7ff4ea200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e406ddf0 con 0x7ff4e40cefa0 2024-09-21T00:14:15.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.230+0000 7ff4ea200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e406e0f0 con 0x7ff4e415b9f0 2024-09-21T00:14:15.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4e415f5a0 0x7ff4e4158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:15.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4e415f5a0 0x7ff4e4158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59776/0 (socket says 172.21.15.83:59776) 2024-09-21T00:14:15.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e3e00640 1 -- 172.21.15.83:0/732570491 learned_addr learned my addr 172.21.15.83:0/732570491 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:15.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e3400640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e40cefa0 0x7ff4e4156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:15.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e2a00640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e415b9f0 0x7ff4e41f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:15.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e3e00640 1 -- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e415b9f0 msgr2=0x7ff4e41f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:15.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e3e00640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e415b9f0 0x7ff4e41f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e3e00640 1 -- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e40cefa0 msgr2=0x7ff4e4156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:15.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e3e00640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e40cefa0 0x7ff4e4156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e3e00640 1 -- 172.21.15.83:0/732570491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e4157aa0 con 0x7ff4e415f5a0 2024-09-21T00:14:15.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.231+0000 7ff4e3e00640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4e415f5a0 0x7ff4e4158b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00ea70 tx=0x7ff4dc00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:15.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.232+0000 7ff4db400640 1 -- 172.21.15.83:0/732570491 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00ce40 con 0x7ff4e415f5a0 2024-09-21T00:14:15.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.232+0000 7ff4db400640 1 -- 172.21.15.83:0/732570491 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4dc004c10 con 0x7ff4e415f5a0 2024-09-21T00:14:15.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.232+0000 7ff4ea200640 1 -- 172.21.15.83:0/732570491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e4157d80 con 0x7ff4e415f5a0 2024-09-21T00:14:15.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.232+0000 7ff4db400640 1 -- 172.21.15.83:0/732570491 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc005020 con 0x7ff4e415f5a0 2024-09-21T00:14:15.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.232+0000 7ff4ea200640 1 -- 172.21.15.83:0/732570491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e4158340 con 0x7ff4e415f5a0 2024-09-21T00:14:15.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.233+0000 7ff4ea200640 1 -- 172.21.15.83:0/732570491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e406e610 con 0x7ff4e415f5a0 2024-09-21T00:14:15.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.234+0000 7ff4db400640 1 -- 172.21.15.83:0/732570491 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4dc0051c0 con 0x7ff4e415f5a0 2024-09-21T00:14:15.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.235+0000 7ff4db400640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff4c4078bc0 0x7ff4c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:15.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.235+0000 7ff4db400640 1 -- 172.21.15.83:0/732570491 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff4dc09bd10 con 0x7ff4e415f5a0 2024-09-21T00:14:15.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.235+0000 7ff4e3400640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff4c4078bc0 0x7ff4c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:15.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.236+0000 7ff4e3400640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff4c4078bc0 0x7ff4c407b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4034000 tx=0x7ff4d4004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:15.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.240+0000 7ff4db400640 1 -- 172.21.15.83:0/732570491 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff4dc0637c0 con 0x7ff4e415f5a0 2024-09-21T00:14:15.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.460+0000 7ff4ea200640 1 -- 172.21.15.83:0/732570491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4e406f970 con 0x7ff4e415f5a0 2024-09-21T00:14:15.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.460+0000 7ff4db400640 1 -- 172.21.15.83:0/732570491 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5222 (secure 0 0 0) 0x7ff4dc0681f0 con 0x7ff4e415f5a0 2024-09-21T00:14:15.462 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:15.462 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":7,"btime":"2024-09-21T00:14:14:969261+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:14:09.437323+0000","modified":"2024-09-21T00:14:14.484378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-21T00:14:15.463 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 7 2024-09-21T00:14:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.462+0000 7ff4ea200640 1 -- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff4c4078bc0 msgr2=0x7ff4c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.462+0000 7ff4ea200640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff4c4078bc0 0x7ff4c407b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4034000 tx=0x7ff4d4004730 comp rx=0 tx=0).stop 2024-09-21T00:14:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.462+0000 7ff4ea200640 1 -- 172.21.15.83:0/732570491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4e415f5a0 msgr2=0x7ff4e4158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.462+0000 7ff4ea200640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4e415f5a0 0x7ff4e4158b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00ea70 tx=0x7ff4dc00ef30 comp rx=0 tx=0).stop 2024-09-21T00:14:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.463+0000 7ff4ea200640 1 -- 172.21.15.83:0/732570491 shutdown_connections 2024-09-21T00:14:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.463+0000 7ff4ea200640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff4c4078bc0 0x7ff4c407b0d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.463+0000 7ff4ea200640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4e415f5a0 0x7ff4e4158b40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.463+0000 7ff4ea200640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e415b9f0 0x7ff4e41f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.463+0000 7ff4ea200640 1 --2- 172.21.15.83:0/732570491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e40cefa0 0x7ff4e4156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.463+0000 7ff4ea200640 1 -- 172.21.15.83:0/732570491 >> 172.21.15.83:0/732570491 conn(0x7ff4e40cca40 msgr2=0x7ff4e40afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:15.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.463+0000 7ff4ea200640 1 -- 172.21.15.83:0/732570491 shutdown_connections 2024-09-21T00:14:15.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.463+0000 7ff4ea200640 1 -- 172.21.15.83:0/732570491 wait complete. 2024-09-21T00:14:15.486 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:15.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.708+0000 7f6f42e00640 1 -- 172.21.15.83:0/2931074944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f3c070f10 msgr2=0x7f6f3c071630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:15.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.708+0000 7f6f42e00640 1 --2- 172.21.15.83:0/2931074944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f3c070f10 0x7f6f3c071630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0737b0 tx=0x7f6f2c02a4d0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.708+0000 7f6f42e00640 1 -- 172.21.15.83:0/2931074944 shutdown_connections 2024-09-21T00:14:15.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.708+0000 7f6f42e00640 1 --2- 172.21.15.83:0/2931074944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f3c0cbcd0 0x7f6f3c06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.708+0000 7f6f42e00640 1 --2- 172.21.15.83:0/2931074944 >> v2:172.21.15.142:3300/0 conn(0x7f6f3c074a70 0x7f6f3c0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.708+0000 7f6f42e00640 1 --2- 172.21.15.83:0/2931074944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f3c070f10 0x7f6f3c071630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.708+0000 7f6f42e00640 1 -- 172.21.15.83:0/2931074944 >> 172.21.15.83:0/2931074944 conn(0x7f6f3c0d1140 msgr2=0x7f6f3c0d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:15.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.708+0000 7f6f42e00640 1 -- 172.21.15.83:0/2931074944 shutdown_connections 2024-09-21T00:14:15.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.708+0000 7f6f42e00640 1 -- 172.21.15.83:0/2931074944 wait complete. 2024-09-21T00:14:15.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.710+0000 7f6f42e00640 1 Processor -- start 2024-09-21T00:14:15.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.711+0000 7f6f42e00640 1 -- start start 2024-09-21T00:14:15.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.712+0000 7f6f42e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f3c070f10 0x7f6f3c1f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:15.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.712+0000 7f6f42e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f3c074a70 0x7f6f3c157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.712+0000 7f6f42e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f3c0cbcd0 0x7f6f3c0c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.712+0000 7f6f42e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c06d6b0 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.712+0000 7f6f42e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c06d530 con 0x7f6f3c074a70 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.712+0000 7f6f42e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3c06d830 con 0x7f6f3c070f10 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.712+0000 7f6f40e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f3c0cbcd0 0x7f6f3c0c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.712+0000 7f6f40e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f3c0cbcd0 0x7f6f3c0c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59798/0 (socket says 172.21.15.83:59798) 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.712+0000 7f6f40e00640 1 -- 172.21.15.83:0/2468901221 learned_addr learned my addr 172.21.15.83:0/2468901221 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f3be00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f3c070f10 0x7f6f3c1f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f33400640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f3c074a70 0x7f6f3c157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f40e00640 1 -- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f3c070f10 msgr2=0x7f6f3c1f5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f40e00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f3c070f10 0x7f6f3c1f5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f40e00640 1 -- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f3c074a70 msgr2=0x7f6f3c157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:15.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f40e00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f3c074a70 0x7f6f3c157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f40e00640 1 -- 172.21.15.83:0/2468901221 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c0b42f0 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f40e00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f3c0cbcd0 0x7f6f3c0c5ee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400ea80 tx=0x7f6f3400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:15.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f38c00640 1 -- 172.21.15.83:0/2468901221 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3400ce40 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f38c00640 1 -- 172.21.15.83:0/2468901221 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f34004b20 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f38c00640 1 -- 172.21.15.83:0/2468901221 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34005020 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f42e00640 1 -- 172.21.15.83:0/2468901221 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f3c0b45d0 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.713+0000 7f6f42e00640 1 -- 172.21.15.83:0/2468901221 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f3c0b4b90 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.714+0000 7f6f42e00640 1 -- 172.21.15.83:0/2468901221 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f3c0cb790 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.716+0000 7f6f38c00640 1 -- 172.21.15.83:0/2468901221 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f340051c0 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.717+0000 7f6f38c00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f18078b90 0x7f6f1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:15.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.717+0000 7f6f38c00640 1 -- 172.21.15.83:0/2468901221 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6f3409bd00 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.717+0000 7f6f3be00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f18078b90 0x7f6f1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:15.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.718+0000 7f6f3be00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f18078b90 0x7f6f1807b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c033000 tx=0x7f6f2c004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:15.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.721+0000 7f6f38c00640 1 -- 172.21.15.83:0/2468901221 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6f34063df0 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.909+0000 7f6f42e00640 1 -- 172.21.15.83:0/2468901221 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f3c1eb510 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.910+0000 7f6f38c00640 1 -- 172.21.15.83:0/2468901221 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f6f340636f0 con 0x7f6f3c0cbcd0 2024-09-21T00:14:15.911 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:15.912 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":27,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:14.484147+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:15.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.912+0000 7f6f42e00640 1 -- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f18078b90 msgr2=0x7f6f1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:15.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.912+0000 7f6f42e00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f18078b90 0x7f6f1807b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c033000 tx=0x7f6f2c004730 comp rx=0 tx=0).stop 2024-09-21T00:14:15.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.912+0000 7f6f42e00640 1 -- 172.21.15.83:0/2468901221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f3c0cbcd0 msgr2=0x7f6f3c0c5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:15.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.912+0000 7f6f42e00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f3c0cbcd0 0x7f6f3c0c5ee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400ea80 tx=0x7f6f3400ef40 comp rx=0 tx=0).stop 2024-09-21T00:14:15.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.912+0000 7f6f42e00640 1 -- 172.21.15.83:0/2468901221 shutdown_connections 2024-09-21T00:14:15.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.912+0000 7f6f42e00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6f18078b90 0x7f6f1807b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.912+0000 7f6f42e00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f3c0cbcd0 0x7f6f3c0c5ee0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.912+0000 7f6f42e00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f3c074a70 0x7f6f3c157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.912+0000 7f6f42e00640 1 --2- 172.21.15.83:0/2468901221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f3c070f10 0x7f6f3c1f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:15.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.912+0000 7f6f42e00640 1 -- 172.21.15.83:0/2468901221 >> 172.21.15.83:0/2468901221 conn(0x7f6f3c0d1140 msgr2=0x7f6f3c158080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:15.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.913+0000 7f6f42e00640 1 -- 172.21.15.83:0/2468901221 shutdown_connections 2024-09-21T00:14:15.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:15.913+0000 7f6f42e00640 1 -- 172.21.15.83:0/2468901221 wait complete. 2024-09-21T00:14:15.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:16.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.155+0000 7fe4d3400640 1 -- 172.21.15.83:0/634421013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc0cbc10 msgr2=0x7fe4cc0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:16.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.155+0000 7fe4d3400640 1 --2- 172.21.15.83:0/634421013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc0cbc10 0x7fe4cc0cc020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc076360 tx=0x7fe4b802a540 comp rx=0 tx=0).stop 2024-09-21T00:14:16.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.155+0000 7fe4d3400640 1 -- 172.21.15.83:0/634421013 shutdown_connections 2024-09-21T00:14:16.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.155+0000 7fe4d3400640 1 --2- 172.21.15.83:0/634421013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc0cbc10 0x7fe4cc0cc020 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.155+0000 7fe4d3400640 1 --2- 172.21.15.83:0/634421013 >> v2:172.21.15.142:3300/0 conn(0x7fe4cc074cb0 0x7fe4cc073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.155+0000 7fe4d3400640 1 -- 172.21.15.83:0/634421013 >> 172.21.15.83:0/634421013 conn(0x7fe4cc0cca40 msgr2=0x7fe4cc0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:16.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.155+0000 7fe4d3400640 1 -- 172.21.15.83:0/634421013 shutdown_connections 2024-09-21T00:14:16.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.155+0000 7fe4d3400640 1 -- 172.21.15.83:0/634421013 wait complete. 2024-09-21T00:14:16.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.157+0000 7fe4d3400640 1 Processor -- start 2024-09-21T00:14:16.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.158+0000 7fe4d3400640 1 -- start start 2024-09-21T00:14:16.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.159+0000 7fe4d3400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4cc06ddf0 0x7fe4cc156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:16.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.159+0000 7fe4d3400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc074cb0 0x7fe4cc151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:16.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.159+0000 7fe4d3400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4cc0cbc10 0x7fe4cc0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:16.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.159+0000 7fe4d3400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc06f360 con 0x7fe4cc074cb0 2024-09-21T00:14:16.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.159+0000 7fe4d3400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc06f1e0 con 0x7fe4cc0cbc10 2024-09-21T00:14:16.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.159+0000 7fe4d3400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc06f4e0 con 0x7fe4cc06ddf0 2024-09-21T00:14:16.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.159+0000 7fe4cbe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc074cb0 0x7fe4cc151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:16.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.159+0000 7fe4cbe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc074cb0 0x7fe4cc151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59810/0 (socket says 172.21.15.83:59810) 2024-09-21T00:14:16.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.159+0000 7fe4cbe00640 1 -- 172.21.15.83:0/241152053 learned_addr learned my addr 172.21.15.83:0/241152053 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:16.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4d1400640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4cc0cbc10 0x7fe4cc0cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:16.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4d0a00640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4cc06ddf0 0x7fe4cc156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:16.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4cbe00640 1 -- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4cc06ddf0 msgr2=0x7fe4cc156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:16.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4cbe00640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4cc06ddf0 0x7fe4cc156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4cbe00640 1 -- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4cc0cbc10 msgr2=0x7fe4cc0cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:16.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4cbe00640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4cc0cbc10 0x7fe4cc0cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4cbe00640 1 -- 172.21.15.83:0/241152053 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc156ec0 con 0x7fe4cc074cb0 2024-09-21T00:14:16.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4cbe00640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc074cb0 0x7fe4cc151830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009780 tx=0x7fe4b8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:16.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4c8c00640 1 -- 172.21.15.83:0/241152053 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8031d60 con 0x7fe4cc074cb0 2024-09-21T00:14:16.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4c8c00640 1 -- 172.21.15.83:0/241152053 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4b8033e10 con 0x7fe4cc074cb0 2024-09-21T00:14:16.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4c8c00640 1 -- 172.21.15.83:0/241152053 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8005260 con 0x7fe4cc074cb0 2024-09-21T00:14:16.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4d3400640 1 -- 172.21.15.83:0/241152053 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc1f4cc0 con 0x7fe4cc074cb0 2024-09-21T00:14:16.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.160+0000 7fe4d3400640 1 -- 172.21.15.83:0/241152053 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc155ea0 con 0x7fe4cc074cb0 2024-09-21T00:14:16.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.161+0000 7fe4d3400640 1 -- 172.21.15.83:0/241152053 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4cc06acf0 con 0x7fe4cc074cb0 2024-09-21T00:14:16.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.163+0000 7fe4c8c00640 1 -- 172.21.15.83:0/241152053 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4b8005400 con 0x7fe4cc074cb0 2024-09-21T00:14:16.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.164+0000 7fe4c8c00640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe4ac078b90 0x7fe4ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:16.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.164+0000 7fe4c8c00640 1 -- 172.21.15.83:0/241152053 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe4b80bc290 con 0x7fe4cc074cb0 2024-09-21T00:14:16.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.164+0000 7fe4d0a00640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe4ac078b90 0x7fe4ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:16.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.165+0000 7fe4d0a00640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe4ac078b90 0x7fe4ac07b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc15a730 tx=0x7fe4c0005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:16.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.168+0000 7fe4c8c00640 1 -- 172.21.15.83:0/241152053 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe4cc06acf0 con 0x7fe4cc074cb0 2024-09-21T00:14:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.354+0000 7fe4d3400640 1 -- 172.21.15.83:0/241152053 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4cc06f990 con 0x7fe4cc074cb0 2024-09-21T00:14:16.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.355+0000 7fe4c8c00640 1 -- 172.21.15.83:0/241152053 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fe4b803f030 con 0x7fe4cc074cb0 2024-09-21T00:14:16.357 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:16.357 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":27,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:14.484147+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:16.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 -- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe4ac078b90 msgr2=0x7fe4ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:16.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe4ac078b90 0x7fe4ac07b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc15a730 tx=0x7fe4c0005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:16.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 -- 172.21.15.83:0/241152053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc074cb0 msgr2=0x7fe4cc151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:16.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc074cb0 0x7fe4cc151830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009780 tx=0x7fe4b8033c20 comp rx=0 tx=0).stop 2024-09-21T00:14:16.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 -- 172.21.15.83:0/241152053 shutdown_connections 2024-09-21T00:14:16.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe4ac078b90 0x7fe4ac07b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4cc0cbc10 0x7fe4cc0cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc074cb0 0x7fe4cc151830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 --2- 172.21.15.83:0/241152053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4cc06ddf0 0x7fe4cc156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 -- 172.21.15.83:0/241152053 >> 172.21.15.83:0/241152053 conn(0x7fe4cc0cca40 msgr2=0x7fe4cc06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:16.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 -- 172.21.15.83:0/241152053 shutdown_connections 2024-09-21T00:14:16.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.358+0000 7fe4d3400640 1 -- 172.21.15.83:0/241152053 wait complete. 2024-09-21T00:14:16.416 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:14:16.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.635+0000 7f87b1400640 1 -- 172.21.15.83:0/3710511665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8790003a50 msgr2=0x7f8790003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:16.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.635+0000 7f87b1400640 1 --2- 172.21.15.83:0/3710511665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8790003a50 0x7f8790003ec0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f879c009d00 tx=0x7f8790005830 comp rx=0 tx=0).stop 2024-09-21T00:14:16.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.635+0000 7f87b1400640 1 -- 172.21.15.83:0/3710511665 shutdown_connections 2024-09-21T00:14:16.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.635+0000 7f87b1400640 1 --2- 172.21.15.83:0/3710511665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8790003a50 0x7f8790003ec0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.635+0000 7f87b1400640 1 -- 172.21.15.83:0/3710511665 >> 172.21.15.83:0/3710511665 conn(0x7f87ac0d1930 msgr2=0x7f87ac0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:16.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.635+0000 7f87b1400640 1 -- 172.21.15.83:0/3710511665 shutdown_connections 2024-09-21T00:14:16.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.635+0000 7f87b1400640 1 -- 172.21.15.83:0/3710511665 wait complete. 2024-09-21T00:14:16.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.637+0000 7f87b1400640 1 Processor -- start 2024-09-21T00:14:16.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.637+0000 7f87b1400640 1 -- start start 2024-09-21T00:14:16.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.638+0000 7f87b1400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8790003a50 0x7f87ac1f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:16.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b1400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87ac0c9de0 0x7f87ac0ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b1400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87ac0ca730 0x7f87ac1f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b1400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac06d2b0 con 0x7f87ac0ca730 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b1400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac162510 con 0x7f8790003a50 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b1400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f87ac06d430 con 0x7f87ac0c9de0 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b0a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87ac0ca730 0x7f87ac1f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b0a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87ac0ca730 0x7f87ac1f9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59828/0 (socket says 172.21.15.83:59828) 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b0a00640 1 -- 172.21.15.83:0/3976102360 learned_addr learned my addr 172.21.15.83:0/3976102360 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87abe00640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8790003a50 0x7f87ac1f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87a3400640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87ac0c9de0 0x7f87ac0ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b0a00640 1 -- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87ac0c9de0 msgr2=0x7f87ac0ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b0a00640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87ac0c9de0 0x7f87ac0ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b0a00640 1 -- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8790003a50 msgr2=0x7f87ac1f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:16.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b0a00640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8790003a50 0x7f87ac1f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.639+0000 7f87b0a00640 1 -- 172.21.15.83:0/3976102360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ac0cab40 con 0x7f87ac0ca730 2024-09-21T00:14:16.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.640+0000 7f87b0a00640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87ac0ca730 0x7f87ac1f9480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f87ac06ea50 tx=0x7f87a4006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:16.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.640+0000 7f87a8c00640 1 -- 172.21.15.83:0/3976102360 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4011840 con 0x7f87ac0ca730 2024-09-21T00:14:16.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.640+0000 7f87a8c00640 1 -- 172.21.15.83:0/3976102360 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87a4018070 con 0x7f87ac0ca730 2024-09-21T00:14:16.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.640+0000 7f87b1400640 1 -- 172.21.15.83:0/3976102360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ac0cbb70 con 0x7f87ac0ca730 2024-09-21T00:14:16.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.640+0000 7f87a8c00640 1 -- 172.21.15.83:0/3976102360 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4011c80 con 0x7f87ac0ca730 2024-09-21T00:14:16.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.640+0000 7f87b1400640 1 -- 172.21.15.83:0/3976102360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ac0cb390 con 0x7f87ac0ca730 2024-09-21T00:14:16.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.641+0000 7f87b1400640 1 -- 172.21.15.83:0/3976102360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87ac154ea0 con 0x7f87ac0ca730 2024-09-21T00:14:16.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.642+0000 7f87a8c00640 1 -- 172.21.15.83:0/3976102360 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f87a401d460 con 0x7f87ac0ca730 2024-09-21T00:14:16.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.643+0000 7f87a8c00640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8788078bf0 0x7f878807b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:16.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.643+0000 7f87a8c00640 1 -- 172.21.15.83:0/3976102360 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f87a409b780 con 0x7f87ac0ca730 2024-09-21T00:14:16.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.644+0000 7f87abe00640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8788078bf0 0x7f878807b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:16.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.644+0000 7f87abe00640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8788078bf0 0x7f878807b100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f879c035000 tx=0x7f879c0046c0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:16.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.648+0000 7f87a8c00640 1 -- 172.21.15.83:0/3976102360 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f87ac0cab40 con 0x7f87ac0ca730 2024-09-21T00:14:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.875+0000 7f87b1400640 1 -- 172.21.15.83:0/3976102360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87ac1605e0 con 0x7f87ac0ca730 2024-09-21T00:14:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.876+0000 7f87a8c00640 1 -- 172.21.15.83:0/3976102360 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5222 (secure 0 0 0) 0x7f87ac162c00 con 0x7f87ac0ca730 2024-09-21T00:14:16.877 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:16.877 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":7,"btime":"2024-09-21T00:14:14:969261+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:14:09.437323+0000","modified":"2024-09-21T00:14:14.484378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-21T00:14:16.878 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 7 2024-09-21T00:14:16.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.878+0000 7f87b1400640 1 -- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8788078bf0 msgr2=0x7f878807b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:16.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.878+0000 7f87b1400640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8788078bf0 0x7f878807b100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f879c035000 tx=0x7f879c0046c0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.878+0000 7f87b1400640 1 -- 172.21.15.83:0/3976102360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87ac0ca730 msgr2=0x7f87ac1f9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:16.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.879+0000 7f87b1400640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87ac0ca730 0x7f87ac1f9480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f87ac06ea50 tx=0x7f87a4006430 comp rx=0 tx=0).stop 2024-09-21T00:14:16.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.879+0000 7f87b1400640 1 -- 172.21.15.83:0/3976102360 shutdown_connections 2024-09-21T00:14:16.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.879+0000 7f87b1400640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8788078bf0 0x7f878807b100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.879+0000 7f87b1400640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87ac0ca730 0x7f87ac1f9480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.879+0000 7f87b1400640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87ac0c9de0 0x7f87ac0ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.879+0000 7f87b1400640 1 --2- 172.21.15.83:0/3976102360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8790003a50 0x7f87ac1f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:16.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.879+0000 7f87b1400640 1 -- 172.21.15.83:0/3976102360 >> 172.21.15.83:0/3976102360 conn(0x7f87ac0d1930 msgr2=0x7f87ac15fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:16.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.879+0000 7f87b1400640 1 -- 172.21.15.83:0/3976102360 shutdown_connections 2024-09-21T00:14:16.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:16.879+0000 7f87b1400640 1 -- 172.21.15.83:0/3976102360 wait complete. 2024-09-21T00:14:16.901 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:17.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.120+0000 7fae88400640 1 -- 172.21.15.83:0/3862815925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae8006e330 msgr2=0x7fae8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:17.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.120+0000 7fae88400640 1 --2- 172.21.15.83:0/3862815925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae8006e330 0x7fae8006ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae78005fd0 tx=0x7fae7802aa90 comp rx=0 tx=0).stop 2024-09-21T00:14:17.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.120+0000 7fae88400640 1 -- 172.21.15.83:0/3862815925 shutdown_connections 2024-09-21T00:14:17.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.120+0000 7fae88400640 1 --2- 172.21.15.83:0/3862815925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae8006e330 0x7fae8006ede0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.120+0000 7fae88400640 1 --2- 172.21.15.83:0/3862815925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80073dd0 0x7fae8006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.120+0000 7fae88400640 1 -- 172.21.15.83:0/3862815925 >> 172.21.15.83:0/3862815925 conn(0x7fae800cca40 msgr2=0x7fae800cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:17.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.120+0000 7fae88400640 1 -- 172.21.15.83:0/3862815925 shutdown_connections 2024-09-21T00:14:17.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.120+0000 7fae88400640 1 -- 172.21.15.83:0/3862815925 wait complete. 2024-09-21T00:14:17.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.123+0000 7fae88400640 1 Processor -- start 2024-09-21T00:14:17.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.123+0000 7fae88400640 1 -- start start 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.124+0000 7fae88400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae8006e330 0x7fae801f9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.124+0000 7fae88400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae80073dd0 0x7fae800b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.124+0000 7fae88400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80074cb0 0x7fae8009bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.124+0000 7fae88400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fae8006f4a0 con 0x7fae80073dd0 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.124+0000 7fae88400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fae8006f320 con 0x7fae80074cb0 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.124+0000 7fae88400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fae8006f620 con 0x7fae8006e330 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.124+0000 7fae85000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae80073dd0 0x7fae800b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.124+0000 7fae85000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae80073dd0 0x7fae800b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59832/0 (socket says 172.21.15.83:59832) 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.124+0000 7fae85000640 1 -- 172.21.15.83:0/549005221 learned_addr learned my addr 172.21.15.83:0/549005221 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae85a00640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae8006e330 0x7fae801f9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae86400640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80074cb0 0x7fae8009bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae85000640 1 -- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae8006e330 msgr2=0x7fae801f9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae85000640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae8006e330 0x7fae801f9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae85000640 1 -- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80074cb0 msgr2=0x7fae8009bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae85000640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80074cb0 0x7fae8009bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae85000640 1 -- 172.21.15.83:0/549005221 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae800c90d0 con 0x7fae80073dd0 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae86400640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80074cb0 0x7fae8009bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae85000640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae80073dd0 0x7fae800b0f50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00d740 tx=0x7fae6c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae7d600640 1 -- 172.21.15.83:0/549005221 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c017070 con 0x7fae80073dd0 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae7d600640 1 -- 172.21.15.83:0/549005221 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae6c009d20 con 0x7fae80073dd0 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae88400640 1 -- 172.21.15.83:0/549005221 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae801fa070 con 0x7fae80073dd0 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.125+0000 7fae7d600640 1 -- 172.21.15.83:0/549005221 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0106c0 con 0x7fae80073dd0 2024-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.126+0000 7fae88400640 1 -- 172.21.15.83:0/549005221 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae800c8df0 con 0x7fae80073dd0 2024-09-21T00:14:17.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.127+0000 7fae88400640 1 -- 172.21.15.83:0/549005221 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae800c8b60 con 0x7fae80073dd0 2024-09-21T00:14:17.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.128+0000 7fae7d600640 1 -- 172.21.15.83:0/549005221 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae6c01a070 con 0x7fae80073dd0 2024-09-21T00:14:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.129+0000 7fae7d600640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fae60078b90 0x7fae6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.129+0000 7fae7d600640 1 -- 172.21.15.83:0/549005221 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fae6c09b200 con 0x7fae80073dd0 2024-09-21T00:14:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.129+0000 7fae85a00640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fae60078b90 0x7fae6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.130+0000 7fae85a00640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fae60078b90 0x7fae6007b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae74007fd0 tx=0x7fae74009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:17.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.134+0000 7fae7d600640 1 -- 172.21.15.83:0/549005221 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fae800c90d0 con 0x7fae80073dd0 2024-09-21T00:14:17.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.322+0000 7fae88400640 1 -- 172.21.15.83:0/549005221 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae8006acf0 con 0x7fae80073dd0 2024-09-21T00:14:17.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.323+0000 7fae7d600640 1 -- 172.21.15.83:0/549005221 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fae6c063390 con 0x7fae80073dd0 2024-09-21T00:14:17.325 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:17.325 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":27,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:14.484147+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:17.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 -- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fae60078b90 msgr2=0x7fae6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:17.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fae60078b90 0x7fae6007b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae74007fd0 tx=0x7fae74009040 comp rx=0 tx=0).stop 2024-09-21T00:14:17.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 -- 172.21.15.83:0/549005221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae80073dd0 msgr2=0x7fae800b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:17.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae80073dd0 0x7fae800b0f50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00d740 tx=0x7fae6c00dc00 comp rx=0 tx=0).stop 2024-09-21T00:14:17.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 -- 172.21.15.83:0/549005221 shutdown_connections 2024-09-21T00:14:17.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fae60078b90 0x7fae6007b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80074cb0 0x7fae8009bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae80073dd0 0x7fae800b0f50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 --2- 172.21.15.83:0/549005221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae8006e330 0x7fae801f9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 -- 172.21.15.83:0/549005221 >> 172.21.15.83:0/549005221 conn(0x7fae800cca40 msgr2=0x7fae8015ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:17.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.325+0000 7fae88400640 1 -- 172.21.15.83:0/549005221 shutdown_connections 2024-09-21T00:14:17.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.326+0000 7fae88400640 1 -- 172.21.15.83:0/549005221 wait complete. 2024-09-21T00:14:17.753 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T00:14:09.437323+0000', 'modified': '2024-09-21T00:14:14.484378+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4371}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4371': {'gid': 4371, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6834/176272161', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6832', 'nonce': 176272161}, {'type': 'v1', 'addr': '172.21.15.83:6834', 'nonce': 176272161}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4371, 'qdb_cluster': [4371]} 2024-09-21T00:14:17.753 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T00:14:17.753 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T00:14:17.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.980+0000 7f1def200640 1 -- 172.21.15.83:0/1758084425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1de815f6d0 msgr2=0x7f1de815e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:17.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.980+0000 7f1def200640 1 --2- 172.21.15.83:0/1758084425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1de815f6d0 0x7f1de815e3d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1de806ed00 tx=0x7f1ddc02a560 comp rx=0 tx=0).stop 2024-09-21T00:14:17.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.980+0000 7f1def200640 1 -- 172.21.15.83:0/1758084425 shutdown_connections 2024-09-21T00:14:17.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.980+0000 7f1def200640 1 --2- 172.21.15.83:0/1758084425 >> v2:172.21.15.142:3300/0 conn(0x7f1de80d2290 0x7f1de80d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.980+0000 7f1def200640 1 --2- 172.21.15.83:0/1758084425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1de815f6d0 0x7f1de815e3d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.980+0000 7f1def200640 1 -- 172.21.15.83:0/1758084425 >> 172.21.15.83:0/1758084425 conn(0x7f1de80d41e0 msgr2=0x7f1de80d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:17.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.980+0000 7f1def200640 1 -- 172.21.15.83:0/1758084425 shutdown_connections 2024-09-21T00:14:17.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.980+0000 7f1def200640 1 -- 172.21.15.83:0/1758084425 wait complete. 2024-09-21T00:14:17.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.982+0000 7f1def200640 1 Processor -- start 2024-09-21T00:14:17.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.982+0000 7f1def200640 1 -- start start 2024-09-21T00:14:17.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.983+0000 7f1def200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de80cef00 0x7f1de81578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.983+0000 7f1def200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1de80d2290 0x7f1de80cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.983+0000 7f1def200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de815f6d0 0x7f1de80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.983+0000 7f1def200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1de80d2be0 con 0x7f1de80d2290 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.983+0000 7f1def200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1de806dce0 con 0x7f1de80cef00 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.983+0000 7f1def200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1de80d2d60 con 0x7f1de815f6d0 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1ded400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1de80d2290 0x7f1de80cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1dede00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de80cef00 0x7f1de81578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1ded400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1de80d2290 0x7f1de80cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59848/0 (socket says 172.21.15.83:59848) 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1ded400640 1 -- 172.21.15.83:0/282133753 learned_addr learned my addr 172.21.15.83:0/282133753 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1dee800640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de815f6d0 0x7f1de80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1ded400640 1 -- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de815f6d0 msgr2=0x7f1de80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1ded400640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de815f6d0 0x7f1de80c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1ded400640 1 -- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de80cef00 msgr2=0x7f1de81578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:17.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1ded400640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de80cef00 0x7f1de81578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1ded400640 1 -- 172.21.15.83:0/282133753 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de81f6150 con 0x7f1de80d2290 2024-09-21T00:14:17.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.984+0000 7f1ded400640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1de80d2290 0x7f1de80cd720 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800c3c0 tx=0x7f1dd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:17.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.985+0000 7f1de2000640 1 -- 172.21.15.83:0/282133753 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8017070 con 0x7f1de80d2290 2024-09-21T00:14:17.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.985+0000 7f1de2000640 1 -- 172.21.15.83:0/282133753 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dd80035f0 con 0x7f1de80d2290 2024-09-21T00:14:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.985+0000 7f1def200640 1 -- 172.21.15.83:0/282133753 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de80c7b30 con 0x7f1de80d2290 2024-09-21T00:14:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.985+0000 7f1de2000640 1 -- 172.21.15.83:0/282133753 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8003a20 con 0x7f1de80d2290 2024-09-21T00:14:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.985+0000 7f1def200640 1 -- 172.21.15.83:0/282133753 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de80c80f0 con 0x7f1de80d2290 2024-09-21T00:14:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.987+0000 7f1de2000640 1 -- 172.21.15.83:0/282133753 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1dd801a070 con 0x7f1de80d2290 2024-09-21T00:14:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.988+0000 7f1de2000640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1dcc078b90 0x7f1dcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.988+0000 7f1de2000640 1 -- 172.21.15.83:0/282133753 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1dd809a2d0 con 0x7f1de80d2290 2024-09-21T00:14:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.989+0000 7f1df782b740 1 Processor -- start 2024-09-21T00:14:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.989+0000 7f1dede00640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1dcc078b90 0x7f1dcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.989+0000 7f1df782b740 1 -- start start 2024-09-21T00:14:17.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.990+0000 7f1dede00640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1dcc078b90 0x7f1dcc07b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc033000 tx=0x7f1ddc004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:17.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1df782b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ef8270 0x55ec622c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1df782b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ecf3b0 0x55ec622c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1df782b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ed7590 0x55ec62299150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:17.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1df782b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ec62222430 con 0x55ec61ecf3b0 2024-09-21T00:14:17.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1df782b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ec622125d0 con 0x55ec61ed7590 2024-09-21T00:14:17.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1df782b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55ec62201a00 con 0x55ec61ef8270 2024-09-21T00:14:17.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1ded400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ecf3b0 0x55ec622c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1dede00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ef8270 0x55ec622c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1ded400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ecf3b0 0x55ec622c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59860/0 (socket says 172.21.15.83:59860) 2024-09-21T00:14:17.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1ded400640 1 -- 172.21.15.83:0/2850012234 learned_addr learned my addr 172.21.15.83:0/2850012234 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:17.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.991+0000 7f1dee800640 1 --2- 172.21.15.83:0/2850012234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ed7590 0x55ec62299150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:17.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.992+0000 7f1ded400640 1 -- 172.21.15.83:0/2850012234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ef8270 msgr2=0x55ec622c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:17.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.992+0000 7f1ded400640 1 --2- 172.21.15.83:0/2850012234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ef8270 0x55ec622c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.992+0000 7f1ded400640 1 -- 172.21.15.83:0/2850012234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ed7590 msgr2=0x55ec62299150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:17.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.992+0000 7f1ded400640 1 --2- 172.21.15.83:0/2850012234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ed7590 0x55ec62299150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.992+0000 7f1ded400640 1 -- 172.21.15.83:0/2850012234 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec621ca520 con 0x55ec61ecf3b0 2024-09-21T00:14:17.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.992+0000 7f1ded400640 1 --2- 172.21.15.83:0/2850012234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ecf3b0 0x55ec622c90a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8001250 tx=0x7f1dd8061450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4721c489d7567bce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:17.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.993+0000 7f1dd6600640 1 -- 172.21.15.83:0/2850012234 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8066710 con 0x55ec61ecf3b0 2024-09-21T00:14:17.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.993+0000 7f1dd6600640 1 -- 172.21.15.83:0/2850012234 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dd8066020 con 0x55ec61ecf3b0 2024-09-21T00:14:17.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.993+0000 7f1dd6600640 1 -- 172.21.15.83:0/2850012234 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd806b650 con 0x55ec61ecf3b0 2024-09-21T00:14:17.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.994+0000 7f1df782b740 1 -- 172.21.15.83:0/2850012234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ecf3b0 msgr2=0x55ec622c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:17.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.994+0000 7f1df782b740 1 --2- 172.21.15.83:0/2850012234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ecf3b0 0x55ec622c90a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8001250 tx=0x7f1dd8061450 comp rx=0 tx=0).stop 2024-09-21T00:14:17.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.994+0000 7f1df782b740 1 -- 172.21.15.83:0/2850012234 shutdown_connections 2024-09-21T00:14:17.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.994+0000 7f1df782b740 1 --2- 172.21.15.83:0/2850012234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ed7590 0x55ec62299150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.994+0000 7f1df782b740 1 --2- 172.21.15.83:0/2850012234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ecf3b0 0x55ec622c90a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.994+0000 7f1df782b740 1 --2- 172.21.15.83:0/2850012234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ef8270 0x55ec622c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:17.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.994+0000 7f1df782b740 1 -- 172.21.15.83:0/2850012234 >> 172.21.15.83:0/2850012234 conn(0x55ec61eec3c0 msgr2=0x55ec6229eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:17.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.994+0000 7f1df782b740 1 -- 172.21.15.83:0/2850012234 shutdown_connections 2024-09-21T00:14:17.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.994+0000 7f1df782b740 1 -- 172.21.15.83:0/2850012234 wait complete. 2024-09-21T00:14:17.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.995+0000 7f1df782b740 1 -- start start 2024-09-21T00:14:17.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.995+0000 7f1df782b740 1 Processor -- start 2024-09-21T00:14:18.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1df782b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec622dd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1df782b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1df782b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1df782b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ec621a8330 con 0x55ec61ed7590 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1df782b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ec62205810 con 0x55ec61ef8270 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1df782b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55ec61f72620 con 0x55ec61ecf3b0 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1df782b740 10 client.0 _ll_register_callbacks cb 0x55ec621ad420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1ded400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1dede00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec622dd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1ded400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59866/0 (socket says 172.21.15.83:59866) 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1ded400640 1 -- 172.21.15.83:0/2762767478 learned_addr learned my addr 172.21.15.83:0/2762767478 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.997+0000 7f1dee800640 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1ded400640 1 -- 172.21.15.83:0/2762767478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 msgr2=0x55ec622dd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:18.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1ded400640 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec622dd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1ded400640 1 -- 172.21.15.83:0/2762767478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 msgr2=0x55ec622c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1ded400640 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1ded400640 1 -- 172.21.15.83:0/2762767478 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec61f63850 con 0x55ec61ed7590 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1ded400640 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b4230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800cd80 tx=0x7f1dd8098430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40988a223ac89caf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1dcaa00640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1dcaa00640 1 -- 172.21.15.83:0/2762767478 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd809a0c0 con 0x55ec61ed7590 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1df782b740 1 -- 172.21.15.83:0/2762767478 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd8066020 con 0x55ec61ed7590 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1dcaa00640 1 -- 172.21.15.83:0/2762767478 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1dd80661d0 con 0x55ec61ed7590 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1dcaa00640 1 -- 172.21.15.83:0/2762767478 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f1dd806b650 con 0x55ec61ed7590 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1df782b740 10 client.4500 fetch_fsmap learned FSMap version 7 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.998+0000 7f1df782b740 1 -- 172.21.15.83:0/2762767478 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55ec61fda6b0 con 0x55ec61ed7590 2024-09-21T00:14:18.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1dcaa00640 1 -- 172.21.15.83:0/2762767478 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dd8066020 con 0x55ec61ed7590 2024-09-21T00:14:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1dcaa00640 1 -- 172.21.15.83:0/2762767478 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f1dd805d630 con 0x55ec61ed7590 2024-09-21T00:14:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1df782b740 10 client.4500 fetch_fsmap finished waiting for FSMap version 7 2024-09-21T00:14:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1df782b740 10 client.4500 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T00:14:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1df782b740 20 client.4500 populate_metadata read hostname 'smithi083' 2024-09-21T00:14:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1df782b740 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55ec61eb6e40 0x55ec622c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1df782b740 4 client.4500 mds_command: new command op to 4371 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:14:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1df782b740 1 -- 172.21.15.83:0/2762767478 --> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec62214520 con 0x55ec61eb6e40 2024-09-21T00:14:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1dede00640 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55ec61eb6e40 0x55ec622c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1dcaa00640 10 client.4500 ms_handle_connect on v2:172.21.15.83:6832/176272161 2024-09-21T00:14:18.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:17.999+0000 7f1dede00640 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55ec61eb6e40 0x55ec622c0fa0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d98ba4f5d7cb00bf server_cookie=f86e5920478535dc in_seq=0 out_seq=0 2024-09-21T00:14:18.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.000+0000 7f1dcaa00640 1 -- 172.21.15.83:0/2762767478 <== mds.0 v2:172.21.15.83:6832/176272161 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec62214520 con 0x55ec61eb6e40 2024-09-21T00:14:18.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.000+0000 7f1dcaa00640 10 client.4500 handle_command_reply: tid=0 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.000+0000 7f1df782b740 1 client.4500 shutdown 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 1 -- 172.21.15.83:0/2762767478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 msgr2=0x55ec622b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b4230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800cd80 tx=0x7f1dd8098430 comp rx=0 tx=0).stop 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 1 -- 172.21.15.83:0/2762767478 shutdown_connections 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55ec61eb6e40 0x55ec622c0fa0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b4230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1dcaa00640 0 client.4500 ms_handle_reset on v2:172.21.15.83:6832/176272161 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 1 --2- 172.21.15.83:0/2762767478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec622dd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 1 -- 172.21.15.83:0/2762767478 >> 172.21.15.83:0/2762767478 conn(0x55ec61eec3c0 msgr2=0x55ec622da1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 1 -- 172.21.15.83:0/2762767478 shutdown_connections 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 1 -- 172.21.15.83:0/2762767478 wait complete. 2024-09-21T00:14:18.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.001+0000 7f1df782b740 20 client.4500 trim_cache size 0 max 16384 2024-09-21T00:14:18.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.020+0000 7f1df782b740 1 Processor -- start 2024-09-21T00:14:18.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.020+0000 7f1df782b740 1 -- start start 2024-09-21T00:14:18.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.021+0000 7f1df782b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec622e4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.021+0000 7f1df782b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622e4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.021+0000 7f1df782b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622e5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.021+0000 7f1df782b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1de8202210 con 0x55ec61ed7590 2024-09-21T00:14:18.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.021+0000 7f1df782b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1de82015a0 con 0x55ec61ef8270 2024-09-21T00:14:18.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.021+0000 7f1df782b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1de8201bf0 con 0x55ec61ecf3b0 2024-09-21T00:14:18.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1ded400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622e4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1ded400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622e4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59870/0 (socket says 172.21.15.83:59870) 2024-09-21T00:14:18.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1ded400640 1 -- 172.21.15.83:0/64573852 learned_addr learned my addr 172.21.15.83:0/64573852 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1dede00640 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec622e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1dee800640 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622e5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1ded400640 1 -- 172.21.15.83:0/64573852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 msgr2=0x55ec622e4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1ded400640 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec622e4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1ded400640 1 -- 172.21.15.83:0/64573852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 msgr2=0x55ec622e5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1ded400640 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622e5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1ded400640 1 -- 172.21.15.83:0/64573852 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6229f840 con 0x55ec61ed7590 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1dee800640 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622e5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1dede00640 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec622e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.022+0000 7f1ded400640 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622e4e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1dd805ef50 tx=0x7f1dd800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca426673f1a2597d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:18.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1dd5c00640 1 -- 172.21.15.83:0/64573852 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8084120 con 0x55ec61ed7590 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1dd5c00640 1 -- 172.21.15.83:0/64573852 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dd8066070 con 0x55ec61ed7590 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1dd5c00640 1 -- 172.21.15.83:0/64573852 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8066220 con 0x55ec61ed7590 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1df782b740 1 -- 172.21.15.83:0/64573852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 msgr2=0x55ec622e4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1df782b740 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622e4e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1dd805ef50 tx=0x7f1dd800ceb0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1df782b740 1 -- 172.21.15.83:0/64573852 shutdown_connections 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1df782b740 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622e5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1df782b740 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622e4e50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1df782b740 1 --2- 172.21.15.83:0/64573852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec622e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1df782b740 1 -- 172.21.15.83:0/64573852 >> 172.21.15.83:0/64573852 conn(0x55ec61eec3c0 msgr2=0x55ec622c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1df782b740 1 -- 172.21.15.83:0/64573852 shutdown_connections 2024-09-21T00:14:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.023+0000 7f1df782b740 1 -- 172.21.15.83:0/64573852 wait complete. 2024-09-21T00:14:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.024+0000 7f1df782b740 1 -- start start 2024-09-21T00:14:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.025+0000 7f1df782b740 1 Processor -- start 2024-09-21T00:14:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1df782b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec623602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1df782b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1df782b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1df782b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ec621a8330 con 0x55ec61ed7590 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1df782b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ec61f72620 con 0x55ec61ef8270 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1df782b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55ec62205810 con 0x55ec61ecf3b0 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1df782b740 10 client.0 _ll_register_callbacks cb 0x7f1dd805dc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1ded400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1ded400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59882/0 (socket says 172.21.15.83:59882) 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1ded400640 1 -- 172.21.15.83:0/3312491067 learned_addr learned my addr 172.21.15.83:0/3312491067 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1dede00640 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec623602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.026+0000 7f1dee800640 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1ded400640 1 -- 172.21.15.83:0/3312491067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 msgr2=0x55ec623602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1ded400640 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec623602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1ded400640 1 -- 172.21.15.83:0/3312491067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 msgr2=0x55ec622b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1ded400640 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1ded400640 1 -- 172.21.15.83:0/3312491067 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec622fc980 con 0x55ec61ed7590 2024-09-21T00:14:18.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1ded400640 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b2890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80619e0 tx=0x7f1dd80983c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4273bfc0732361 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:18.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1dcaa00640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T00:14:18.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1dcaa00640 1 -- 172.21.15.83:0/3312491067 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8066220 con 0x55ec61ed7590 2024-09-21T00:14:18.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1dcaa00640 1 -- 172.21.15.83:0/3312491067 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1dd80663c0 con 0x55ec61ed7590 2024-09-21T00:14:18.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1df782b740 1 -- 172.21.15.83:0/3312491067 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd8066070 con 0x55ec61ed7590 2024-09-21T00:14:18.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1dcaa00640 1 -- 172.21.15.83:0/3312491067 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f1dd8073050 con 0x55ec61ed7590 2024-09-21T00:14:18.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.027+0000 7f1df782b740 10 client.4506 fetch_fsmap learned FSMap version 7 2024-09-21T00:14:18.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.028+0000 7f1df782b740 1 -- 172.21.15.83:0/3312491067 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55ec622fc980 con 0x55ec61ed7590 2024-09-21T00:14:18.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.028+0000 7f1dcaa00640 1 -- 172.21.15.83:0/3312491067 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dd8066070 con 0x55ec61ed7590 2024-09-21T00:14:18.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.028+0000 7f1dcaa00640 1 -- 172.21.15.83:0/3312491067 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f1dd8076020 con 0x55ec61ed7590 2024-09-21T00:14:18.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.028+0000 7f1df782b740 10 client.4506 fetch_fsmap finished waiting for FSMap version 7 2024-09-21T00:14:18.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.028+0000 7f1df782b740 10 client.4506 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T00:14:18.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.028+0000 7f1df782b740 20 client.4506 populate_metadata read hostname 'smithi083' 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.028+0000 7f1df782b740 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55ec62366450 0x55ec62366860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.028+0000 7f1df782b740 4 client.4506 mds_command: new command op to 4371 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.028+0000 7f1df782b740 1 -- 172.21.15.83:0/3312491067 --> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] -- command(tid 0: {"prefix": "status"}) -- 0x55ec6220ffd0 con 0x55ec62366450 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.028+0000 7f1dede00640 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55ec62366450 0x55ec62366860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1dcaa00640 10 client.4506 ms_handle_connect on v2:172.21.15.83:6832/176272161 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1dede00640 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55ec62366450 0x55ec62366860 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb909bacb77a5b30 server_cookie=ef5059494aee335c in_seq=0 out_seq=0 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1dcaa00640 1 -- 172.21.15.83:0/3312491067 <== mds.0 v2:172.21.15.83:6832/176272161 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55ec6220ffd0 con 0x55ec62366450 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1dcaa00640 10 client.4506 handle_command_reply: tid=0 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 client.4506 shutdown 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 -- 172.21.15.83:0/3312491067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 msgr2=0x55ec622b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b2890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80619e0 tx=0x7f1dd80983c0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 -- 172.21.15.83:0/3312491067 shutdown_connections 2024-09-21T00:14:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec61ef8270 0x55ec622b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55ec62366450 0x55ec62366860 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ec61ed7590 0x55ec622b2890 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 --2- 172.21.15.83:0/3312491067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ec61ecf3b0 0x55ec623602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1dcaa00640 0 client.4506 ms_handle_reset on v2:172.21.15.83:6832/176272161 2024-09-21T00:14:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 -- 172.21.15.83:0/3312491067 >> 172.21.15.83:0/3312491067 conn(0x55ec61eec3c0 msgr2=0x55ec622c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 -- 172.21.15.83:0/3312491067 shutdown_connections 2024-09-21T00:14:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.029+0000 7f1df782b740 1 -- 172.21.15.83:0/3312491067 wait complete. 2024-09-21T00:14:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1df782b740 20 client.4506 trim_cache size 0 max 16384 2024-09-21T00:14:18.034 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "d4df3382-b453-41c4-9497-6203e3b4e46e", 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4371, 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 8.0808498629999992, 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 7, 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 27, 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 27, 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 14.134744912 2024-09-21T00:14:18.035 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:14:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 -- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1dcc078b90 msgr2=0x7f1dcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1dcc078b90 0x7f1dcc07b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc033000 tx=0x7f1ddc004730 comp rx=0 tx=0).stop 2024-09-21T00:14:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 -- 172.21.15.83:0/282133753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1de80d2290 msgr2=0x7f1de80cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:18.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1de80d2290 0x7f1de80cd720 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800c3c0 tx=0x7f1dd800c880 comp rx=0 tx=0).stop 2024-09-21T00:14:18.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 -- 172.21.15.83:0/282133753 shutdown_connections 2024-09-21T00:14:18.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1dcc078b90 0x7f1dcc07b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de815f6d0 0x7f1de80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1de80d2290 0x7f1de80cd720 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 --2- 172.21.15.83:0/282133753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de80cef00 0x7f1de81578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 -- 172.21.15.83:0/282133753 >> 172.21.15.83:0/282133753 conn(0x7f1de80d41e0 msgr2=0x7f1de81614c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:18.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 -- 172.21.15.83:0/282133753 shutdown_connections 2024-09-21T00:14:18.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.030+0000 7f1def200640 1 -- 172.21.15.83:0/282133753 wait complete. 2024-09-21T00:14:18.055 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T00:14:18.055 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T00:14:18.055 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T00:14:18.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.274+0000 7f52eba00640 1 -- 172.21.15.83:0/3442624696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e406ddf0 msgr2=0x7f52e406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:18.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.274+0000 7f52eba00640 1 --2- 172.21.15.83:0/3442624696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e406ddf0 0x7f52e406e200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f52e4076360 tx=0x7f52dc02aa30 comp rx=0 tx=0).stop 2024-09-21T00:14:18.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.274+0000 7f52eba00640 1 -- 172.21.15.83:0/3442624696 shutdown_connections 2024-09-21T00:14:18.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.274+0000 7f52eba00640 1 --2- 172.21.15.83:0/3442624696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e406ddf0 0x7f52e406e200 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.274+0000 7f52eba00640 1 --2- 172.21.15.83:0/3442624696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e40cbc10 0x7f52e40cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.274+0000 7f52eba00640 1 --2- 172.21.15.83:0/3442624696 >> v2:172.21.15.142:3300/0 conn(0x7f52e4074cb0 0x7f52e4073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.274+0000 7f52eba00640 1 -- 172.21.15.83:0/3442624696 >> 172.21.15.83:0/3442624696 conn(0x7f52e40cca40 msgr2=0x7f52e40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:18.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.274+0000 7f52eba00640 1 -- 172.21.15.83:0/3442624696 shutdown_connections 2024-09-21T00:14:18.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.274+0000 7f52eba00640 1 -- 172.21.15.83:0/3442624696 wait complete. 2024-09-21T00:14:18.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.276+0000 7f52eba00640 1 Processor -- start 2024-09-21T00:14:18.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.277+0000 7f52eba00640 1 -- start start 2024-09-21T00:14:18.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.278+0000 7f52eba00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52e406ddf0 0x7f52e40b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.278+0000 7f52eba00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e4074cb0 0x7f52e41f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.278+0000 7f52eba00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e40cbc10 0x7f52e41f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.278+0000 7f52eba00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f52e406f170 con 0x7f52e4074cb0 2024-09-21T00:14:18.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.278+0000 7f52eba00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f52e406eff0 con 0x7f52e406ddf0 2024-09-21T00:14:18.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.278+0000 7f52eba00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f52e406f2f0 con 0x7f52e40cbc10 2024-09-21T00:14:18.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.278+0000 7f52dbe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e4074cb0 0x7f52e41f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.278+0000 7f52dbe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e4074cb0 0x7f52e41f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59912/0 (socket says 172.21.15.83:59912) 2024-09-21T00:14:18.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.278+0000 7f52dbe00640 1 -- 172.21.15.83:0/84146591 learned_addr learned my addr 172.21.15.83:0/84146591 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:18.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.278+0000 7f52e9000640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52e406ddf0 0x7f52e40b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52e9a00640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e40cbc10 0x7f52e41f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52dbe00640 1 -- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e40cbc10 msgr2=0x7f52e41f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:18.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52dbe00640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e40cbc10 0x7f52e41f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52dbe00640 1 -- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52e406ddf0 msgr2=0x7f52e40b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:18.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52dbe00640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52e406ddf0 0x7f52e40b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52dbe00640 1 -- 172.21.15.83:0/84146591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e4157d60 con 0x7f52e4074cb0 2024-09-21T00:14:18.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52dbe00640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e4074cb0 0x7f52e41f3590 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00d740 tx=0x7f52cc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:18.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52e1600640 1 -- 172.21.15.83:0/84146591 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc017070 con 0x7f52e4074cb0 2024-09-21T00:14:18.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52e1600640 1 -- 172.21.15.83:0/84146591 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52cc009ab0 con 0x7f52e4074cb0 2024-09-21T00:14:18.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52eba00640 1 -- 172.21.15.83:0/84146591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e40b1170 con 0x7f52e4074cb0 2024-09-21T00:14:18.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.279+0000 7f52e1600640 1 -- 172.21.15.83:0/84146591 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc010460 con 0x7f52e4074cb0 2024-09-21T00:14:18.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.280+0000 7f52eba00640 1 -- 172.21.15.83:0/84146591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e4156e20 con 0x7f52e4074cb0 2024-09-21T00:14:18.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.281+0000 7f52eba00640 1 -- 172.21.15.83:0/84146591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e406acf0 con 0x7f52e4074cb0 2024-09-21T00:14:18.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.282+0000 7f52e1600640 1 -- 172.21.15.83:0/84146591 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52cc01a070 con 0x7f52e4074cb0 2024-09-21T00:14:18.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.283+0000 7f52e1600640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c0078b90 0x7f52c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:18.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.283+0000 7f52e1600640 1 -- 172.21.15.83:0/84146591 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52cc09b180 con 0x7f52e4074cb0 2024-09-21T00:14:18.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.283+0000 7f52e9000640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c0078b90 0x7f52c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:18.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.284+0000 7f52e9000640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c0078b90 0x7f52c007b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52e415a730 tx=0x7f52d400b260 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:18.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.287+0000 7f52e1600640 1 -- 172.21.15.83:0/84146591 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f52e406acf0 con 0x7f52e4074cb0 2024-09-21T00:14:18.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.508+0000 7f52eba00640 1 -- 172.21.15.83:0/84146591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f52e4073dd0 con 0x7f52e4074cb0 2024-09-21T00:14:18.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.508+0000 7f52e1600640 1 -- 172.21.15.83:0/84146591 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f52cc062c20 con 0x7f52e4074cb0 2024-09-21T00:14:18.509 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.510+0000 7f52eba00640 1 -- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c0078b90 msgr2=0x7f52c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.510+0000 7f52eba00640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c0078b90 0x7f52c007b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52e415a730 tx=0x7f52d400b260 comp rx=0 tx=0).stop 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.510+0000 7f52eba00640 1 -- 172.21.15.83:0/84146591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e4074cb0 msgr2=0x7f52e41f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.510+0000 7f52eba00640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e4074cb0 0x7f52e41f3590 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00d740 tx=0x7f52cc00dc00 comp rx=0 tx=0).stop 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.510+0000 7f52eba00640 1 -- 172.21.15.83:0/84146591 shutdown_connections 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.510+0000 7f52eba00640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c0078b90 0x7f52c007b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.510+0000 7f52eba00640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e40cbc10 0x7f52e41f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.510+0000 7f52eba00640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e4074cb0 0x7f52e41f3590 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.510+0000 7f52eba00640 1 --2- 172.21.15.83:0/84146591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52e406ddf0 0x7f52e40b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.510+0000 7f52eba00640 1 -- 172.21.15.83:0/84146591 >> 172.21.15.83:0/84146591 conn(0x7f52e40cca40 msgr2=0x7f52e40ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:18.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.511+0000 7f52eba00640 1 -- 172.21.15.83:0/84146591 shutdown_connections 2024-09-21T00:14:18.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18.511+0000 7f52eba00640 1 -- 172.21.15.83:0/84146591 wait complete. 2024-09-21T00:14:18.535 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T00:14:18.535 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:14:18.535 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-09-21T00:14:18.535 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T00:14:18.535 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T00:14:18.535 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T00:14:18.535 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T00:14:18.535 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:14:18.535 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T00:14:18.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:18.535 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-09-21T00:14:18.570 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:14:18.570 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:14:18.570 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:18.571 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T00:14:18.572 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42718sec preferred_lft 42718sec 2024-09-21T00:14:18.572 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2024-09-21T00:14:18.572 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:18.573 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T00:14:18.573 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:18.573 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:18.573 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2024-09-21T00:14:18.573 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2024-09-21T00:14:18.573 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2024-09-21T00:14:18.573 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T00:14:18.573 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:18.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:18.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:18.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:18.991 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:14:19.047 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-09-21T00:14:19.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:19.051 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-09-21T00:14:19.108 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-09-21T00:14:19.108 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:14:19.108 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T00:14:19.109 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T00:14:19.109 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:14:19.109 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:19.109 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:19.110 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T00:14:19.110 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T00:14:19.110 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T00:14:19.110 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:19.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:19.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:19.726 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T00:14:19.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:19.762 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-09-21T00:14:19.839 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:19.839 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:19.839 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T00:14:19.839 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T00:14:19.839 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:19.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:20.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:20.019 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T00:14:20.019 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:20.019 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:20.019 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T00:14:20.019 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T00:14:20.019 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T00:14:20.019 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T00:14:20.019 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T00:14:20.019 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:20.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:20.268 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:20.268 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:20.268 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-09-21T00:14:20.269 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T00:14:20.269 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:20.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:20.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:20.438 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T00:14:20.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:14:20.438 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T00:14:20.473 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T00:14:20.473 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:14:20.473 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T00:14:20.547 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-21T00:14:20.645 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-21T00:14:20.683 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T00:14:20.684 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-21T00:14:20.685 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-21T00:14:20.685 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-09-21T00:14:20.685 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-09-21T00:14:20.685 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-09-21T00:14:20.685 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-09-21T00:14:20.685 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-21T00:14:20.685 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T00:14:20.685 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T00:14:20.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:20.686 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-21T00:14:20.761 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T00:14:20.761 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T00:14:20.806 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-21T00:14:20.863 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T00:14:20.899 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-21T00:14:20.899 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-21T00:14:20.899 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-21T00:14:20.899 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-21T00:14:20.899 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-21T00:14:20.899 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-21T00:14:20.899 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-21T00:14:20.899 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-21T00:14:20.899 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-21T00:14:20.900 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-21T00:14:20.900 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-21T00:14:20.900 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-21T00:14:20.900 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:14:20.900 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-21T00:14:20.900 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-21T00:14:20.900 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-21T00:14:20.900 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-21T00:14:20.900 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-21T00:14:20.900 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T00:14:20.901 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T00:14:20.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:20.903 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-21T00:14:21.031 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:2024-09-21T00:14:21.030+0000 7f224f740480 -1 init, newargv = 0x55d2f43c5000 newargc=15 2024-09-21T00:14:21.031 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:ceph-fuse[43111]: starting ceph client 2024-09-21T00:14:21.043 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:ceph-fuse[43111]: starting fuse 2024-09-21T00:14:22.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-21T00:14:22.144 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-21T00:14:22.182 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T00:14:22.183 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-21T00:14:22.184 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-21T00:14:22.184 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-0 2024-09-21T00:14:22.184 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-1 2024-09-21T00:14:22.184 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-2 2024-09-21T00:14:22.184 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-3 2024-09-21T00:14:22.184 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-21T00:14:22.184 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T00:14:22.184 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T00:14:22.184 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-21T00:14:22.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:22.185 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-21T00:14:22.260 INFO:teuthology.orchestra.run.smithi083.stdout:41 2024-09-21T00:14:22.261 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> sudo stdin-killer -- python3 -c ' 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> import re 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T00:14:22.261 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> return f 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T00:14:22.262 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.admin")) 2024-09-21T00:14:22.263 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-09-21T00:14:22.424 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.admin.43111.asok 2024-09-21T00:14:22.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:22.438 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43111.asok 2024-09-21T00:14:22.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:22.438 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43111.asok status 2024-09-21T00:14:22.680 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "admin", 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "43111", 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/" 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2024-09-21T00:14:22.681 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4521, 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 4521 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 250005127 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-09-21T00:14:22.682 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 250005127 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.4521 192.168.0.1:0/250005127", 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.1:0/250005127", 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 1, 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 7, 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 27, 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2024-09-21T00:14:22.683 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:14:22.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:22.698 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2024-09-21T00:14:22.698 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T00:14:22.734 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2024-09-21T00:14:22.734 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T00:14:22.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:22.734 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T00:14:22.831 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T00:14:22.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:22.931 INFO:teuthology.orchestra.run.smithi083.stdout:# file: . 2024-09-21T00:14:22.931 INFO:teuthology.orchestra.run.smithi083.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T00:14:22.931 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:22.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:22.939 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:14:22.939 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:22.975 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T00:14:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.231+0000 7fc57c200640 1 -- 172.21.15.83:0/1512201655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5740cef00 msgr2=0x7fc5740cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.231+0000 7fc57c200640 1 --2- 172.21.15.83:0/1512201655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5740cef00 0x7fc5740cf310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc56c005fd0 tx=0x7fc56c02aa90 comp rx=0 tx=0).stop 2024-09-21T00:14:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.231+0000 7fc57c200640 1 -- 172.21.15.83:0/1512201655 shutdown_connections 2024-09-21T00:14:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.231+0000 7fc57c200640 1 --2- 172.21.15.83:0/1512201655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5740cef00 0x7fc5740cf310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.231+0000 7fc57c200640 1 --2- 172.21.15.83:0/1512201655 >> v2:172.21.15.142:3300/0 conn(0x7fc57406ddf0 0x7fc57406e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.231+0000 7fc57c200640 1 -- 172.21.15.83:0/1512201655 >> 172.21.15.83:0/1512201655 conn(0x7fc5740b1b90 msgr2=0x7fc5740b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.232+0000 7fc57c200640 1 -- 172.21.15.83:0/1512201655 shutdown_connections 2024-09-21T00:14:23.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.232+0000 7fc57c200640 1 -- 172.21.15.83:0/1512201655 wait complete. 2024-09-21T00:14:23.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.234+0000 7fc57c200640 1 Processor -- start 2024-09-21T00:14:23.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.234+0000 7fc57c200640 1 -- start start 2024-09-21T00:14:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.235+0000 7fc57c200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc57406ddf0 0x7fc5740b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.235+0000 7fc57c200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5740cef00 0x7fc5741f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.235+0000 7fc57c200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc574156a50 0x7fc57415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.235+0000 7fc57c200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740cf850 con 0x7fc5740cef00 2024-09-21T00:14:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.235+0000 7fc57c200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc574161060 con 0x7fc57406ddf0 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.235+0000 7fc57c200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc5740cf9d0 con 0x7fc574156a50 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc578e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5740cef00 0x7fc5741f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc578e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5740cef00 0x7fc5741f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46246/0 (socket says 172.21.15.83:46246) 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc578e00640 1 -- 172.21.15.83:0/513091480 learned_addr learned my addr 172.21.15.83:0/513091480 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc57a200640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc574156a50 0x7fc57415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc579800640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc57406ddf0 0x7fc5740b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc578e00640 1 -- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc574156a50 msgr2=0x7fc57415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc578e00640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc574156a50 0x7fc57415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc578e00640 1 -- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc57406ddf0 msgr2=0x7fc5740b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc578e00640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc57406ddf0 0x7fc5740b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc578e00640 1 -- 172.21.15.83:0/513091480 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5740b3410 con 0x7fc5740cef00 2024-09-21T00:14:23.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.236+0000 7fc578e00640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5740cef00 0x7fc5741f60a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc560009fd0 tx=0x7fc56000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:23.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.237+0000 7fc571600640 1 -- 172.21.15.83:0/513091480 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56000ccc0 con 0x7fc5740cef00 2024-09-21T00:14:23.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.237+0000 7fc571600640 1 -- 172.21.15.83:0/513091480 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc56000ee70 con 0x7fc5740cef00 2024-09-21T00:14:23.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.237+0000 7fc571600640 1 -- 172.21.15.83:0/513091480 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56000ce60 con 0x7fc5740cef00 2024-09-21T00:14:23.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.237+0000 7fc57c200640 1 -- 172.21.15.83:0/513091480 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc574159550 con 0x7fc5740cef00 2024-09-21T00:14:23.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.237+0000 7fc57c200640 1 -- 172.21.15.83:0/513091480 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc574159b10 con 0x7fc5740cef00 2024-09-21T00:14:23.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.238+0000 7fc57c200640 1 -- 172.21.15.83:0/513091480 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57406e200 con 0x7fc5740cef00 2024-09-21T00:14:23.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.239+0000 7fc571600640 1 -- 172.21.15.83:0/513091480 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc560005260 con 0x7fc5740cef00 2024-09-21T00:14:23.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.240+0000 7fc571600640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc554078bc0 0x7fc55407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:23.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.240+0000 7fc571600640 1 -- 172.21.15.83:0/513091480 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc56009b8e0 con 0x7fc5740cef00 2024-09-21T00:14:23.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.241+0000 7fc579800640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc554078bc0 0x7fc55407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:23.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.241+0000 7fc579800640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc554078bc0 0x7fc55407b0d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc568001720 tx=0x7fc568009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:23.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.245+0000 7fc571600640 1 -- 172.21.15.83:0/513091480 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc5600632f0 con 0x7fc5740cef00 2024-09-21T00:14:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.441+0000 7fc57c200640 1 -- 172.21.15.83:0/513091480 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc574160270 con 0x7fc5740cef00 2024-09-21T00:14:23.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.441+0000 7fc571600640 1 -- 172.21.15.83:0/513091480 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fc560067d20 con 0x7fc5740cef00 2024-09-21T00:14:23.443 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-09-21T00:14:23.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 -- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc554078bc0 msgr2=0x7fc55407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:23.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc554078bc0 0x7fc55407b0d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc568001720 tx=0x7fc568009040 comp rx=0 tx=0).stop 2024-09-21T00:14:23.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 -- 172.21.15.83:0/513091480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5740cef00 msgr2=0x7fc5741f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:23.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5740cef00 0x7fc5741f60a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc560009fd0 tx=0x7fc56000ec20 comp rx=0 tx=0).stop 2024-09-21T00:14:23.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 -- 172.21.15.83:0/513091480 shutdown_connections 2024-09-21T00:14:23.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc554078bc0 0x7fc55407b0d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc574156a50 0x7fc57415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5740cef00 0x7fc5741f60a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 --2- 172.21.15.83:0/513091480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc57406ddf0 0x7fc5740b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 -- 172.21.15.83:0/513091480 >> 172.21.15.83:0/513091480 conn(0x7fc5740b1b90 msgr2=0x7fc57406d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:23.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 -- 172.21.15.83:0/513091480 shutdown_connections 2024-09-21T00:14:23.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.444+0000 7fc57c200640 1 -- 172.21.15.83:0/513091480 wait complete. 2024-09-21T00:14:23.467 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:14:23.467 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:23.502 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T00:14:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.763+0000 7f23df000640 1 -- 172.21.15.83:0/1132838637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23d8074b60 msgr2=0x7f23d806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.763+0000 7f23df000640 1 --2- 172.21.15.83:0/1132838637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23d8074b60 0x7f23d806ddf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009830 tx=0x7f23c002a510 comp rx=0 tx=0).stop 2024-09-21T00:14:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.763+0000 7f23df000640 1 -- 172.21.15.83:0/1132838637 shutdown_connections 2024-09-21T00:14:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.763+0000 7f23df000640 1 --2- 172.21.15.83:0/1132838637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23d8074b60 0x7f23d806ddf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.763+0000 7f23df000640 1 --2- 172.21.15.83:0/1132838637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23d8156a50 0x7f23d8074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.763+0000 7f23df000640 1 -- 172.21.15.83:0/1132838637 >> 172.21.15.83:0/1132838637 conn(0x7f23d80b1b90 msgr2=0x7f23d80b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.763+0000 7f23df000640 1 -- 172.21.15.83:0/1132838637 shutdown_connections 2024-09-21T00:14:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.763+0000 7f23df000640 1 -- 172.21.15.83:0/1132838637 wait complete. 2024-09-21T00:14:23.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.765+0000 7f23df000640 1 Processor -- start 2024-09-21T00:14:23.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.765+0000 7f23df000640 1 -- start start 2024-09-21T00:14:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23df000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23d806e330 0x7f23d80c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23df000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23d8074b60 0x7f23d8155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23df000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23d8156a50 0x7f23d81f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23df000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f23d80ce500 con 0x7f23d8156a50 2024-09-21T00:14:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23df000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f23d80ce380 con 0x7f23d806e330 2024-09-21T00:14:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23df000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23d80ce680 con 0x7f23d8074b60 2024-09-21T00:14:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23dd000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23d8156a50 0x7f23d81f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23dd000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23d8156a50 0x7f23d81f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46264/0 (socket says 172.21.15.83:46264) 2024-09-21T00:14:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23dd000640 1 -- 172.21.15.83:0/3279939132 learned_addr learned my addr 172.21.15.83:0/3279939132 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23cf400640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23d8074b60 0x7f23d8155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.767+0000 7f23d7e00640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23d806e330 0x7f23d80c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23dd000640 1 -- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23d8074b60 msgr2=0x7f23d8155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23dd000640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23d8074b60 0x7f23d8155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23dd000640 1 -- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23d806e330 msgr2=0x7f23d80c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23dd000640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23d806e330 0x7f23d80c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23dd000640 1 -- 172.21.15.83:0/3279939132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d80c76e0 con 0x7f23d8156a50 2024-09-21T00:14:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23d7e00640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23d806e330 0x7f23d80c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23dd000640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23d8156a50 0x7f23d81f5180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f23d000cb40 tx=0x7f23d000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:23.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23d4c00640 1 -- 172.21.15.83:0/3279939132 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0016020 con 0x7f23d8156a50 2024-09-21T00:14:23.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23d4c00640 1 -- 172.21.15.83:0/3279939132 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23d000ad90 con 0x7f23d8156a50 2024-09-21T00:14:23.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23df000640 1 -- 172.21.15.83:0/3279939132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d80c9960 con 0x7f23d8156a50 2024-09-21T00:14:23.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23d4c00640 1 -- 172.21.15.83:0/3279939132 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0012680 con 0x7f23d8156a50 2024-09-21T00:14:23.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.768+0000 7f23df000640 1 -- 172.21.15.83:0/3279939132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d80c7c60 con 0x7f23d8156a50 2024-09-21T00:14:23.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.769+0000 7f23df000640 1 -- 172.21.15.83:0/3279939132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d806ddf0 con 0x7f23d8156a50 2024-09-21T00:14:23.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.771+0000 7f23d4c00640 1 -- 172.21.15.83:0/3279939132 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23d0019020 con 0x7f23d8156a50 2024-09-21T00:14:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.772+0000 7f23d4c00640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f23b4078bc0 0x7f23b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.772+0000 7f23d4c00640 1 -- 172.21.15.83:0/3279939132 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f23d009b5f0 con 0x7f23d8156a50 2024-09-21T00:14:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.772+0000 7f23d7e00640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f23b4078bc0 0x7f23b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:23.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.773+0000 7f23d7e00640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f23b4078bc0 0x7f23b407b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009b80 tx=0x7f23c8005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:23.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.776+0000 7f23d4c00640 1 -- 172.21.15.83:0/3279939132 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f23d0020020 con 0x7f23d8156a50 2024-09-21T00:14:23.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.977+0000 7f23df000640 1 -- 172.21.15.83:0/3279939132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f23d81563d0 con 0x7f23d8156a50 2024-09-21T00:14:23.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.977+0000 7f23d4c00640 1 -- 172.21.15.83:0/3279939132 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f23d806e740 con 0x7f23d8156a50 2024-09-21T00:14:23.978 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.979+0000 7f23df000640 1 -- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f23b4078bc0 msgr2=0x7f23b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.979+0000 7f23df000640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f23b4078bc0 0x7f23b407b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009b80 tx=0x7f23c8005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.979+0000 7f23df000640 1 -- 172.21.15.83:0/3279939132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23d8156a50 msgr2=0x7f23d81f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.979+0000 7f23df000640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23d8156a50 0x7f23d81f5180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f23d000cb40 tx=0x7f23d000a060 comp rx=0 tx=0).stop 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.979+0000 7f23df000640 1 -- 172.21.15.83:0/3279939132 shutdown_connections 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.979+0000 7f23df000640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f23b4078bc0 0x7f23b407b0d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.979+0000 7f23df000640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23d8156a50 0x7f23d81f5180 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.979+0000 7f23df000640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23d8074b60 0x7f23d8155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.979+0000 7f23df000640 1 --2- 172.21.15.83:0/3279939132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23d806e330 0x7f23d80c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.979+0000 7f23df000640 1 -- 172.21.15.83:0/3279939132 >> 172.21.15.83:0/3279939132 conn(0x7f23d80b1b90 msgr2=0x7f23d80afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.980+0000 7f23df000640 1 -- 172.21.15.83:0/3279939132 shutdown_connections 2024-09-21T00:14:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:23.980+0000 7f23df000640 1 -- 172.21.15.83:0/3279939132 wait complete. 2024-09-21T00:14:24.003 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2024-09-21T00:14:24.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:24.003 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T00:14:24.057 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:ceph-fuse[43111]: fuse finished with error 0 and tester_r 0 2024-09-21T00:14:24.062 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:14:24.146 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:14:24.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:24.147 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T00:14:24.194 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.413+0000 7f9078600640 1 -- 172.21.15.83:0/642119443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f907006e500 msgr2=0x7f90700af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.413+0000 7f9078600640 1 --2- 172.21.15.83:0/642119443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f907006e500 0x7f90700af420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f905c009830 tx=0x7f905c02a5c0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.413+0000 7f9078600640 1 -- 172.21.15.83:0/642119443 shutdown_connections 2024-09-21T00:14:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.413+0000 7f9078600640 1 --2- 172.21.15.83:0/642119443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f907006e500 0x7f90700af420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.413+0000 7f9078600640 1 -- 172.21.15.83:0/642119443 >> 172.21.15.83:0/642119443 conn(0x7f90700cca40 msgr2=0x7f90700cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.413+0000 7f9078600640 1 -- 172.21.15.83:0/642119443 shutdown_connections 2024-09-21T00:14:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.413+0000 7f9078600640 1 -- 172.21.15.83:0/642119443 wait complete. 2024-09-21T00:14:24.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.416+0000 7f9078600640 1 Processor -- start 2024-09-21T00:14:24.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.416+0000 7f9078600640 1 -- start start 2024-09-21T00:14:24.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.417+0000 7f9078600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f907015e7c0 0x7f907009e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:24.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.417+0000 7f9078600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90701f4da0 0x7f9070160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:24.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.417+0000 7f9078600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907009c100 0x7f907009c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:24.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.417+0000 7f9078600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f90700ce8a0 con 0x7f907015e7c0 2024-09-21T00:14:24.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.417+0000 7f9078600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90700ce720 con 0x7f90701f4da0 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.417+0000 7f9078600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f90700cea20 con 0x7f907009c100 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9075c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f907015e7c0 0x7f907009e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9075c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f907015e7c0 0x7f907009e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46296/0 (socket says 172.21.15.83:46296) 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9075c00640 1 -- 172.21.15.83:0/1702613277 learned_addr learned my addr 172.21.15.83:0/1702613277 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9075200640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90701f4da0 0x7f9070160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9076600640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907009c100 0x7f907009c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9075c00640 1 -- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907009c100 msgr2=0x7f907009c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9075c00640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907009c100 0x7f907009c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9075c00640 1 -- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90701f4da0 msgr2=0x7f9070160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9075c00640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90701f4da0 0x7f9070160430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9075c00640 1 -- 172.21.15.83:0/1702613277 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90701f5820 con 0x7f907015e7c0 2024-09-21T00:14:24.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.418+0000 7f9075c00640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f907015e7c0 0x7f907009e380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f906400c760 tx=0x7f906400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:24.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.419+0000 7f906d600640 1 -- 172.21.15.83:0/1702613277 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064003da0 con 0x7f907015e7c0 2024-09-21T00:14:24.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.419+0000 7f906d600640 1 -- 172.21.15.83:0/1702613277 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9064005070 con 0x7f907015e7c0 2024-09-21T00:14:24.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.419+0000 7f9078600640 1 -- 172.21.15.83:0/1702613277 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90701f5b00 con 0x7f907015e7c0 2024-09-21T00:14:24.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.419+0000 7f906d600640 1 -- 172.21.15.83:0/1702613277 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064005480 con 0x7f907015e7c0 2024-09-21T00:14:24.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.419+0000 7f9078600640 1 -- 172.21.15.83:0/1702613277 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f907009b610 con 0x7f907015e7c0 2024-09-21T00:14:24.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.420+0000 7f9078600640 1 -- 172.21.15.83:0/1702613277 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90700cb750 con 0x7f907015e7c0 2024-09-21T00:14:24.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.421+0000 7f906d600640 1 -- 172.21.15.83:0/1702613277 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9064005620 con 0x7f907015e7c0 2024-09-21T00:14:24.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.422+0000 7f906d600640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9050078bc0 0x7f905007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:24.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.422+0000 7f906d600640 1 -- 172.21.15.83:0/1702613277 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f906409acf0 con 0x7f907015e7c0 2024-09-21T00:14:24.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.422+0000 7f9075200640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9050078bc0 0x7f905007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:24.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.423+0000 7f9075200640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9050078bc0 0x7f905007b0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f905c034000 tx=0x7f905c004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:24.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.426+0000 7f906d600640 1 -- 172.21.15.83:0/1702613277 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f906409f070 con 0x7f907015e7c0 2024-09-21T00:14:24.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.611+0000 7f9078600640 1 -- 172.21.15.83:0/1702613277 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90701f5cd0 con 0x7f907015e7c0 2024-09-21T00:14:24.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.613+0000 7f906d600640 1 -- 172.21.15.83:0/1702613277 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f90701f5cd0 con 0x7f907015e7c0 2024-09-21T00:14:24.614 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:24.614 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":27,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:14.484147+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:24.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 -- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9050078bc0 msgr2=0x7f905007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:24.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9050078bc0 0x7f905007b0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f905c034000 tx=0x7f905c004730 comp rx=0 tx=0).stop 2024-09-21T00:14:24.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 -- 172.21.15.83:0/1702613277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f907015e7c0 msgr2=0x7f907009e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:24.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f907015e7c0 0x7f907009e380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f906400c760 tx=0x7f906400cc20 comp rx=0 tx=0).stop 2024-09-21T00:14:24.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 -- 172.21.15.83:0/1702613277 shutdown_connections 2024-09-21T00:14:24.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9050078bc0 0x7f905007b0d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907009c100 0x7f907009c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90701f4da0 0x7f9070160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 --2- 172.21.15.83:0/1702613277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f907015e7c0 0x7f907009e380 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 -- 172.21.15.83:0/1702613277 >> 172.21.15.83:0/1702613277 conn(0x7f90700cca40 msgr2=0x7f90700734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:24.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 -- 172.21.15.83:0/1702613277 shutdown_connections 2024-09-21T00:14:24.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.615+0000 7f9078600640 1 -- 172.21.15.83:0/1702613277 wait complete. 2024-09-21T00:14:24.638 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:24.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.858+0000 7f2d94e00640 1 -- 172.21.15.83:0/3848460211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d901629c0 msgr2=0x7f2d9006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:24.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.858+0000 7f2d94e00640 1 --2- 172.21.15.83:0/3848460211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d901629c0 0x7f2d9006d2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c005fd0 tx=0x7f2d7c02a530 comp rx=0 tx=0).stop 2024-09-21T00:14:24.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.858+0000 7f2d94e00640 1 -- 172.21.15.83:0/3848460211 shutdown_connections 2024-09-21T00:14:24.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.858+0000 7f2d94e00640 1 --2- 172.21.15.83:0/3848460211 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d9006d7f0 0x7f2d90154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.858+0000 7f2d94e00640 1 --2- 172.21.15.83:0/3848460211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d901629c0 0x7f2d9006d2b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.858+0000 7f2d94e00640 1 -- 172.21.15.83:0/3848460211 >> 172.21.15.83:0/3848460211 conn(0x7f2d900d1930 msgr2=0x7f2d900d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:24.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.858+0000 7f2d94e00640 1 -- 172.21.15.83:0/3848460211 shutdown_connections 2024-09-21T00:14:24.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.858+0000 7f2d94e00640 1 -- 172.21.15.83:0/3848460211 wait complete. 2024-09-21T00:14:24.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.860+0000 7f2d94e00640 1 Processor -- start 2024-09-21T00:14:24.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.860+0000 7f2d94e00640 1 -- start start 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d94e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d9006d7f0 0x7f2d900cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d94e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d900b9e40 0x7f2d9014d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d94e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d9014f6a0 0x7f2d90152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d94e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2d90155770 con 0x7f2d9014f6a0 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d94e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2d901555f0 con 0x7f2d900b9e40 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d94e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2d901558f0 con 0x7f2d9006d7f0 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d8fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d9014f6a0 0x7f2d90152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d8fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d9014f6a0 0x7f2d90152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46318/0 (socket says 172.21.15.83:46318) 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d8fe00640 1 -- 172.21.15.83:0/1662270252 learned_addr learned my addr 172.21.15.83:0/1662270252 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d8ea00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d900b9e40 0x7f2d9014d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d8f400640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d9006d7f0 0x7f2d900cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d8fe00640 1 -- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d9006d7f0 msgr2=0x7f2d900cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:24.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d8fe00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d9006d7f0 0x7f2d900cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.862+0000 7f2d8fe00640 1 -- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d900b9e40 msgr2=0x7f2d9014d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:24.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.863+0000 7f2d8fe00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d900b9e40 0x7f2d9014d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:24.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.863+0000 7f2d8fe00640 1 -- 172.21.15.83:0/1662270252 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9014fed0 con 0x7f2d9014f6a0 2024-09-21T00:14:24.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.863+0000 7f2d8f400640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d9006d7f0 0x7f2d900cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:24.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.863+0000 7f2d8ea00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d900b9e40 0x7f2d9014d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:24.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.863+0000 7f2d8fe00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d9014f6a0 0x7f2d90152a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800cad0 tx=0x7f2d8800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.863+0000 7f2d87400640 1 -- 172.21.15.83:0/1662270252 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800ae20 con 0x7f2d9014f6a0 2024-09-21T00:14:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.863+0000 7f2d87400640 1 -- 172.21.15.83:0/1662270252 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d8800f450 con 0x7f2d9014f6a0 2024-09-21T00:14:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.863+0000 7f2d94e00640 1 -- 172.21.15.83:0/1662270252 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d901501b0 con 0x7f2d9014f6a0 2024-09-21T00:14:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.863+0000 7f2d87400640 1 -- 172.21.15.83:0/1662270252 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800f8c0 con 0x7f2d9014f6a0 2024-09-21T00:14:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.863+0000 7f2d94e00640 1 -- 172.21.15.83:0/1662270252 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d90150770 con 0x7f2d9014f6a0 2024-09-21T00:14:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.864+0000 7f2d94e00640 1 -- 172.21.15.83:0/1662270252 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d9014fc40 con 0x7f2d9014f6a0 2024-09-21T00:14:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.865+0000 7f2d87400640 1 -- 172.21.15.83:0/1662270252 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2d8800fa60 con 0x7f2d9014f6a0 2024-09-21T00:14:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.866+0000 7f2d87400640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2d70078bc0 0x7f2d7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.867+0000 7f2d87400640 1 -- 172.21.15.83:0/1662270252 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2d8809bb90 con 0x7f2d9014f6a0 2024-09-21T00:14:24.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.867+0000 7f2d8f400640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2d70078bc0 0x7f2d7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:24.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.868+0000 7f2d8f400640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2d70078bc0 0x7f2d7007b0d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2d80006fd0 tx=0x7f2d80008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:24.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:24.871+0000 7f2d87400640 1 -- 172.21.15.83:0/1662270252 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2d88014030 con 0x7f2d9014f6a0 2024-09-21T00:14:25.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.062+0000 7f2d94e00640 1 -- 172.21.15.83:0/1662270252 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d90154ea0 con 0x7f2d9014f6a0 2024-09-21T00:14:25.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.063+0000 7f2d87400640 1 -- 172.21.15.83:0/1662270252 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f2d88063d20 con 0x7f2d9014f6a0 2024-09-21T00:14:25.065 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:25.065 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":27,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:14.484147+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:25.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 -- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2d70078bc0 msgr2=0x7f2d7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:25.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2d70078bc0 0x7f2d7007b0d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2d80006fd0 tx=0x7f2d80008040 comp rx=0 tx=0).stop 2024-09-21T00:14:25.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 -- 172.21.15.83:0/1662270252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d9014f6a0 msgr2=0x7f2d90152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:25.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d9014f6a0 0x7f2d90152a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800cad0 tx=0x7f2d8800cf90 comp rx=0 tx=0).stop 2024-09-21T00:14:25.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 -- 172.21.15.83:0/1662270252 shutdown_connections 2024-09-21T00:14:25.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2d70078bc0 0x7f2d7007b0d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:25.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d9014f6a0 0x7f2d90152a10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:25.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d900b9e40 0x7f2d9014d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:25.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 --2- 172.21.15.83:0/1662270252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d9006d7f0 0x7f2d900cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:25.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 -- 172.21.15.83:0/1662270252 >> 172.21.15.83:0/1662270252 conn(0x7f2d900d1930 msgr2=0x7f2d9015fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:25.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 -- 172.21.15.83:0/1662270252 shutdown_connections 2024-09-21T00:14:25.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.066+0000 7f2d94e00640 1 -- 172.21.15.83:0/1662270252 wait complete. 2024-09-21T00:14:25.088 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T00:14:25.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.310+0000 7fcb2be00640 1 -- 172.21.15.83:0/1126635333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb2c155b40 msgr2=0x7fcb2c15f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:25.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.310+0000 7fcb2be00640 1 --2- 172.21.15.83:0/1126635333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb2c155b40 0x7fcb2c15f960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005fd0 tx=0x7fcb1c02a5d0 comp rx=0 tx=0).stop 2024-09-21T00:14:25.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.310+0000 7fcb2be00640 1 -- 172.21.15.83:0/1126635333 shutdown_connections 2024-09-21T00:14:25.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.310+0000 7fcb2be00640 1 --2- 172.21.15.83:0/1126635333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb2c0ce250 0x7fcb2c0ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:25.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.310+0000 7fcb2be00640 1 --2- 172.21.15.83:0/1126635333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb2c155b40 0x7fcb2c15f960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:25.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.310+0000 7fcb2be00640 1 -- 172.21.15.83:0/1126635333 >> 172.21.15.83:0/1126635333 conn(0x7fcb2c06f920 msgr2=0x7fcb2c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:25.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.310+0000 7fcb2be00640 1 -- 172.21.15.83:0/1126635333 shutdown_connections 2024-09-21T00:14:25.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.310+0000 7fcb2be00640 1 -- 172.21.15.83:0/1126635333 wait complete. 2024-09-21T00:14:25.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.312+0000 7fcb2be00640 1 Processor -- start 2024-09-21T00:14:25.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.313+0000 7fcb2be00640 1 -- start start 2024-09-21T00:14:25.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.314+0000 7fcb2be00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb2c06def0 0x7fcb2c154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:25.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.314+0000 7fcb2be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb2c0ce250 0x7fcb2c15e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:25.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.314+0000 7fcb2be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb2c155b40 0x7fcb2c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:25.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.314+0000 7fcb2be00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0cef30 con 0x7fcb2c06def0 2024-09-21T00:14:25.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.314+0000 7fcb2be00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0cedb0 con 0x7fcb2c155b40 2024-09-21T00:14:25.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.314+0000 7fcb2be00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2c0cf0b0 con 0x7fcb2c0ce250 2024-09-21T00:14:25.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.314+0000 7fcb2aa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb2c06def0 0x7fcb2c154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:25.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.314+0000 7fcb2aa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb2c06def0 0x7fcb2c154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46346/0 (socket says 172.21.15.83:46346) 2024-09-21T00:14:25.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.314+0000 7fcb2aa00640 1 -- 172.21.15.83:0/3266231543 learned_addr learned my addr 172.21.15.83:0/3266231543 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:25.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.314+0000 7fcb2b400640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb2c155b40 0x7fcb2c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:25.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb22000640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb2c0ce250 0x7fcb2c15e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:25.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb2aa00640 1 -- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb2c0ce250 msgr2=0x7fcb2c15e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:25.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb2aa00640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb2c0ce250 0x7fcb2c15e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:25.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb2aa00640 1 -- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb2c155b40 msgr2=0x7fcb2c157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:25.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb2aa00640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb2c155b40 0x7fcb2c157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:25.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb2aa00640 1 -- 172.21.15.83:0/3266231543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c1f8bb0 con 0x7fcb2c06def0 2024-09-21T00:14:25.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb22000640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb2c0ce250 0x7fcb2c15e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:25.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb2aa00640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb2c06def0 0x7fcb2c154550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c006010 tx=0x7fcb1c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:25.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb23400640 1 -- 172.21.15.83:0/3266231543 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c03e030 con 0x7fcb2c06def0 2024-09-21T00:14:25.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb23400640 1 -- 172.21.15.83:0/3266231543 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb1c003ae0 con 0x7fcb2c06def0 2024-09-21T00:14:25.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb23400640 1 -- 172.21.15.83:0/3266231543 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c035040 con 0x7fcb2c06def0 2024-09-21T00:14:25.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.315+0000 7fcb2be00640 1 -- 172.21.15.83:0/3266231543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2c1f8e90 con 0x7fcb2c06def0 2024-09-21T00:14:25.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.316+0000 7fcb2be00640 1 -- 172.21.15.83:0/3266231543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2c0af290 con 0x7fcb2c06def0 2024-09-21T00:14:25.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.316+0000 7fcb2be00640 1 -- 172.21.15.83:0/3266231543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2c0ce660 con 0x7fcb2c06def0 2024-09-21T00:14:25.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.318+0000 7fcb23400640 1 -- 172.21.15.83:0/3266231543 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb1c041030 con 0x7fcb2c06def0 2024-09-21T00:14:25.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.319+0000 7fcb23400640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcb08078b90 0x7fcb0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:25.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.319+0000 7fcb23400640 1 -- 172.21.15.83:0/3266231543 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcb1c0bb6b0 con 0x7fcb2c06def0 2024-09-21T00:14:25.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.319+0000 7fcb22000640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcb08078b90 0x7fcb0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:25.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.320+0000 7fcb22000640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcb08078b90 0x7fcb0807b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0cc770 tx=0x7fcb14009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:25.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.323+0000 7fcb23400640 1 -- 172.21.15.83:0/3266231543 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcb1c083710 con 0x7fcb2c06def0 2024-09-21T00:14:25.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:25.543+0000 7fcb2be00640 1 -- 172.21.15.83:0/3266231543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcb2c0af520 con 0x7fcb2c06def0 2024-09-21T00:14:26.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.025+0000 7fcb23400640 1 -- 172.21.15.83:0/3266231543 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fcb1c083010 con 0x7fcb2c06def0 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.027+0000 7fcb2be00640 1 -- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcb08078b90 msgr2=0x7fcb0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.027+0000 7fcb2be00640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcb08078b90 0x7fcb0807b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0cc770 tx=0x7fcb14009040 comp rx=0 tx=0).stop 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.027+0000 7fcb2be00640 1 -- 172.21.15.83:0/3266231543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb2c06def0 msgr2=0x7fcb2c154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.027+0000 7fcb2be00640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb2c06def0 0x7fcb2c154550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c006010 tx=0x7fcb1c0035f0 comp rx=0 tx=0).stop 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.027+0000 7fcb2be00640 1 -- 172.21.15.83:0/3266231543 shutdown_connections 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.027+0000 7fcb2be00640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcb08078b90 0x7fcb0807b0a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.027+0000 7fcb2be00640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb2c155b40 0x7fcb2c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.027+0000 7fcb2be00640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb2c0ce250 0x7fcb2c15e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.027+0000 7fcb2be00640 1 --2- 172.21.15.83:0/3266231543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb2c06def0 0x7fcb2c154550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.027+0000 7fcb2be00640 1 -- 172.21.15.83:0/3266231543 >> 172.21.15.83:0/3266231543 conn(0x7fcb2c06f920 msgr2=0x7fcb2c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.028+0000 7fcb2be00640 1 -- 172.21.15.83:0/3266231543 shutdown_connections 2024-09-21T00:14:26.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.028+0000 7fcb2be00640 1 -- 172.21.15.83:0/3266231543 wait complete. 2024-09-21T00:14:26.050 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-21T00:14:26.050 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T00:14:26.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.272+0000 7f7f52600640 1 -- 172.21.15.83:0/2255218457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4c071870 msgr2=0x7f7f4c06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:26.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.272+0000 7f7f52600640 1 --2- 172.21.15.83:0/2255218457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4c071870 0x7f7f4c06e1f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c073490 tx=0x7f7f4402aa10 comp rx=0 tx=0).stop 2024-09-21T00:14:26.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.272+0000 7f7f52600640 1 -- 172.21.15.83:0/2255218457 shutdown_connections 2024-09-21T00:14:26.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.272+0000 7f7f52600640 1 --2- 172.21.15.83:0/2255218457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4c071870 0x7f7f4c06e1f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:26.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.272+0000 7f7f52600640 1 --2- 172.21.15.83:0/2255218457 >> v2:172.21.15.142:3300/0 conn(0x7f7f4c0b3f50 0x7f7f4c15e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:26.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.272+0000 7f7f52600640 1 -- 172.21.15.83:0/2255218457 >> 172.21.15.83:0/2255218457 conn(0x7f7f4c0d1020 msgr2=0x7f7f4c0d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:26.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.272+0000 7f7f52600640 1 -- 172.21.15.83:0/2255218457 shutdown_connections 2024-09-21T00:14:26.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.272+0000 7f7f52600640 1 -- 172.21.15.83:0/2255218457 wait complete. 2024-09-21T00:14:26.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.274+0000 7f7f52600640 1 Processor -- start 2024-09-21T00:14:26.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.274+0000 7f7f52600640 1 -- start start 2024-09-21T00:14:26.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f52600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4c06dde0 0x7f7f4c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:26.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f52600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4c0b3f50 0x7f7f4c14a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:26.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f52600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4c14ac60 0x7f7f4c14b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:26.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f52600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c15f380 con 0x7f7f4c06dde0 2024-09-21T00:14:26.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f52600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c15f200 con 0x7f7f4c0b3f50 2024-09-21T00:14:26.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f52600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4c15f500 con 0x7f7f4c14ac60 2024-09-21T00:14:26.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f51200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4c06dde0 0x7f7f4c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:26.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f51200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4c06dde0 0x7f7f4c1491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46362/0 (socket says 172.21.15.83:46362) 2024-09-21T00:14:26.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f51200640 1 -- 172.21.15.83:0/2717892814 learned_addr learned my addr 172.21.15.83:0/2717892814 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:26.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f51c00640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4c14ac60 0x7f7f4c14b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:26.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.276+0000 7f7f43e00640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4c0b3f50 0x7f7f4c14a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:26.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f51200640 1 -- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4c14ac60 msgr2=0x7f7f4c14b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:26.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f51200640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4c14ac60 0x7f7f4c14b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:26.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f51200640 1 -- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4c0b3f50 msgr2=0x7f7f4c14a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:26.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f51200640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4c0b3f50 0x7f7f4c14a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:26.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f51200640 1 -- 172.21.15.83:0/2717892814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c14b5b0 con 0x7f7f4c06dde0 2024-09-21T00:14:26.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f43e00640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4c0b3f50 0x7f7f4c14a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:26.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f51200640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4c06dde0 0x7f7f4c1491e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00c970 tx=0x7f7f3c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:26.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f49600640 1 -- 172.21.15.83:0/2717892814 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c007bb0 con 0x7f7f4c06dde0 2024-09-21T00:14:26.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f49600640 1 -- 172.21.15.83:0/2717892814 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f3c007e40 con 0x7f7f4c06dde0 2024-09-21T00:14:26.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f52600640 1 -- 172.21.15.83:0/2717892814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4c15d130 con 0x7f7f4c06dde0 2024-09-21T00:14:26.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f49600640 1 -- 172.21.15.83:0/2717892814 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00f690 con 0x7f7f4c06dde0 2024-09-21T00:14:26.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.277+0000 7f7f52600640 1 -- 172.21.15.83:0/2717892814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4c149f20 con 0x7f7f4c06dde0 2024-09-21T00:14:26.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.278+0000 7f7f52600640 1 -- 172.21.15.83:0/2717892814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4c15f9b0 con 0x7f7f4c06dde0 2024-09-21T00:14:26.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.280+0000 7f7f49600640 1 -- 172.21.15.83:0/2717892814 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7f3c00f830 con 0x7f7f4c06dde0 2024-09-21T00:14:26.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.281+0000 7f7f49600640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7f28078b90 0x7f7f2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:26.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.281+0000 7f7f49600640 1 -- 172.21.15.83:0/2717892814 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7f3c09b850 con 0x7f7f4c06dde0 2024-09-21T00:14:26.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.281+0000 7f7f43e00640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7f28078b90 0x7f7f2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:26.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.282+0000 7f7f43e00640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7f28078b90 0x7f7f2807b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f34006fd0 tx=0x7f7f34008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:26.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.285+0000 7f7f49600640 1 -- 172.21.15.83:0/2717892814 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7f3c014030 con 0x7f7f4c06dde0 2024-09-21T00:14:26.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:26.509+0000 7f7f52600640 1 -- 172.21.15.83:0/2717892814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7f4c0b4ed0 con 0x7f7f4c06dde0 2024-09-21T00:14:27.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.033+0000 7f7f49600640 1 -- 172.21.15.83:0/2717892814 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f7f3c063940 con 0x7f7f4c06dde0 2024-09-21T00:14:27.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.036+0000 7f7f52600640 1 -- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7f28078b90 msgr2=0x7f7f2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.036+0000 7f7f52600640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7f28078b90 0x7f7f2807b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f34006fd0 tx=0x7f7f34008040 comp rx=0 tx=0).stop 2024-09-21T00:14:27.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.036+0000 7f7f52600640 1 -- 172.21.15.83:0/2717892814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4c06dde0 msgr2=0x7f7f4c1491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.036+0000 7f7f52600640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4c06dde0 0x7f7f4c1491e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00c970 tx=0x7f7f3c00ce30 comp rx=0 tx=0).stop 2024-09-21T00:14:27.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.036+0000 7f7f52600640 1 -- 172.21.15.83:0/2717892814 shutdown_connections 2024-09-21T00:14:27.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.036+0000 7f7f52600640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7f28078b90 0x7f7f2807b0a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.036+0000 7f7f52600640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4c14ac60 0x7f7f4c14b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.036+0000 7f7f52600640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4c0b3f50 0x7f7f4c14a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.036+0000 7f7f52600640 1 --2- 172.21.15.83:0/2717892814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4c06dde0 0x7f7f4c1491e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.036+0000 7f7f52600640 1 -- 172.21.15.83:0/2717892814 >> 172.21.15.83:0/2717892814 conn(0x7f7f4c0d1020 msgr2=0x7f7f4c06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:27.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.037+0000 7f7f52600640 1 -- 172.21.15.83:0/2717892814 shutdown_connections 2024-09-21T00:14:27.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.037+0000 7f7f52600640 1 -- 172.21.15.83:0/2717892814 wait complete. 2024-09-21T00:14:27.060 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T00:14:27.061 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:14:27.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.280+0000 7f10d3e00640 1 -- 172.21.15.83:0/805249048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d41627f0 msgr2=0x7f10d406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.280+0000 7f10d3e00640 1 --2- 172.21.15.83:0/805249048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d41627f0 0x7f10d406d2b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f10d40b6de0 tx=0x7f10bc02a5f0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.280+0000 7f10d3e00640 1 -- 172.21.15.83:0/805249048 shutdown_connections 2024-09-21T00:14:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.280+0000 7f10d3e00640 1 --2- 172.21.15.83:0/805249048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d41627f0 0x7f10d406d2b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.280+0000 7f10d3e00640 1 --2- 172.21.15.83:0/805249048 >> v2:172.21.15.142:3300/0 conn(0x7f10d40b9e40 0x7f10d41622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.280+0000 7f10d3e00640 1 -- 172.21.15.83:0/805249048 >> 172.21.15.83:0/805249048 conn(0x7f10d40d1930 msgr2=0x7f10d40d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.280+0000 7f10d3e00640 1 -- 172.21.15.83:0/805249048 shutdown_connections 2024-09-21T00:14:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.280+0000 7f10d3e00640 1 -- 172.21.15.83:0/805249048 wait complete. 2024-09-21T00:14:27.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.282+0000 7f10d3e00640 1 Processor -- start 2024-09-21T00:14:27.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.282+0000 7f10d3e00640 1 -- start start 2024-09-21T00:14:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d406d7f0 0x7f10d41568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10d40b9e40 0x7f10d40c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d41627f0 0x7f10d40c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f10d4155940 con 0x7f10d41627f0 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f10d41557c0 con 0x7f10d406d7f0 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f10d4155ac0 con 0x7f10d40b9e40 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d41627f0 0x7f10d40c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d2a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d406d7f0 0x7f10d41568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d41627f0 0x7f10d40c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46376/0 (socket says 172.21.15.83:46376) 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3400640 1 -- 172.21.15.83:0/106569381 learned_addr learned my addr 172.21.15.83:0/106569381 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10ca000640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10d40b9e40 0x7f10d40c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3400640 1 -- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10d40b9e40 msgr2=0x7f10d40c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3400640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10d40b9e40 0x7f10d40c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3400640 1 -- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d406d7f0 msgr2=0x7f10d41568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3400640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d406d7f0 0x7f10d41568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.284+0000 7f10d3400640 1 -- 172.21.15.83:0/106569381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d41f6940 con 0x7f10d41627f0 2024-09-21T00:14:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.285+0000 7f10d3400640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d41627f0 0x7f10d40c7de0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00c730 tx=0x7f10cc00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.285+0000 7f10cb400640 1 -- 172.21.15.83:0/106569381 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc003b70 con 0x7f10d41627f0 2024-09-21T00:14:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.285+0000 7f10cb400640 1 -- 172.21.15.83:0/106569381 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10cc003d10 con 0x7f10d41627f0 2024-09-21T00:14:27.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.285+0000 7f10d3e00640 1 -- 172.21.15.83:0/106569381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d41f6660 con 0x7f10d41627f0 2024-09-21T00:14:27.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.285+0000 7f10cb400640 1 -- 172.21.15.83:0/106569381 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc005330 con 0x7f10d41627f0 2024-09-21T00:14:27.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.285+0000 7f10d3e00640 1 -- 172.21.15.83:0/106569381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d41560c0 con 0x7f10d41627f0 2024-09-21T00:14:27.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.286+0000 7f10d3e00640 1 -- 172.21.15.83:0/106569381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d41622b0 con 0x7f10d41627f0 2024-09-21T00:14:27.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.287+0000 7f10cb400640 1 -- 172.21.15.83:0/106569381 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10cc0054d0 con 0x7f10d41627f0 2024-09-21T00:14:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.288+0000 7f10cb400640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f10b0078bc0 0x7f10b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.288+0000 7f10cb400640 1 -- 172.21.15.83:0/106569381 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f10cc09ad40 con 0x7f10d41627f0 2024-09-21T00:14:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.289+0000 7f10d2a00640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f10b0078bc0 0x7f10b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.289+0000 7f10d2a00640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f10b0078bc0 0x7f10b007b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10c4004630 tx=0x7f10c400b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:27.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.293+0000 7f10cb400640 1 -- 172.21.15.83:0/106569381 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f10d4163170 con 0x7f10d41627f0 2024-09-21T00:14:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.521+0000 7f10d3e00640 1 -- 172.21.15.83:0/106569381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10d41f63f0 con 0x7f10d41627f0 2024-09-21T00:14:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.522+0000 7f10cb400640 1 -- 172.21.15.83:0/106569381 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5222 (secure 0 0 0) 0x7f10cc062750 con 0x7f10d41627f0 2024-09-21T00:14:27.523 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:27.523 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"btime":"2024-09-21T00:14:27:026365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:14:09.437323+0000","modified":"2024-09-21T00:14:26.510440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-21T00:14:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-09-21T00:14:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.524+0000 7f10d3e00640 1 -- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f10b0078bc0 msgr2=0x7f10b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.524+0000 7f10d3e00640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f10b0078bc0 0x7f10b007b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10c4004630 tx=0x7f10c400b2e0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.524+0000 7f10d3e00640 1 -- 172.21.15.83:0/106569381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d41627f0 msgr2=0x7f10d40c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.524+0000 7f10d3e00640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d41627f0 0x7f10d40c7de0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00c730 tx=0x7f10cc00cb30 comp rx=0 tx=0).stop 2024-09-21T00:14:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.525+0000 7f10d3e00640 1 -- 172.21.15.83:0/106569381 shutdown_connections 2024-09-21T00:14:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.525+0000 7f10d3e00640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f10b0078bc0 0x7f10b007b0d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.525+0000 7f10d3e00640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d41627f0 0x7f10d40c7de0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.525+0000 7f10d3e00640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10d40b9e40 0x7f10d40c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.525+0000 7f10d3e00640 1 --2- 172.21.15.83:0/106569381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d406d7f0 0x7f10d41568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.525+0000 7f10d3e00640 1 -- 172.21.15.83:0/106569381 >> 172.21.15.83:0/106569381 conn(0x7f10d40d1930 msgr2=0x7f10d40b8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.525+0000 7f10d3e00640 1 -- 172.21.15.83:0/106569381 shutdown_connections 2024-09-21T00:14:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.525+0000 7f10d3e00640 1 -- 172.21.15.83:0/106569381 wait complete. 2024-09-21T00:14:27.547 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.766+0000 7f61d7000640 1 -- 172.21.15.83:0/3044223739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61d00af420 msgr2=0x7f61d015e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.766+0000 7f61d7000640 1 --2- 172.21.15.83:0/3044223739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61d00af420 0x7f61d015e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f61c8005fd0 tx=0x7f61c802aa90 comp rx=0 tx=0).stop 2024-09-21T00:14:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.766+0000 7f61d7000640 1 -- 172.21.15.83:0/3044223739 shutdown_connections 2024-09-21T00:14:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.766+0000 7f61d7000640 1 --2- 172.21.15.83:0/3044223739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61d00af420 0x7f61d015e7c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.766+0000 7f61d7000640 1 -- 172.21.15.83:0/3044223739 >> 172.21.15.83:0/3044223739 conn(0x7f61d00cca40 msgr2=0x7f61d00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.766+0000 7f61d7000640 1 -- 172.21.15.83:0/3044223739 shutdown_connections 2024-09-21T00:14:27.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.766+0000 7f61d7000640 1 -- 172.21.15.83:0/3044223739 wait complete. 2024-09-21T00:14:27.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.769+0000 7f61d7000640 1 Processor -- start 2024-09-21T00:14:27.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.769+0000 7f61d7000640 1 -- start start 2024-09-21T00:14:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.770+0000 7f61d7000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d00af420 0x7f61d006d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.770+0000 7f61d7000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61d006dea0 0x7f61d01f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.770+0000 7f61d7000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d01f5d30 0x7f61d01f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.770+0000 7f61d7000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f61d00ce8a0 con 0x7f61d006dea0 2024-09-21T00:14:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.770+0000 7f61d7000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f61d00ce720 con 0x7f61d01f5d30 2024-09-21T00:14:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.770+0000 7f61d7000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f61d00cea20 con 0x7f61d00af420 2024-09-21T00:14:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cf400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61d006dea0 0x7f61d01f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d00af420 0x7f61d006d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d00af420 0x7f61d006d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:57244/0 (socket says 172.21.15.83:57244) 2024-09-21T00:14:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cfe00640 1 -- 172.21.15.83:0/2257388832 learned_addr learned my addr 172.21.15.83:0/2257388832 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cf400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61d006dea0 0x7f61d01f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46398/0 (socket says 172.21.15.83:46398) 2024-09-21T00:14:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61d5000640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d01f5d30 0x7f61d01f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cfe00640 1 -- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d01f5d30 msgr2=0x7f61d01f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cfe00640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d01f5d30 0x7f61d01f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cfe00640 1 -- 172.21.15.83:0/2257388832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61d006dea0 msgr2=0x7f61d01f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cfe00640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61d006dea0 0x7f61d01f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cfe00640 1 -- 172.21.15.83:0/2257388832 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d006e2b0 con 0x7f61d00af420 2024-09-21T00:14:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cf400640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61d006dea0 0x7f61d01f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:14:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.771+0000 7f61cfe00640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d00af420 0x7f61d006d960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61c000c3a0 tx=0x7f61c000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:27.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.772+0000 7f61c7e00640 1 -- 172.21.15.83:0/2257388832 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0017070 con 0x7f61d00af420 2024-09-21T00:14:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.772+0000 7f61c7e00640 1 -- 172.21.15.83:0/2257388832 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61c00053c0 con 0x7f61d00af420 2024-09-21T00:14:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.772+0000 7f61d7000640 1 -- 172.21.15.83:0/2257388832 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d0073a70 con 0x7f61d00af420 2024-09-21T00:14:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.772+0000 7f61c7e00640 1 -- 172.21.15.83:0/2257388832 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0003850 con 0x7f61d00af420 2024-09-21T00:14:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.772+0000 7f61d7000640 1 -- 172.21.15.83:0/2257388832 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d0074030 con 0x7f61d00af420 2024-09-21T00:14:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.773+0000 7f61d7000640 1 -- 172.21.15.83:0/2257388832 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d00cb750 con 0x7f61d00af420 2024-09-21T00:14:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.774+0000 7f61c7e00640 1 -- 172.21.15.83:0/2257388832 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61c001a070 con 0x7f61d00af420 2024-09-21T00:14:27.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.775+0000 7f61c7e00640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f61b0078b90 0x7f61b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:27.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.775+0000 7f61c7e00640 1 -- 172.21.15.83:0/2257388832 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f61c009a660 con 0x7f61d00af420 2024-09-21T00:14:27.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.776+0000 7f61cf400640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f61b0078b90 0x7f61b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:27.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.776+0000 7f61cf400640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f61b0078b90 0x7f61b007b0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61d0075030 tx=0x7f61bc009060 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:27.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.780+0000 7f61c7e00640 1 -- 172.21.15.83:0/2257388832 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f61d006e2b0 con 0x7f61d00af420 2024-09-21T00:14:27.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.968+0000 7f61d7000640 1 -- 172.21.15.83:0/2257388832 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61d00b5f40 con 0x7f61d00af420 2024-09-21T00:14:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.970+0000 7f61c7e00640 1 -- 172.21.15.83:0/2257388832 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f61c0069e20 con 0x7f61d00af420 2024-09-21T00:14:27.971 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:27.971 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":27,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:14.484147+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:27.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 -- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f61b0078b90 msgr2=0x7f61b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f61b0078b90 0x7f61b007b0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61d0075030 tx=0x7f61bc009060 comp rx=0 tx=0).stop 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 -- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d00af420 msgr2=0x7f61d006d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d00af420 0x7f61d006d960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61c000c3a0 tx=0x7f61c000c860 comp rx=0 tx=0).stop 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 -- 172.21.15.83:0/2257388832 shutdown_connections 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f61b0078b90 0x7f61b007b0a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d01f5d30 0x7f61d01f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61d006dea0 0x7f61d01f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 --2- 172.21.15.83:0/2257388832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d00af420 0x7f61d006d960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 -- 172.21.15.83:0/2257388832 >> 172.21.15.83:0/2257388832 conn(0x7f61d00cca40 msgr2=0x7f61d00b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 -- 172.21.15.83:0/2257388832 shutdown_connections 2024-09-21T00:14:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:27.972+0000 7f61d7000640 1 -- 172.21.15.83:0/2257388832 wait complete. 2024-09-21T00:14:27.998 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T00:14:27.998 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:14:28.077 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:14:28.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:14:28.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.223+0000 7f7cfca00640 1 -- 172.21.15.83:0/2670145954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf806e500 msgr2=0x7f7cf806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.223+0000 7f7cfca00640 1 --2- 172.21.15.83:0/2670145954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf806e500 0x7f7cf806ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0005fd0 tx=0x7f7cf002a940 comp rx=0 tx=0).stop 2024-09-21T00:14:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.223+0000 7f7cfca00640 1 -- 172.21.15.83:0/2670145954 shutdown_connections 2024-09-21T00:14:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.223+0000 7f7cfca00640 1 --2- 172.21.15.83:0/2670145954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf806e500 0x7f7cf806ede0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.223+0000 7f7cfca00640 1 -- 172.21.15.83:0/2670145954 >> 172.21.15.83:0/2670145954 conn(0x7f7cf80cca40 msgr2=0x7f7cf80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.223+0000 7f7cfca00640 1 -- 172.21.15.83:0/2670145954 shutdown_connections 2024-09-21T00:14:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.223+0000 7f7cfca00640 1 -- 172.21.15.83:0/2670145954 wait complete. 2024-09-21T00:14:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.225+0000 7f7cfca00640 1 Processor -- start 2024-09-21T00:14:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.225+0000 7f7cfca00640 1 -- start start 2024-09-21T00:14:28.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7cfca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf8073dd0 0x7f7cf809e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:28.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7cfca00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf8074cb0 0x7f7cf81594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7cfca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf8159a20 0x7f7cf8156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7cfca00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf806f6b0 con 0x7f7cf8074cb0 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7cfca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf806f530 con 0x7f7cf8073dd0 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7cfca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf806f830 con 0x7f7cf8159a20 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7ced400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf8074cb0 0x7f7cf81594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7ced400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf8074cb0 0x7f7cf81594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46410/0 (socket says 172.21.15.83:46410) 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7ced400640 1 -- 172.21.15.83:0/695529484 learned_addr learned my addr 172.21.15.83:0/695529484 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7cf5e00640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf8073dd0 0x7f7cf809e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7cf6800640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf8159a20 0x7f7cf8156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7ced400640 1 -- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf8159a20 msgr2=0x7f7cf8156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.227+0000 7f7ced400640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf8159a20 0x7f7cf8156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.228+0000 7f7ced400640 1 -- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf8073dd0 msgr2=0x7f7cf809e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.228+0000 7f7ced400640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf8073dd0 0x7f7cf809e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.228+0000 7f7ced400640 1 -- 172.21.15.83:0/695529484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf8159e30 con 0x7f7cf8074cb0 2024-09-21T00:14:28.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.228+0000 7f7ced400640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf8074cb0 0x7f7cf81594e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c3f0 tx=0x7f7ce000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:28.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.228+0000 7f7ceea00640 1 -- 172.21.15.83:0/695529484 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0017070 con 0x7f7cf8074cb0 2024-09-21T00:14:28.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.228+0000 7f7ceea00640 1 -- 172.21.15.83:0/695529484 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ce00035f0 con 0x7f7cf8074cb0 2024-09-21T00:14:28.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.228+0000 7f7cfca00640 1 -- 172.21.15.83:0/695529484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf80c82d0 con 0x7f7cf8074cb0 2024-09-21T00:14:28.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.228+0000 7f7ceea00640 1 -- 172.21.15.83:0/695529484 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0003a40 con 0x7f7cf8074cb0 2024-09-21T00:14:28.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.228+0000 7f7cfca00640 1 -- 172.21.15.83:0/695529484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf80c8890 con 0x7f7cf8074cb0 2024-09-21T00:14:28.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.229+0000 7f7cfca00640 1 -- 172.21.15.83:0/695529484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf806ede0 con 0x7f7cf8074cb0 2024-09-21T00:14:28.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.231+0000 7f7ceea00640 1 -- 172.21.15.83:0/695529484 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ce001a070 con 0x7f7cf8074cb0 2024-09-21T00:14:28.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.231+0000 7f7ceea00640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7cd4078bc0 0x7f7cd407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:28.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.232+0000 7f7ceea00640 1 -- 172.21.15.83:0/695529484 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7ce009a2e0 con 0x7f7cf8074cb0 2024-09-21T00:14:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.232+0000 7f7cf5e00640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7cd4078bc0 0x7f7cd407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.233+0000 7f7cf5e00640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7cd4078bc0 0x7f7cd407b0d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8000f60 tx=0x7f7ce8009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.236+0000 7f7ceea00640 1 -- 172.21.15.83:0/695529484 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7cf8159e30 con 0x7f7cf8074cb0 2024-09-21T00:14:28.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.419+0000 7f7cfca00640 1 -- 172.21.15.83:0/695529484 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7cf806e700 con 0x7f7cd4078bc0 2024-09-21T00:14:28.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.427+0000 7f7ceea00640 1 -- 172.21.15.83:0/695529484 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332543 (secure 0 0 0) 0x7f7cf806e700 con 0x7f7cd4078bc0 2024-09-21T00:14:28.432 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:28.434 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:14:28.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 -- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7cd4078bc0 msgr2=0x7f7cd407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:28.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7cd4078bc0 0x7f7cd407b0d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8000f60 tx=0x7f7ce8009040 comp rx=0 tx=0).stop 2024-09-21T00:14:28.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 -- 172.21.15.83:0/695529484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf8074cb0 msgr2=0x7f7cf81594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf8074cb0 0x7f7cf81594e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c3f0 tx=0x7f7ce000c8b0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 -- 172.21.15.83:0/695529484 shutdown_connections 2024-09-21T00:14:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7cd4078bc0 0x7f7cd407b0d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf8159a20 0x7f7cf8156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf8074cb0 0x7f7cf81594e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 --2- 172.21.15.83:0/695529484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf8073dd0 0x7f7cf809e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 -- 172.21.15.83:0/695529484 >> 172.21.15.83:0/695529484 conn(0x7f7cf80cca40 msgr2=0x7f7cf815e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 -- 172.21.15.83:0/695529484 shutdown_connections 2024-09-21T00:14:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.432+0000 7f7cfca00640 1 -- 172.21.15.83:0/695529484 wait complete. 2024-09-21T00:14:28.454 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-21T00:14:26.853691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":148,"num_write_kb":1645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219664,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755056,"statfs":{"total":773094113280,"available":772869177344,"internally_reserved":0,"allocated":3514368,"data_stored":2070974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.878944"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979446+0000","last_change":"2024-09-21T00:14:08.955433+0000","last_active":"2024-09-21T00:14:14.979446+0000","last_peered":"2024-09-21T00:14:14.979446+0000","last_clean":"2024-09-21T00:14:14.979446+0000","last_became_active":"2024-09-21T00:14:08.955066+0000","last_became_peered":"2024-09-21T00:14:08.955066+0000","last_unstale":"2024-09-21T00:14:14.979446+0000","last_undegraded":"2024-09-21T00:14:14.979446+0000","last_fullsized":"2024-09-21T00:14:14.979446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:28.367381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967544+0000","last_change":"2024-09-21T00:14:09.966683+0000","last_active":"2024-09-21T00:14:15.967544+0000","last_peered":"2024-09-21T00:14:15.967544+0000","last_clean":"2024-09-21T00:14:15.967544+0000","last_became_active":"2024-09-21T00:14:09.966351+0000","last_became_peered":"2024-09-21T00:14:09.966351+0000","last_unstale":"2024-09-21T00:14:15.967544+0000","last_undegraded":"2024-09-21T00:14:15.967544+0000","last_fullsized":"2024-09-21T00:14:15.967544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:51.673086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977041+0000","last_change":"2024-09-21T00:14:14.002579+0000","last_active":"2024-09-21T00:14:14.977041+0000","last_peered":"2024-09-21T00:14:14.977041+0000","last_clean":"2024-09-21T00:14:14.977041+0000","last_became_active":"2024-09-21T00:14:13.998346+0000","last_became_peered":"2024-09-21T00:14:13.998346+0000","last_unstale":"2024-09-21T00:14:14.977041+0000","last_undegraded":"2024-09-21T00:14:14.977041+0000","last_fullsized":"2024-09-21T00:14:14.977041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:05.886343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967750+0000","last_change":"2024-09-21T00:14:08.969417+0000","last_active":"2024-09-21T00:14:15.967750+0000","last_peered":"2024-09-21T00:14:15.967750+0000","last_clean":"2024-09-21T00:14:15.967750+0000","last_became_active":"2024-09-21T00:14:08.969077+0000","last_became_peered":"2024-09-21T00:14:08.969077+0000","last_unstale":"2024-09-21T00:14:15.967750+0000","last_undegraded":"2024-09-21T00:14:15.967750+0000","last_fullsized":"2024-09-21T00:14:15.967750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:01.181700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967587+0000","last_change":"2024-09-21T00:14:09.975248+0000","last_active":"2024-09-21T00:14:15.967587+0000","last_peered":"2024-09-21T00:14:15.967587+0000","last_clean":"2024-09-21T00:14:15.967587+0000","last_became_active":"2024-09-21T00:14:09.974959+0000","last_became_peered":"2024-09-21T00:14:09.974959+0000","last_unstale":"2024-09-21T00:14:15.967587+0000","last_undegraded":"2024-09-21T00:14:15.967587+0000","last_fullsized":"2024-09-21T00:14:15.967587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:43.775786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973627+0000","last_change":"2024-09-21T00:14:14.001939+0000","last_active":"2024-09-21T00:14:14.973627+0000","last_peered":"2024-09-21T00:14:14.973627+0000","last_clean":"2024-09-21T00:14:14.973627+0000","last_became_active":"2024-09-21T00:14:14.001348+0000","last_became_peered":"2024-09-21T00:14:14.001348+0000","last_unstale":"2024-09-21T00:14:14.973627+0000","last_undegraded":"2024-09-21T00:14:14.973627+0000","last_fullsized":"2024-09-21T00:14:14.973627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:02.627970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123227+0000","last_change":"2024-09-21T00:14:08.964352+0000","last_active":"2024-09-21T00:14:16.123227+0000","last_peered":"2024-09-21T00:14:16.123227+0000","last_clean":"2024-09-21T00:14:16.123227+0000","last_became_active":"2024-09-21T00:14:08.958414+0000","last_became_peered":"2024-09-21T00:14:08.958414+0000","last_unstale":"2024-09-21T00:14:16.123227+0000","last_undegraded":"2024-09-21T00:14:16.123227+0000","last_fullsized":"2024-09-21T00:14:16.123227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:51.700187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123442+0000","last_change":"2024-09-21T00:14:09.962666+0000","last_active":"2024-09-21T00:14:16.123442+0000","last_peered":"2024-09-21T00:14:16.123442+0000","last_clean":"2024-09-21T00:14:16.123442+0000","last_became_active":"2024-09-21T00:14:09.961909+0000","last_became_peered":"2024-09-21T00:14:09.961909+0000","last_unstale":"2024-09-21T00:14:16.123442+0000","last_undegraded":"2024-09-21T00:14:16.123442+0000","last_fullsized":"2024-09-21T00:14:16.123442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:13.058730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974353+0000","last_change":"2024-09-21T00:14:14.009588+0000","last_active":"2024-09-21T00:14:14.974353+0000","last_peered":"2024-09-21T00:14:14.974353+0000","last_clean":"2024-09-21T00:14:14.974353+0000","last_became_active":"2024-09-21T00:14:14.008994+0000","last_became_peered":"2024-09-21T00:14:14.008994+0000","last_unstale":"2024-09-21T00:14:14.974353+0000","last_undegraded":"2024-09-21T00:14:14.974353+0000","last_fullsized":"2024-09-21T00:14:14.974353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:50.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122959+0000","last_change":"2024-09-21T00:14:08.962061+0000","last_active":"2024-09-21T00:14:16.122959+0000","last_peered":"2024-09-21T00:14:16.122959+0000","last_clean":"2024-09-21T00:14:16.122959+0000","last_became_active":"2024-09-21T00:14:08.961712+0000","last_became_peered":"2024-09-21T00:14:08.961712+0000","last_unstale":"2024-09-21T00:14:16.122959+0000","last_undegraded":"2024-09-21T00:14:16.122959+0000","last_fullsized":"2024-09-21T00:14:16.122959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:05:03.896547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500923+0000","last_change":"2024-09-21T00:14:09.957015+0000","last_active":"2024-09-21T00:14:15.500923+0000","last_peered":"2024-09-21T00:14:15.500923+0000","last_clean":"2024-09-21T00:14:15.500923+0000","last_became_active":"2024-09-21T00:14:09.956388+0000","last_became_peered":"2024-09-21T00:14:09.956388+0000","last_unstale":"2024-09-21T00:14:15.500923+0000","last_undegraded":"2024-09-21T00:14:15.500923+0000","last_fullsized":"2024-09-21T00:14:15.500923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:26.738282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973647+0000","last_change":"2024-09-21T00:14:14.004999+0000","last_active":"2024-09-21T00:14:14.973647+0000","last_peered":"2024-09-21T00:14:14.973647+0000","last_clean":"2024-09-21T00:14:14.973647+0000","last_became_active":"2024-09-21T00:14:14.003986+0000","last_became_peered":"2024-09-21T00:14:14.003986+0000","last_unstale":"2024-09-21T00:14:14.973647+0000","last_undegraded":"2024-09-21T00:14:14.973647+0000","last_fullsized":"2024-09-21T00:14:14.973647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:44.919521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500238+0000","last_change":"2024-09-21T00:14:09.955745+0000","last_active":"2024-09-21T00:14:15.500238+0000","last_peered":"2024-09-21T00:14:15.500238+0000","last_clean":"2024-09-21T00:14:15.500238+0000","last_became_active":"2024-09-21T00:14:09.954866+0000","last_became_peered":"2024-09-21T00:14:09.954866+0000","last_unstale":"2024-09-21T00:14:15.500238+0000","last_undegraded":"2024-09-21T00:14:15.500238+0000","last_fullsized":"2024-09-21T00:14:15.500238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:55.173826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500524+0000","last_change":"2024-09-21T00:14:08.962655+0000","last_active":"2024-09-21T00:14:15.500524+0000","last_peered":"2024-09-21T00:14:15.500524+0000","last_clean":"2024-09-21T00:14:15.500524+0000","last_became_active":"2024-09-21T00:14:08.962352+0000","last_became_peered":"2024-09-21T00:14:08.962352+0000","last_unstale":"2024-09-21T00:14:15.500524+0000","last_undegraded":"2024-09-21T00:14:15.500524+0000","last_fullsized":"2024-09-21T00:14:15.500524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:27.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500879+0000","last_change":"2024-09-21T00:14:14.006261+0000","last_active":"2024-09-21T00:14:15.500879+0000","last_peered":"2024-09-21T00:14:15.500879+0000","last_clean":"2024-09-21T00:14:15.500879+0000","last_became_active":"2024-09-21T00:14:14.003285+0000","last_became_peered":"2024-09-21T00:14:14.003285+0000","last_unstale":"2024-09-21T00:14:15.500879+0000","last_undegraded":"2024-09-21T00:14:15.500879+0000","last_fullsized":"2024-09-21T00:14:15.500879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:26.610299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977966+0000","last_change":"2024-09-21T00:14:09.955950+0000","last_active":"2024-09-21T00:14:14.977966+0000","last_peered":"2024-09-21T00:14:14.977966+0000","last_clean":"2024-09-21T00:14:14.977966+0000","last_became_active":"2024-09-21T00:14:09.953875+0000","last_became_peered":"2024-09-21T00:14:09.953875+0000","last_unstale":"2024-09-21T00:14:14.977966+0000","last_undegraded":"2024-09-21T00:14:14.977966+0000","last_fullsized":"2024-09-21T00:14:14.977966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123258+0000","last_change":"2024-09-21T00:14:08.969348+0000","last_active":"2024-09-21T00:14:16.123258+0000","last_peered":"2024-09-21T00:14:16.123258+0000","last_clean":"2024-09-21T00:14:16.123258+0000","last_became_active":"2024-09-21T00:14:08.969018+0000","last_became_peered":"2024-09-21T00:14:08.969018+0000","last_unstale":"2024-09-21T00:14:16.123258+0000","last_undegraded":"2024-09-21T00:14:16.123258+0000","last_fullsized":"2024-09-21T00:14:16.123258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:28.286333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122670+0000","last_change":"2024-09-21T00:14:13.994464+0000","last_active":"2024-09-21T00:14:16.122670+0000","last_peered":"2024-09-21T00:14:16.122670+0000","last_clean":"2024-09-21T00:14:16.122670+0000","last_became_active":"2024-09-21T00:14:13.993997+0000","last_became_peered":"2024-09-21T00:14:13.993997+0000","last_unstale":"2024-09-21T00:14:16.122670+0000","last_undegraded":"2024-09-21T00:14:16.122670+0000","last_fullsized":"2024-09-21T00:14:16.122670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:59.204344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977267+0000","last_change":"2024-09-21T00:14:09.944109+0000","last_active":"2024-09-21T00:14:14.977267+0000","last_peered":"2024-09-21T00:14:14.977267+0000","last_clean":"2024-09-21T00:14:14.977267+0000","last_became_active":"2024-09-21T00:14:09.943696+0000","last_became_peered":"2024-09-21T00:14:09.943696+0000","last_unstale":"2024-09-21T00:14:14.977267+0000","last_undegraded":"2024-09-21T00:14:14.977267+0000","last_fullsized":"2024-09-21T00:14:14.977267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:11.037361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978186+0000","last_change":"2024-09-21T00:14:08.952283+0000","last_active":"2024-09-21T00:14:14.978186+0000","last_peered":"2024-09-21T00:14:14.978186+0000","last_clean":"2024-09-21T00:14:14.978186+0000","last_became_active":"2024-09-21T00:14:08.951509+0000","last_became_peered":"2024-09-21T00:14:08.951509+0000","last_unstale":"2024-09-21T00:14:14.978186+0000","last_undegraded":"2024-09-21T00:14:14.978186+0000","last_fullsized":"2024-09-21T00:14:14.978186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:05.121425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979265+0000","last_change":"2024-09-21T00:14:14.009693+0000","last_active":"2024-09-21T00:14:14.979265+0000","last_peered":"2024-09-21T00:14:14.979265+0000","last_clean":"2024-09-21T00:14:14.979265+0000","last_became_active":"2024-09-21T00:14:14.009212+0000","last_became_peered":"2024-09-21T00:14:14.009212+0000","last_unstale":"2024-09-21T00:14:14.979265+0000","last_undegraded":"2024-09-21T00:14:14.979265+0000","last_fullsized":"2024-09-21T00:14:14.979265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:46.075015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500105+0000","last_change":"2024-09-21T00:14:09.952055+0000","last_active":"2024-09-21T00:14:15.500105+0000","last_peered":"2024-09-21T00:14:15.500105+0000","last_clean":"2024-09-21T00:14:15.500105+0000","last_became_active":"2024-09-21T00:14:09.951745+0000","last_became_peered":"2024-09-21T00:14:09.951745+0000","last_unstale":"2024-09-21T00:14:15.500105+0000","last_undegraded":"2024-09-21T00:14:15.500105+0000","last_fullsized":"2024-09-21T00:14:15.500105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:35.198862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.121996+0000","last_change":"2024-09-21T00:14:08.953140+0000","last_active":"2024-09-21T00:14:16.121996+0000","last_peered":"2024-09-21T00:14:16.121996+0000","last_clean":"2024-09-21T00:14:16.121996+0000","last_became_active":"2024-09-21T00:14:08.950002+0000","last_became_peered":"2024-09-21T00:14:08.950002+0000","last_unstale":"2024-09-21T00:14:16.121996+0000","last_undegraded":"2024-09-21T00:14:16.121996+0000","last_fullsized":"2024-09-21T00:14:16.121996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:05.121425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974140+0000","last_change":"2024-09-21T00:14:14.006167+0000","last_active":"2024-09-21T00:14:14.974140+0000","last_peered":"2024-09-21T00:14:14.974140+0000","last_clean":"2024-09-21T00:14:14.974140+0000","last_became_active":"2024-09-21T00:14:14.005001+0000","last_became_peered":"2024-09-21T00:14:14.005001+0000","last_unstale":"2024-09-21T00:14:14.974140+0000","last_undegraded":"2024-09-21T00:14:14.974140+0000","last_fullsized":"2024-09-21T00:14:14.974140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:57:27.249041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979047+0000","last_change":"2024-09-21T00:14:09.952929+0000","last_active":"2024-09-21T00:14:14.979047+0000","last_peered":"2024-09-21T00:14:14.979047+0000","last_clean":"2024-09-21T00:14:14.979047+0000","last_became_active":"2024-09-21T00:14:09.952574+0000","last_became_peered":"2024-09-21T00:14:09.952574+0000","last_unstale":"2024-09-21T00:14:14.979047+0000","last_undegraded":"2024-09-21T00:14:14.979047+0000","last_fullsized":"2024-09-21T00:14:14.979047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:02:57.284191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501092+0000","last_change":"2024-09-21T00:14:08.965568+0000","last_active":"2024-09-21T00:14:15.501092+0000","last_peered":"2024-09-21T00:14:15.501092+0000","last_clean":"2024-09-21T00:14:15.501092+0000","last_became_active":"2024-09-21T00:14:08.965239+0000","last_became_peered":"2024-09-21T00:14:08.965239+0000","last_unstale":"2024-09-21T00:14:15.501092+0000","last_undegraded":"2024-09-21T00:14:15.501092+0000","last_fullsized":"2024-09-21T00:14:15.501092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:00.848504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973649+0000","last_change":"2024-09-21T00:14:13.996979+0000","last_active":"2024-09-21T00:14:14.973649+0000","last_peered":"2024-09-21T00:14:14.973649+0000","last_clean":"2024-09-21T00:14:14.973649+0000","last_became_active":"2024-09-21T00:14:13.996457+0000","last_became_peered":"2024-09-21T00:14:13.996457+0000","last_unstale":"2024-09-21T00:14:14.973649+0000","last_undegraded":"2024-09-21T00:14:14.973649+0000","last_fullsized":"2024-09-21T00:14:14.973649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:14.192155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979358+0000","last_change":"2024-09-21T00:14:09.968623+0000","last_active":"2024-09-21T00:14:14.979358+0000","last_peered":"2024-09-21T00:14:14.979358+0000","last_clean":"2024-09-21T00:14:14.979358+0000","last_became_active":"2024-09-21T00:14:09.968243+0000","last_became_peered":"2024-09-21T00:14:09.968243+0000","last_unstale":"2024-09-21T00:14:14.979358+0000","last_undegraded":"2024-09-21T00:14:14.979358+0000","last_fullsized":"2024-09-21T00:14:14.979358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:54:02.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979198+0000","last_change":"2024-09-21T00:14:08.956965+0000","last_active":"2024-09-21T00:14:14.979198+0000","last_peered":"2024-09-21T00:14:14.979198+0000","last_clean":"2024-09-21T00:14:14.979198+0000","last_became_active":"2024-09-21T00:14:08.956594+0000","last_became_peered":"2024-09-21T00:14:08.956594+0000","last_unstale":"2024-09-21T00:14:14.979198+0000","last_undegraded":"2024-09-21T00:14:14.979198+0000","last_fullsized":"2024-09-21T00:14:14.979198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:51.700187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977217+0000","last_change":"2024-09-21T00:14:13.998452+0000","last_active":"2024-09-21T00:14:14.977217+0000","last_peered":"2024-09-21T00:14:14.977217+0000","last_clean":"2024-09-21T00:14:14.977217+0000","last_became_active":"2024-09-21T00:14:13.997896+0000","last_became_peered":"2024-09-21T00:14:13.997896+0000","last_unstale":"2024-09-21T00:14:14.977217+0000","last_undegraded":"2024-09-21T00:14:14.977217+0000","last_fullsized":"2024-09-21T00:14:14.977217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:06.050664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123575+0000","last_change":"2024-09-21T00:14:09.960305+0000","last_active":"2024-09-21T00:14:16.123575+0000","last_peered":"2024-09-21T00:14:16.123575+0000","last_clean":"2024-09-21T00:14:16.123575+0000","last_became_active":"2024-09-21T00:14:09.959991+0000","last_became_peered":"2024-09-21T00:14:09.959991+0000","last_unstale":"2024-09-21T00:14:16.123575+0000","last_undegraded":"2024-09-21T00:14:16.123575+0000","last_fullsized":"2024-09-21T00:14:16.123575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:01.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501177+0000","last_change":"2024-09-21T00:14:08.961047+0000","last_active":"2024-09-21T00:14:15.501177+0000","last_peered":"2024-09-21T00:14:15.501177+0000","last_clean":"2024-09-21T00:14:15.501177+0000","last_became_active":"2024-09-21T00:14:08.960716+0000","last_became_peered":"2024-09-21T00:14:08.960716+0000","last_unstale":"2024-09-21T00:14:15.501177+0000","last_undegraded":"2024-09-21T00:14:15.501177+0000","last_fullsized":"2024-09-21T00:14:15.501177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:06.314729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123221+0000","last_change":"2024-09-21T00:14:14.001333+0000","last_active":"2024-09-21T00:14:16.123221+0000","last_peered":"2024-09-21T00:14:16.123221+0000","last_clean":"2024-09-21T00:14:16.123221+0000","last_became_active":"2024-09-21T00:14:14.000838+0000","last_became_peered":"2024-09-21T00:14:14.000838+0000","last_unstale":"2024-09-21T00:14:16.123221+0000","last_undegraded":"2024-09-21T00:14:16.123221+0000","last_fullsized":"2024-09-21T00:14:16.123221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:04.996254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973835+0000","last_change":"2024-09-21T00:14:09.960278+0000","last_active":"2024-09-21T00:14:14.973835+0000","last_peered":"2024-09-21T00:14:14.973835+0000","last_clean":"2024-09-21T00:14:14.973835+0000","last_became_active":"2024-09-21T00:14:09.959949+0000","last_became_peered":"2024-09-21T00:14:09.959949+0000","last_unstale":"2024-09-21T00:14:14.973835+0000","last_undegraded":"2024-09-21T00:14:14.973835+0000","last_fullsized":"2024-09-21T00:14:14.973835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:09.105489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966906+0000","last_change":"2024-09-21T00:14:08.967871+0000","last_active":"2024-09-21T00:14:15.966906+0000","last_peered":"2024-09-21T00:14:15.966906+0000","last_clean":"2024-09-21T00:14:15.966906+0000","last_became_active":"2024-09-21T00:14:08.966840+0000","last_became_peered":"2024-09-21T00:14:08.966840+0000","last_unstale":"2024-09-21T00:14:15.966906+0000","last_undegraded":"2024-09-21T00:14:15.966906+0000","last_fullsized":"2024-09-21T00:14:15.966906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:12:50.931090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123068+0000","last_change":"2024-09-21T00:14:14.004129+0000","last_active":"2024-09-21T00:14:16.123068+0000","last_peered":"2024-09-21T00:14:16.123068+0000","last_clean":"2024-09-21T00:14:16.123068+0000","last_became_active":"2024-09-21T00:14:14.003631+0000","last_became_peered":"2024-09-21T00:14:14.003631+0000","last_unstale":"2024-09-21T00:14:16.123068+0000","last_undegraded":"2024-09-21T00:14:16.123068+0000","last_fullsized":"2024-09-21T00:14:16.123068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:31.535375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122448+0000","last_change":"2024-09-21T00:14:09.974665+0000","last_active":"2024-09-21T00:14:16.122448+0000","last_peered":"2024-09-21T00:14:16.122448+0000","last_clean":"2024-09-21T00:14:16.122448+0000","last_became_active":"2024-09-21T00:14:09.964253+0000","last_became_peered":"2024-09-21T00:14:09.964253+0000","last_unstale":"2024-09-21T00:14:16.122448+0000","last_undegraded":"2024-09-21T00:14:16.122448+0000","last_fullsized":"2024-09-21T00:14:16.122448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:40.707880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500462+0000","last_change":"2024-09-21T00:14:08.961331+0000","last_active":"2024-09-21T00:14:15.500462+0000","last_peered":"2024-09-21T00:14:15.500462+0000","last_clean":"2024-09-21T00:14:15.500462+0000","last_became_active":"2024-09-21T00:14:08.961064+0000","last_became_peered":"2024-09-21T00:14:08.961064+0000","last_unstale":"2024-09-21T00:14:15.500462+0000","last_undegraded":"2024-09-21T00:14:15.500462+0000","last_fullsized":"2024-09-21T00:14:15.500462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:09.528188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123408+0000","last_change":"2024-09-21T00:14:14.001325+0000","last_active":"2024-09-21T00:14:16.123408+0000","last_peered":"2024-09-21T00:14:16.123408+0000","last_clean":"2024-09-21T00:14:16.123408+0000","last_became_active":"2024-09-21T00:14:14.000838+0000","last_became_peered":"2024-09-21T00:14:14.000838+0000","last_unstale":"2024-09-21T00:14:16.123408+0000","last_undegraded":"2024-09-21T00:14:16.123408+0000","last_fullsized":"2024-09-21T00:14:16.123408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:14.306042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966733+0000","last_change":"2024-09-21T00:14:09.958391+0000","last_active":"2024-09-21T00:14:15.966733+0000","last_peered":"2024-09-21T00:14:15.966733+0000","last_clean":"2024-09-21T00:14:15.966733+0000","last_became_active":"2024-09-21T00:14:09.957844+0000","last_became_peered":"2024-09-21T00:14:09.957844+0000","last_unstale":"2024-09-21T00:14:15.966733+0000","last_undegraded":"2024-09-21T00:14:15.966733+0000","last_fullsized":"2024-09-21T00:14:15.966733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:30.770474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977238+0000","last_change":"2024-09-21T00:14:08.968128+0000","last_active":"2024-09-21T00:14:14.977238+0000","last_peered":"2024-09-21T00:14:14.977238+0000","last_clean":"2024-09-21T00:14:14.977238+0000","last_became_active":"2024-09-21T00:14:08.967257+0000","last_became_peered":"2024-09-21T00:14:08.967257+0000","last_unstale":"2024-09-21T00:14:14.977238+0000","last_undegraded":"2024-09-21T00:14:14.977238+0000","last_fullsized":"2024-09-21T00:14:14.977238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:03.075394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123840+0000","last_change":"2024-09-21T00:14:14.005119+0000","last_active":"2024-09-21T00:14:16.123840+0000","last_peered":"2024-09-21T00:14:16.123840+0000","last_clean":"2024-09-21T00:14:16.123840+0000","last_became_active":"2024-09-21T00:14:14.003742+0000","last_became_peered":"2024-09-21T00:14:14.003742+0000","last_unstale":"2024-09-21T00:14:16.123840+0000","last_undegraded":"2024-09-21T00:14:16.123840+0000","last_fullsized":"2024-09-21T00:14:16.123840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:06.050664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122838+0000","last_change":"2024-09-21T00:14:09.969231+0000","last_active":"2024-09-21T00:14:16.122838+0000","last_peered":"2024-09-21T00:14:16.122838+0000","last_clean":"2024-09-21T00:14:16.122838+0000","last_became_active":"2024-09-21T00:14:09.968567+0000","last_became_peered":"2024-09-21T00:14:09.968567+0000","last_unstale":"2024-09-21T00:14:16.122838+0000","last_undegraded":"2024-09-21T00:14:16.122838+0000","last_fullsized":"2024-09-21T00:14:16.122838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.302969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500274+0000","last_change":"2024-09-21T00:14:08.966891+0000","last_active":"2024-09-21T00:14:15.500274+0000","last_peered":"2024-09-21T00:14:15.500274+0000","last_clean":"2024-09-21T00:14:15.500274+0000","last_became_active":"2024-09-21T00:14:08.966521+0000","last_became_peered":"2024-09-21T00:14:08.966521+0000","last_unstale":"2024-09-21T00:14:15.500274+0000","last_undegraded":"2024-09-21T00:14:15.500274+0000","last_fullsized":"2024-09-21T00:14:15.500274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:17.687314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967312+0000","last_change":"2024-09-21T00:14:14.004905+0000","last_active":"2024-09-21T00:14:15.967312+0000","last_peered":"2024-09-21T00:14:15.967312+0000","last_clean":"2024-09-21T00:14:15.967312+0000","last_became_active":"2024-09-21T00:14:14.002340+0000","last_became_peered":"2024-09-21T00:14:14.002340+0000","last_unstale":"2024-09-21T00:14:15.967312+0000","last_undegraded":"2024-09-21T00:14:15.967312+0000","last_fullsized":"2024-09-21T00:14:15.967312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:46.951215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977585+0000","last_change":"2024-09-21T00:14:09.944543+0000","last_active":"2024-09-21T00:14:14.977585+0000","last_peered":"2024-09-21T00:14:14.977585+0000","last_clean":"2024-09-21T00:14:14.977585+0000","last_became_active":"2024-09-21T00:14:09.944211+0000","last_became_peered":"2024-09-21T00:14:09.944211+0000","last_unstale":"2024-09-21T00:14:14.977585+0000","last_undegraded":"2024-09-21T00:14:14.977585+0000","last_fullsized":"2024-09-21T00:14:14.977585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:26.273280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500607+0000","last_change":"2024-09-21T00:14:08.963265+0000","last_active":"2024-09-21T00:14:15.500607+0000","last_peered":"2024-09-21T00:14:15.500607+0000","last_clean":"2024-09-21T00:14:15.500607+0000","last_became_active":"2024-09-21T00:14:08.961984+0000","last_became_peered":"2024-09-21T00:14:08.961984+0000","last_unstale":"2024-09-21T00:14:15.500607+0000","last_undegraded":"2024-09-21T00:14:15.500607+0000","last_fullsized":"2024-09-21T00:14:15.500607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:23.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122745+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:14:16.122745+0000","last_peered":"2024-09-21T00:14:16.122745+0000","last_clean":"2024-09-21T00:14:16.122745+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:14:16.122745+0000","last_undegraded":"2024-09-21T00:14:16.122745+0000","last_fullsized":"2024-09-21T00:14:16.122745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501135+0000","last_change":"2024-09-21T00:14:13.987888+0000","last_active":"2024-09-21T00:14:15.501135+0000","last_peered":"2024-09-21T00:14:15.501135+0000","last_clean":"2024-09-21T00:14:15.501135+0000","last_became_active":"2024-09-21T00:14:13.987371+0000","last_became_peered":"2024-09-21T00:14:13.987371+0000","last_unstale":"2024-09-21T00:14:15.501135+0000","last_undegraded":"2024-09-21T00:14:15.501135+0000","last_fullsized":"2024-09-21T00:14:15.501135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:13.662595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500986+0000","last_change":"2024-09-21T00:14:09.976122+0000","last_active":"2024-09-21T00:14:15.500986+0000","last_peered":"2024-09-21T00:14:15.500986+0000","last_clean":"2024-09-21T00:14:15.500986+0000","last_became_active":"2024-09-21T00:14:09.975763+0000","last_became_peered":"2024-09-21T00:14:09.975763+0000","last_unstale":"2024-09-21T00:14:15.500986+0000","last_undegraded":"2024-09-21T00:14:15.500986+0000","last_fullsized":"2024-09-21T00:14:15.500986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:58.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123695+0000","last_change":"2024-09-21T00:14:08.965532+0000","last_active":"2024-09-21T00:14:16.123695+0000","last_peered":"2024-09-21T00:14:16.123695+0000","last_clean":"2024-09-21T00:14:16.123695+0000","last_became_active":"2024-09-21T00:14:08.965203+0000","last_became_peered":"2024-09-21T00:14:08.965203+0000","last_unstale":"2024-09-21T00:14:16.123695+0000","last_undegraded":"2024-09-21T00:14:16.123695+0000","last_fullsized":"2024-09-21T00:14:16.123695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:43:28.609507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973635+0000","last_change":"2024-09-21T00:14:14.010029+0000","last_active":"2024-09-21T00:14:14.973635+0000","last_peered":"2024-09-21T00:14:14.973635+0000","last_clean":"2024-09-21T00:14:14.973635+0000","last_became_active":"2024-09-21T00:14:14.009543+0000","last_became_peered":"2024-09-21T00:14:14.009543+0000","last_unstale":"2024-09-21T00:14:14.973635+0000","last_undegraded":"2024-09-21T00:14:14.973635+0000","last_fullsized":"2024-09-21T00:14:14.973635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:44.738397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122862+0000","last_change":"2024-09-21T00:14:09.956902+0000","last_active":"2024-09-21T00:14:16.122862+0000","last_peered":"2024-09-21T00:14:16.122862+0000","last_clean":"2024-09-21T00:14:16.122862+0000","last_became_active":"2024-09-21T00:14:09.956598+0000","last_became_peered":"2024-09-21T00:14:09.956598+0000","last_unstale":"2024-09-21T00:14:16.122862+0000","last_undegraded":"2024-09-21T00:14:16.122862+0000","last_fullsized":"2024-09-21T00:14:16.122862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:33.085847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967274+0000","last_change":"2024-09-21T00:14:08.960165+0000","last_active":"2024-09-21T00:14:15.967274+0000","last_peered":"2024-09-21T00:14:15.967274+0000","last_clean":"2024-09-21T00:14:15.967274+0000","last_became_active":"2024-09-21T00:14:08.959384+0000","last_became_peered":"2024-09-21T00:14:08.959384+0000","last_unstale":"2024-09-21T00:14:15.967274+0000","last_undegraded":"2024-09-21T00:14:15.967274+0000","last_fullsized":"2024-09-21T00:14:15.967274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:45.898250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967161+0000","last_change":"2024-09-21T00:14:13.991452+0000","last_active":"2024-09-21T00:14:15.967161+0000","last_peered":"2024-09-21T00:14:15.967161+0000","last_clean":"2024-09-21T00:14:15.967161+0000","last_became_active":"2024-09-21T00:14:13.991104+0000","last_became_peered":"2024-09-21T00:14:13.991104+0000","last_unstale":"2024-09-21T00:14:15.967161+0000","last_undegraded":"2024-09-21T00:14:15.967161+0000","last_fullsized":"2024-09-21T00:14:15.967161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:13.243815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123422+0000","last_change":"2024-09-21T00:14:09.965731+0000","last_active":"2024-09-21T00:14:16.123422+0000","last_peered":"2024-09-21T00:14:16.123422+0000","last_clean":"2024-09-21T00:14:16.123422+0000","last_became_active":"2024-09-21T00:14:09.965441+0000","last_became_peered":"2024-09-21T00:14:09.965441+0000","last_unstale":"2024-09-21T00:14:16.123422+0000","last_undegraded":"2024-09-21T00:14:16.123422+0000","last_fullsized":"2024-09-21T00:14:16.123422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:30.235970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979154+0000","last_change":"2024-09-21T00:14:08.956670+0000","last_active":"2024-09-21T00:14:14.979154+0000","last_peered":"2024-09-21T00:14:14.979154+0000","last_clean":"2024-09-21T00:14:14.979154+0000","last_became_active":"2024-09-21T00:14:08.955944+0000","last_became_peered":"2024-09-21T00:14:08.955944+0000","last_unstale":"2024-09-21T00:14:14.979154+0000","last_undegraded":"2024-09-21T00:14:14.979154+0000","last_fullsized":"2024-09-21T00:14:14.979154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:27.091939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500018+0000","last_change":"2024-09-21T00:14:13.993587+0000","last_active":"2024-09-21T00:14:15.500018+0000","last_peered":"2024-09-21T00:14:15.500018+0000","last_clean":"2024-09-21T00:14:15.500018+0000","last_became_active":"2024-09-21T00:14:13.993154+0000","last_became_peered":"2024-09-21T00:14:13.993154+0000","last_unstale":"2024-09-21T00:14:15.500018+0000","last_undegraded":"2024-09-21T00:14:15.500018+0000","last_fullsized":"2024-09-21T00:14:15.500018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:10.903336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974186+0000","last_change":"2024-09-21T00:14:09.956980+0000","last_active":"2024-09-21T00:14:14.974186+0000","last_peered":"2024-09-21T00:14:14.974186+0000","last_clean":"2024-09-21T00:14:14.974186+0000","last_became_active":"2024-09-21T00:14:09.956663+0000","last_became_peered":"2024-09-21T00:14:09.956663+0000","last_unstale":"2024-09-21T00:14:14.974186+0000","last_undegraded":"2024-09-21T00:14:14.974186+0000","last_fullsized":"2024-09-21T00:14:14.974186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.535510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123436+0000","last_change":"2024-09-21T00:14:08.962950+0000","last_active":"2024-09-21T00:14:16.123436+0000","last_peered":"2024-09-21T00:14:16.123436+0000","last_clean":"2024-09-21T00:14:16.123436+0000","last_became_active":"2024-09-21T00:14:08.962106+0000","last_became_peered":"2024-09-21T00:14:08.962106+0000","last_unstale":"2024-09-21T00:14:16.123436+0000","last_undegraded":"2024-09-21T00:14:16.123436+0000","last_fullsized":"2024-09-21T00:14:16.123436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:28.367381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123232+0000","last_change":"2024-09-21T00:14:13.998520+0000","last_active":"2024-09-21T00:14:16.123232+0000","last_peered":"2024-09-21T00:14:16.123232+0000","last_clean":"2024-09-21T00:14:16.123232+0000","last_became_active":"2024-09-21T00:14:13.998102+0000","last_became_peered":"2024-09-21T00:14:13.998102+0000","last_unstale":"2024-09-21T00:14:16.123232+0000","last_undegraded":"2024-09-21T00:14:16.123232+0000","last_fullsized":"2024-09-21T00:14:16.123232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:35.968823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500013+0000","last_change":"2024-09-21T00:14:09.971253+0000","last_active":"2024-09-21T00:14:15.500013+0000","last_peered":"2024-09-21T00:14:15.500013+0000","last_clean":"2024-09-21T00:14:15.500013+0000","last_became_active":"2024-09-21T00:14:09.966337+0000","last_became_peered":"2024-09-21T00:14:09.966337+0000","last_unstale":"2024-09-21T00:14:15.500013+0000","last_undegraded":"2024-09-21T00:14:15.500013+0000","last_fullsized":"2024-09-21T00:14:15.500013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:30.235970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977345+0000","last_change":"2024-09-21T00:14:08.956648+0000","last_active":"2024-09-21T00:14:14.977345+0000","last_peered":"2024-09-21T00:14:14.977345+0000","last_clean":"2024-09-21T00:14:14.977345+0000","last_became_active":"2024-09-21T00:14:08.956242+0000","last_became_peered":"2024-09-21T00:14:08.956242+0000","last_unstale":"2024-09-21T00:14:14.977345+0000","last_undegraded":"2024-09-21T00:14:14.977345+0000","last_fullsized":"2024-09-21T00:14:14.977345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:51:44.198197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967515+0000","last_change":"2024-09-21T00:14:14.010023+0000","last_active":"2024-09-21T00:14:15.967515+0000","last_peered":"2024-09-21T00:14:15.967515+0000","last_clean":"2024-09-21T00:14:15.967515+0000","last_became_active":"2024-09-21T00:14:14.009295+0000","last_became_peered":"2024-09-21T00:14:14.009295+0000","last_unstale":"2024-09-21T00:14:15.967515+0000","last_undegraded":"2024-09-21T00:14:15.967515+0000","last_fullsized":"2024-09-21T00:14:15.967515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:45.380314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122633+0000","last_change":"2024-09-21T00:14:09.958927+0000","last_active":"2024-09-21T00:14:16.122633+0000","last_peered":"2024-09-21T00:14:16.122633+0000","last_clean":"2024-09-21T00:14:16.122633+0000","last_became_active":"2024-09-21T00:14:09.958618+0000","last_became_peered":"2024-09-21T00:14:09.958618+0000","last_unstale":"2024-09-21T00:14:16.122633+0000","last_undegraded":"2024-09-21T00:14:16.122633+0000","last_fullsized":"2024-09-21T00:14:16.122633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122261+0000","last_change":"2024-09-21T00:14:08.962483+0000","last_active":"2024-09-21T00:14:16.122261+0000","last_peered":"2024-09-21T00:14:16.122261+0000","last_clean":"2024-09-21T00:14:16.122261+0000","last_became_active":"2024-09-21T00:14:08.961970+0000","last_became_peered":"2024-09-21T00:14:08.961970+0000","last_unstale":"2024-09-21T00:14:16.122261+0000","last_undegraded":"2024-09-21T00:14:16.122261+0000","last_fullsized":"2024-09-21T00:14:16.122261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:27.091939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967654+0000","last_change":"2024-09-21T00:14:13.994820+0000","last_active":"2024-09-21T00:14:15.967654+0000","last_peered":"2024-09-21T00:14:15.967654+0000","last_clean":"2024-09-21T00:14:15.967654+0000","last_became_active":"2024-09-21T00:14:13.994201+0000","last_became_peered":"2024-09-21T00:14:13.994201+0000","last_unstale":"2024-09-21T00:14:15.967654+0000","last_undegraded":"2024-09-21T00:14:15.967654+0000","last_fullsized":"2024-09-21T00:14:15.967654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.660541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500240+0000","last_change":"2024-09-21T00:14:09.954424+0000","last_active":"2024-09-21T00:14:15.500240+0000","last_peered":"2024-09-21T00:14:15.500240+0000","last_clean":"2024-09-21T00:14:15.500240+0000","last_became_active":"2024-09-21T00:14:09.953451+0000","last_became_peered":"2024-09-21T00:14:09.953451+0000","last_unstale":"2024-09-21T00:14:15.500240+0000","last_undegraded":"2024-09-21T00:14:15.500240+0000","last_fullsized":"2024-09-21T00:14:15.500240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:02.131667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500383+0000","last_change":"2024-09-21T00:14:08.955470+0000","last_active":"2024-09-21T00:14:15.500383+0000","last_peered":"2024-09-21T00:14:15.500383+0000","last_clean":"2024-09-21T00:14:15.500383+0000","last_became_active":"2024-09-21T00:14:08.952599+0000","last_became_peered":"2024-09-21T00:14:08.952599+0000","last_unstale":"2024-09-21T00:14:15.500383+0000","last_undegraded":"2024-09-21T00:14:15.500383+0000","last_fullsized":"2024-09-21T00:14:15.500383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:16.644911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123459+0000","last_change":"2024-09-21T00:14:14.004819+0000","last_active":"2024-09-21T00:14:16.123459+0000","last_peered":"2024-09-21T00:14:16.123459+0000","last_clean":"2024-09-21T00:14:16.123459+0000","last_became_active":"2024-09-21T00:14:14.003284+0000","last_became_peered":"2024-09-21T00:14:14.003284+0000","last_unstale":"2024-09-21T00:14:16.123459+0000","last_undegraded":"2024-09-21T00:14:16.123459+0000","last_fullsized":"2024-09-21T00:14:16.123459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:56:35.976927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123069+0000","last_change":"2024-09-21T00:14:09.966769+0000","last_active":"2024-09-21T00:14:16.123069+0000","last_peered":"2024-09-21T00:14:16.123069+0000","last_clean":"2024-09-21T00:14:16.123069+0000","last_became_active":"2024-09-21T00:14:09.966448+0000","last_became_peered":"2024-09-21T00:14:09.966448+0000","last_unstale":"2024-09-21T00:14:16.123069+0000","last_undegraded":"2024-09-21T00:14:16.123069+0000","last_fullsized":"2024-09-21T00:14:16.123069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978213+0000","last_change":"2024-09-21T00:14:08.967528+0000","last_active":"2024-09-21T00:14:14.978213+0000","last_peered":"2024-09-21T00:14:14.978213+0000","last_clean":"2024-09-21T00:14:14.978213+0000","last_became_active":"2024-09-21T00:14:08.966897+0000","last_became_peered":"2024-09-21T00:14:08.966897+0000","last_unstale":"2024-09-21T00:14:14.978213+0000","last_undegraded":"2024-09-21T00:14:14.978213+0000","last_fullsized":"2024-09-21T00:14:14.978213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:51:44.198197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501045+0000","last_change":"2024-09-21T00:14:13.989994+0000","last_active":"2024-09-21T00:14:15.501045+0000","last_peered":"2024-09-21T00:14:15.501045+0000","last_clean":"2024-09-21T00:14:15.501045+0000","last_became_active":"2024-09-21T00:14:13.989524+0000","last_became_peered":"2024-09-21T00:14:13.989524+0000","last_unstale":"2024-09-21T00:14:15.501045+0000","last_undegraded":"2024-09-21T00:14:15.501045+0000","last_fullsized":"2024-09-21T00:14:15.501045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:45.169356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123101+0000","last_change":"2024-09-21T00:14:09.955385+0000","last_active":"2024-09-21T00:14:16.123101+0000","last_peered":"2024-09-21T00:14:16.123101+0000","last_clean":"2024-09-21T00:14:16.123101+0000","last_became_active":"2024-09-21T00:14:09.955031+0000","last_became_peered":"2024-09-21T00:14:09.955031+0000","last_unstale":"2024-09-21T00:14:16.123101+0000","last_undegraded":"2024-09-21T00:14:16.123101+0000","last_fullsized":"2024-09-21T00:14:16.123101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:27.504857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:21.039817+0000","last_change":"2024-09-21T00:14:08.950520+0000","last_active":"2024-09-21T00:14:21.039817+0000","last_peered":"2024-09-21T00:14:21.039817+0000","last_clean":"2024-09-21T00:14:21.039817+0000","last_became_active":"2024-09-21T00:14:08.950052+0000","last_became_peered":"2024-09-21T00:14:08.950052+0000","last_unstale":"2024-09-21T00:14:21.039817+0000","last_undegraded":"2024-09-21T00:14:21.039817+0000","last_fullsized":"2024-09-21T00:14:21.039817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:03.572976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977762+0000","last_change":"2024-09-21T00:14:13.991051+0000","last_active":"2024-09-21T00:14:14.977762+0000","last_peered":"2024-09-21T00:14:14.977762+0000","last_clean":"2024-09-21T00:14:14.977762+0000","last_became_active":"2024-09-21T00:14:13.990544+0000","last_became_peered":"2024-09-21T00:14:13.990544+0000","last_unstale":"2024-09-21T00:14:14.977762+0000","last_undegraded":"2024-09-21T00:14:14.977762+0000","last_fullsized":"2024-09-21T00:14:14.977762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:21.835935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500587+0000","last_change":"2024-09-21T00:14:09.967875+0000","last_active":"2024-09-21T00:14:15.500587+0000","last_peered":"2024-09-21T00:14:15.500587+0000","last_clean":"2024-09-21T00:14:15.500587+0000","last_became_active":"2024-09-21T00:14:09.966515+0000","last_became_peered":"2024-09-21T00:14:09.966515+0000","last_unstale":"2024-09-21T00:14:15.500587+0000","last_undegraded":"2024-09-21T00:14:15.500587+0000","last_fullsized":"2024-09-21T00:14:15.500587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:18:31.266375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978569+0000","last_change":"2024-09-21T00:14:08.963443+0000","last_active":"2024-09-21T00:14:14.978569+0000","last_peered":"2024-09-21T00:14:14.978569+0000","last_clean":"2024-09-21T00:14:14.978569+0000","last_became_active":"2024-09-21T00:14:08.963001+0000","last_became_peered":"2024-09-21T00:14:08.963001+0000","last_unstale":"2024-09-21T00:14:14.978569+0000","last_undegraded":"2024-09-21T00:14:14.978569+0000","last_fullsized":"2024-09-21T00:14:14.978569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:38.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974431+0000","last_change":"2024-09-21T00:14:14.004423+0000","last_active":"2024-09-21T00:14:14.974431+0000","last_peered":"2024-09-21T00:14:14.974431+0000","last_clean":"2024-09-21T00:14:14.974431+0000","last_became_active":"2024-09-21T00:14:14.003993+0000","last_became_peered":"2024-09-21T00:14:14.003993+0000","last_unstale":"2024-09-21T00:14:14.974431+0000","last_undegraded":"2024-09-21T00:14:14.974431+0000","last_fullsized":"2024-09-21T00:14:14.974431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:07:20.224751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967722+0000","last_change":"2024-09-21T00:14:09.971797+0000","last_active":"2024-09-21T00:14:15.967722+0000","last_peered":"2024-09-21T00:14:15.967722+0000","last_clean":"2024-09-21T00:14:15.967722+0000","last_became_active":"2024-09-21T00:14:09.971424+0000","last_became_peered":"2024-09-21T00:14:09.971424+0000","last_unstale":"2024-09-21T00:14:15.967722+0000","last_undegraded":"2024-09-21T00:14:15.967722+0000","last_fullsized":"2024-09-21T00:14:15.967722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:26.244909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122745+0000","last_change":"2024-09-21T00:14:08.946131+0000","last_active":"2024-09-21T00:14:16.122745+0000","last_peered":"2024-09-21T00:14:16.122745+0000","last_clean":"2024-09-21T00:14:16.122745+0000","last_became_active":"2024-09-21T00:14:08.945798+0000","last_became_peered":"2024-09-21T00:14:08.945798+0000","last_unstale":"2024-09-21T00:14:16.122745+0000","last_undegraded":"2024-09-21T00:14:16.122745+0000","last_fullsized":"2024-09-21T00:14:16.122745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:19.481209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.976886+0000","last_change":"2024-09-21T00:14:14.009826+0000","last_active":"2024-09-21T00:14:14.976886+0000","last_peered":"2024-09-21T00:14:14.976886+0000","last_clean":"2024-09-21T00:14:14.976886+0000","last_became_active":"2024-09-21T00:14:14.009239+0000","last_became_peered":"2024-09-21T00:14:14.009239+0000","last_unstale":"2024-09-21T00:14:14.976886+0000","last_undegraded":"2024-09-21T00:14:14.976886+0000","last_fullsized":"2024-09-21T00:14:14.976886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:11.352568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974080+0000","last_change":"2024-09-21T00:14:09.961500+0000","last_active":"2024-09-21T00:14:14.974080+0000","last_peered":"2024-09-21T00:14:14.974080+0000","last_clean":"2024-09-21T00:14:14.974080+0000","last_became_active":"2024-09-21T00:14:09.960752+0000","last_became_peered":"2024-09-21T00:14:09.960752+0000","last_unstale":"2024-09-21T00:14:14.974080+0000","last_undegraded":"2024-09-21T00:14:14.974080+0000","last_fullsized":"2024-09-21T00:14:14.974080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123962+0000","last_change":"2024-09-21T00:14:08.951923+0000","last_active":"2024-09-21T00:14:16.123962+0000","last_peered":"2024-09-21T00:14:16.123962+0000","last_clean":"2024-09-21T00:14:16.123962+0000","last_became_active":"2024-09-21T00:14:08.947804+0000","last_became_peered":"2024-09-21T00:14:08.947804+0000","last_unstale":"2024-09-21T00:14:16.123962+0000","last_undegraded":"2024-09-21T00:14:16.123962+0000","last_fullsized":"2024-09-21T00:14:16.123962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:28.286333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977974+0000","last_change":"2024-09-21T00:14:13.997051+0000","last_active":"2024-09-21T00:14:14.977974+0000","last_peered":"2024-09-21T00:14:14.977974+0000","last_clean":"2024-09-21T00:14:14.977974+0000","last_became_active":"2024-09-21T00:14:13.996692+0000","last_became_peered":"2024-09-21T00:14:13.996692+0000","last_unstale":"2024-09-21T00:14:14.977974+0000","last_undegraded":"2024-09-21T00:14:14.977974+0000","last_fullsized":"2024-09-21T00:14:14.977974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:37.116365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979061+0000","last_change":"2024-09-21T00:14:13.993380+0000","last_active":"2024-09-21T00:14:14.979061+0000","last_peered":"2024-09-21T00:14:14.979061+0000","last_clean":"2024-09-21T00:14:14.979061+0000","last_became_active":"2024-09-21T00:14:13.992819+0000","last_became_peered":"2024-09-21T00:14:13.992819+0000","last_unstale":"2024-09-21T00:14:14.979061+0000","last_undegraded":"2024-09-21T00:14:14.979061+0000","last_fullsized":"2024-09-21T00:14:14.979061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.855429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978052+0000","last_change":"2024-09-21T00:14:09.962777+0000","last_active":"2024-09-21T00:14:14.978052+0000","last_peered":"2024-09-21T00:14:14.978052+0000","last_clean":"2024-09-21T00:14:14.978052+0000","last_became_active":"2024-09-21T00:14:09.962489+0000","last_became_peered":"2024-09-21T00:14:09.962489+0000","last_unstale":"2024-09-21T00:14:14.978052+0000","last_undegraded":"2024-09-21T00:14:14.978052+0000","last_fullsized":"2024-09-21T00:14:14.978052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:21.354918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500237+0000","last_change":"2024-09-21T00:14:08.955114+0000","last_active":"2024-09-21T00:14:15.500237+0000","last_peered":"2024-09-21T00:14:15.500237+0000","last_clean":"2024-09-21T00:14:15.500237+0000","last_became_active":"2024-09-21T00:14:08.954028+0000","last_became_peered":"2024-09-21T00:14:08.954028+0000","last_unstale":"2024-09-21T00:14:15.500237+0000","last_undegraded":"2024-09-21T00:14:15.500237+0000","last_fullsized":"2024-09-21T00:14:15.500237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:19.481209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500943+0000","last_change":"2024-09-21T00:14:13.993411+0000","last_active":"2024-09-21T00:14:15.500943+0000","last_peered":"2024-09-21T00:14:15.500943+0000","last_clean":"2024-09-21T00:14:15.500943+0000","last_became_active":"2024-09-21T00:14:13.992997+0000","last_became_peered":"2024-09-21T00:14:13.992997+0000","last_unstale":"2024-09-21T00:14:15.500943+0000","last_undegraded":"2024-09-21T00:14:15.500943+0000","last_fullsized":"2024-09-21T00:14:15.500943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:22.418960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967109+0000","last_change":"2024-09-21T00:14:09.962686+0000","last_active":"2024-09-21T00:14:15.967109+0000","last_peered":"2024-09-21T00:14:15.967109+0000","last_clean":"2024-09-21T00:14:15.967109+0000","last_became_active":"2024-09-21T00:14:09.961140+0000","last_became_peered":"2024-09-21T00:14:09.961140+0000","last_unstale":"2024-09-21T00:14:15.967109+0000","last_undegraded":"2024-09-21T00:14:15.967109+0000","last_fullsized":"2024-09-21T00:14:15.967109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:30.146682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122851+0000","last_change":"2024-09-21T00:14:08.961705+0000","last_active":"2024-09-21T00:14:16.122851+0000","last_peered":"2024-09-21T00:14:16.122851+0000","last_clean":"2024-09-21T00:14:16.122851+0000","last_became_active":"2024-09-21T00:14:08.961362+0000","last_became_peered":"2024-09-21T00:14:08.961362+0000","last_unstale":"2024-09-21T00:14:16.122851+0000","last_undegraded":"2024-09-21T00:14:16.122851+0000","last_fullsized":"2024-09-21T00:14:16.122851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:17.677016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500354+0000","last_change":"2024-09-21T00:14:08.967458+0000","last_active":"2024-09-21T00:14:15.500354+0000","last_peered":"2024-09-21T00:14:15.500354+0000","last_clean":"2024-09-21T00:14:15.500354+0000","last_became_active":"2024-09-21T00:14:08.966663+0000","last_became_peered":"2024-09-21T00:14:08.966663+0000","last_unstale":"2024-09-21T00:14:15.500354+0000","last_undegraded":"2024-09-21T00:14:15.500354+0000","last_fullsized":"2024-09-21T00:14:15.500354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:12.051409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978414+0000","last_change":"2024-09-21T00:14:09.955928+0000","last_active":"2024-09-21T00:14:14.978414+0000","last_peered":"2024-09-21T00:14:14.978414+0000","last_clean":"2024-09-21T00:14:14.978414+0000","last_became_active":"2024-09-21T00:14:09.955523+0000","last_became_peered":"2024-09-21T00:14:09.955523+0000","last_unstale":"2024-09-21T00:14:14.978414+0000","last_undegraded":"2024-09-21T00:14:14.978414+0000","last_fullsized":"2024-09-21T00:14:14.978414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:16.513288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978979+0000","last_change":"2024-09-21T00:14:14.003528+0000","last_active":"2024-09-21T00:14:14.978979+0000","last_peered":"2024-09-21T00:14:14.978979+0000","last_clean":"2024-09-21T00:14:14.978979+0000","last_became_active":"2024-09-21T00:14:14.002941+0000","last_became_peered":"2024-09-21T00:14:14.002941+0000","last_unstale":"2024-09-21T00:14:14.978979+0000","last_undegraded":"2024-09-21T00:14:14.978979+0000","last_fullsized":"2024-09-21T00:14:14.978979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:21.996124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967341+0000","last_change":"2024-09-21T00:14:08.968392+0000","last_active":"2024-09-21T00:14:15.967341+0000","last_peered":"2024-09-21T00:14:15.967341+0000","last_clean":"2024-09-21T00:14:15.967341+0000","last_became_active":"2024-09-21T00:14:08.967708+0000","last_became_peered":"2024-09-21T00:14:08.967708+0000","last_unstale":"2024-09-21T00:14:15.967341+0000","last_undegraded":"2024-09-21T00:14:15.967341+0000","last_fullsized":"2024-09-21T00:14:15.967341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:36.352016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123057+0000","last_change":"2024-09-21T00:14:09.961926+0000","last_active":"2024-09-21T00:14:16.123057+0000","last_peered":"2024-09-21T00:14:16.123057+0000","last_clean":"2024-09-21T00:14:16.123057+0000","last_became_active":"2024-09-21T00:14:09.961227+0000","last_became_peered":"2024-09-21T00:14:09.961227+0000","last_unstale":"2024-09-21T00:14:16.123057+0000","last_undegraded":"2024-09-21T00:14:16.123057+0000","last_fullsized":"2024-09-21T00:14:16.123057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978238+0000","last_change":"2024-09-21T00:14:14.013035+0000","last_active":"2024-09-21T00:14:14.978238+0000","last_peered":"2024-09-21T00:14:14.978238+0000","last_clean":"2024-09-21T00:14:14.978238+0000","last_became_active":"2024-09-21T00:14:14.011549+0000","last_became_peered":"2024-09-21T00:14:14.011549+0000","last_unstale":"2024-09-21T00:14:14.978238+0000","last_undegraded":"2024-09-21T00:14:14.978238+0000","last_fullsized":"2024-09-21T00:14:14.978238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:20.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973538+0000","last_change":"2024-09-21T00:14:09.960154+0000","last_active":"2024-09-21T00:14:14.973538+0000","last_peered":"2024-09-21T00:14:14.973538+0000","last_clean":"2024-09-21T00:14:14.973538+0000","last_became_active":"2024-09-21T00:14:09.959838+0000","last_became_peered":"2024-09-21T00:14:09.959838+0000","last_unstale":"2024-09-21T00:14:14.973538+0000","last_undegraded":"2024-09-21T00:14:14.973538+0000","last_fullsized":"2024-09-21T00:14:14.973538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977119+0000","last_change":"2024-09-21T00:14:09.961472+0000","last_active":"2024-09-21T00:14:14.977119+0000","last_peered":"2024-09-21T00:14:14.977119+0000","last_clean":"2024-09-21T00:14:14.977119+0000","last_became_active":"2024-09-21T00:14:09.961159+0000","last_became_peered":"2024-09-21T00:14:09.961159+0000","last_unstale":"2024-09-21T00:14:14.977119+0000","last_undegraded":"2024-09-21T00:14:14.977119+0000","last_fullsized":"2024-09-21T00:14:14.977119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:18.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500115+0000","last_change":"2024-09-21T00:14:09.960102+0000","last_active":"2024-09-21T00:14:15.500115+0000","last_peered":"2024-09-21T00:14:15.500115+0000","last_clean":"2024-09-21T00:14:15.500115+0000","last_became_active":"2024-09-21T00:14:09.959770+0000","last_became_peered":"2024-09-21T00:14:09.959770+0000","last_unstale":"2024-09-21T00:14:15.500115+0000","last_undegraded":"2024-09-21T00:14:15.500115+0000","last_fullsized":"2024-09-21T00:14:15.500115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:48:17.648660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967160+0000","last_change":"2024-09-21T00:14:09.967922+0000","last_active":"2024-09-21T00:14:15.967160+0000","last_peered":"2024-09-21T00:14:15.967160+0000","last_clean":"2024-09-21T00:14:15.967160+0000","last_became_active":"2024-09-21T00:14:09.964230+0000","last_became_peered":"2024-09-21T00:14:09.964230+0000","last_unstale":"2024-09-21T00:14:15.967160+0000","last_undegraded":"2024-09-21T00:14:15.967160+0000","last_fullsized":"2024-09-21T00:14:15.967160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:12.855251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123529+0000","last_change":"2024-09-21T00:14:09.971876+0000","last_active":"2024-09-21T00:14:16.123529+0000","last_peered":"2024-09-21T00:14:16.123529+0000","last_clean":"2024-09-21T00:14:16.123529+0000","last_became_active":"2024-09-21T00:14:09.968741+0000","last_became_peered":"2024-09-21T00:14:09.968741+0000","last_unstale":"2024-09-21T00:14:16.123529+0000","last_undegraded":"2024-09-21T00:14:16.123529+0000","last_fullsized":"2024-09-21T00:14:16.123529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:16.513288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123468+0000","last_change":"2024-09-21T00:14:09.957134+0000","last_active":"2024-09-21T00:14:16.123468+0000","last_peered":"2024-09-21T00:14:16.123468+0000","last_clean":"2024-09-21T00:14:16.123468+0000","last_became_active":"2024-09-21T00:14:09.956848+0000","last_became_peered":"2024-09-21T00:14:09.956848+0000","last_unstale":"2024-09-21T00:14:16.123468+0000","last_undegraded":"2024-09-21T00:14:16.123468+0000","last_fullsized":"2024-09-21T00:14:16.123468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:42.044497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973970+0000","last_change":"2024-09-21T00:14:09.969393+0000","last_active":"2024-09-21T00:14:14.973970+0000","last_peered":"2024-09-21T00:14:14.973970+0000","last_clean":"2024-09-21T00:14:14.973970+0000","last_became_active":"2024-09-21T00:14:09.967322+0000","last_became_peered":"2024-09-21T00:14:09.967322+0000","last_unstale":"2024-09-21T00:14:14.973970+0000","last_undegraded":"2024-09-21T00:14:14.973970+0000","last_fullsized":"2024-09-21T00:14:14.973970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:13.058730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967420+0000","last_change":"2024-09-21T00:14:09.975534+0000","last_active":"2024-09-21T00:14:15.967420+0000","last_peered":"2024-09-21T00:14:15.967420+0000","last_clean":"2024-09-21T00:14:15.967420+0000","last_became_active":"2024-09-21T00:14:09.975223+0000","last_became_peered":"2024-09-21T00:14:09.975223+0000","last_unstale":"2024-09-21T00:14:15.967420+0000","last_undegraded":"2024-09-21T00:14:15.967420+0000","last_fullsized":"2024-09-21T00:14:15.967420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:34.284952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500162+0000","last_change":"2024-09-21T00:14:09.955799+0000","last_active":"2024-09-21T00:14:15.500162+0000","last_peered":"2024-09-21T00:14:15.500162+0000","last_clean":"2024-09-21T00:14:15.500162+0000","last_became_active":"2024-09-21T00:14:09.955490+0000","last_became_peered":"2024-09-21T00:14:09.955490+0000","last_unstale":"2024-09-21T00:14:15.500162+0000","last_undegraded":"2024-09-21T00:14:15.500162+0000","last_fullsized":"2024-09-21T00:14:15.500162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:17.805417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966906+0000","last_change":"2024-09-21T00:14:09.967087+0000","last_active":"2024-09-21T00:14:15.966906+0000","last_peered":"2024-09-21T00:14:15.966906+0000","last_clean":"2024-09-21T00:14:15.966906+0000","last_became_active":"2024-09-21T00:14:09.966758+0000","last_became_peered":"2024-09-21T00:14:09.966758+0000","last_unstale":"2024-09-21T00:14:15.966906+0000","last_undegraded":"2024-09-21T00:14:15.966906+0000","last_fullsized":"2024-09-21T00:14:15.966906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:56.369574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122953+0000","last_change":"2024-09-21T00:14:09.959275+0000","last_active":"2024-09-21T00:14:16.122953+0000","last_peered":"2024-09-21T00:14:16.122953+0000","last_clean":"2024-09-21T00:14:16.122953+0000","last_became_active":"2024-09-21T00:14:09.956637+0000","last_became_peered":"2024-09-21T00:14:09.956637+0000","last_unstale":"2024-09-21T00:14:16.122953+0000","last_undegraded":"2024-09-21T00:14:16.122953+0000","last_fullsized":"2024-09-21T00:14:16.122953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:18.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978300+0000","last_change":"2024-09-21T00:14:09.966758+0000","last_active":"2024-09-21T00:14:14.978300+0000","last_peered":"2024-09-21T00:14:14.978300+0000","last_clean":"2024-09-21T00:14:14.978300+0000","last_became_active":"2024-09-21T00:14:09.966435+0000","last_became_peered":"2024-09-21T00:14:09.966435+0000","last_unstale":"2024-09-21T00:14:14.978300+0000","last_undegraded":"2024-09-21T00:14:14.978300+0000","last_fullsized":"2024-09-21T00:14:14.978300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:14.814291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122756+0000","last_change":"2024-09-21T00:14:09.970050+0000","last_active":"2024-09-21T00:14:16.122756+0000","last_peered":"2024-09-21T00:14:16.122756+0000","last_clean":"2024-09-21T00:14:16.122756+0000","last_became_active":"2024-09-21T00:14:09.969400+0000","last_became_peered":"2024-09-21T00:14:09.969400+0000","last_unstale":"2024-09-21T00:14:16.122756+0000","last_undegraded":"2024-09-21T00:14:16.122756+0000","last_fullsized":"2024-09-21T00:14:16.122756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:10.275524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501120+0000","last_change":"2024-09-21T00:14:09.967005+0000","last_active":"2024-09-21T00:14:15.501120+0000","last_peered":"2024-09-21T00:14:15.501120+0000","last_clean":"2024-09-21T00:14:15.501120+0000","last_became_active":"2024-09-21T00:14:09.966713+0000","last_became_peered":"2024-09-21T00:14:09.966713+0000","last_unstale":"2024-09-21T00:14:15.501120+0000","last_undegraded":"2024-09-21T00:14:15.501120+0000","last_fullsized":"2024-09-21T00:14:15.501120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:46.902750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978761+0000","last_change":"2024-09-21T00:14:09.963493+0000","last_active":"2024-09-21T00:14:14.978761+0000","last_peered":"2024-09-21T00:14:14.978761+0000","last_clean":"2024-09-21T00:14:14.978761+0000","last_became_active":"2024-09-21T00:14:09.963165+0000","last_became_peered":"2024-09-21T00:14:09.963165+0000","last_unstale":"2024-09-21T00:14:14.978761+0000","last_undegraded":"2024-09-21T00:14:14.978761+0000","last_fullsized":"2024-09-21T00:14:14.978761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501052+0000","last_change":"2024-09-21T00:14:09.958838+0000","last_active":"2024-09-21T00:14:15.501052+0000","last_peered":"2024-09-21T00:14:15.501052+0000","last_clean":"2024-09-21T00:14:15.501052+0000","last_became_active":"2024-09-21T00:14:09.958571+0000","last_became_peered":"2024-09-21T00:14:09.958571+0000","last_unstale":"2024-09-21T00:14:15.501052+0000","last_undegraded":"2024-09-21T00:14:15.501052+0000","last_fullsized":"2024-09-21T00:14:15.501052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:25.477700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500012+0000","last_change":"2024-09-21T00:14:09.966624+0000","last_active":"2024-09-21T00:14:15.500012+0000","last_peered":"2024-09-21T00:14:15.500012+0000","last_clean":"2024-09-21T00:14:15.500012+0000","last_became_active":"2024-09-21T00:14:09.966263+0000","last_became_peered":"2024-09-21T00:14:09.966263+0000","last_unstale":"2024-09-21T00:14:15.500012+0000","last_undegraded":"2024-09-21T00:14:15.500012+0000","last_fullsized":"2024-09-21T00:14:15.500012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:34.688163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966562+0000","last_change":"2024-09-21T00:14:09.968374+0000","last_active":"2024-09-21T00:14:15.966562+0000","last_peered":"2024-09-21T00:14:15.966562+0000","last_clean":"2024-09-21T00:14:15.966562+0000","last_became_active":"2024-09-21T00:14:09.966302+0000","last_became_peered":"2024-09-21T00:14:09.966302+0000","last_unstale":"2024-09-21T00:14:15.966562+0000","last_undegraded":"2024-09-21T00:14:15.966562+0000","last_fullsized":"2024-09-21T00:14:15.966562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:02.471950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122938+0000","last_change":"2024-09-21T00:14:09.957691+0000","last_active":"2024-09-21T00:14:16.122938+0000","last_peered":"2024-09-21T00:14:16.122938+0000","last_clean":"2024-09-21T00:14:16.122938+0000","last_became_active":"2024-09-21T00:14:09.957412+0000","last_became_peered":"2024-09-21T00:14:09.957412+0000","last_unstale":"2024-09-21T00:14:16.122938+0000","last_undegraded":"2024-09-21T00:14:16.122938+0000","last_fullsized":"2024-09-21T00:14:16.122938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.535510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123180+0000","last_change":"2024-09-21T00:14:09.975745+0000","last_active":"2024-09-21T00:14:16.123180+0000","last_peered":"2024-09-21T00:14:16.123180+0000","last_clean":"2024-09-21T00:14:16.123180+0000","last_became_active":"2024-09-21T00:14:09.975384+0000","last_became_peered":"2024-09-21T00:14:09.975384+0000","last_unstale":"2024-09-21T00:14:16.123180+0000","last_undegraded":"2024-09-21T00:14:16.123180+0000","last_fullsized":"2024-09-21T00:14:16.123180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:07.322051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123056+0000","last_change":"2024-09-21T00:14:09.969705+0000","last_active":"2024-09-21T00:14:16.123056+0000","last_peered":"2024-09-21T00:14:16.123056+0000","last_clean":"2024-09-21T00:14:16.123056+0000","last_became_active":"2024-09-21T00:14:09.969022+0000","last_became_peered":"2024-09-21T00:14:09.969022+0000","last_unstale":"2024-09-21T00:14:16.123056+0000","last_undegraded":"2024-09-21T00:14:16.123056+0000","last_fullsized":"2024-09-21T00:14:16.123056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:00.965737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123003+0000","last_change":"2024-09-21T00:14:09.967788+0000","last_active":"2024-09-21T00:14:16.123003+0000","last_peered":"2024-09-21T00:14:16.123003+0000","last_clean":"2024-09-21T00:14:16.123003+0000","last_became_active":"2024-09-21T00:14:09.967437+0000","last_became_peered":"2024-09-21T00:14:09.967437+0000","last_unstale":"2024-09-21T00:14:16.123003+0000","last_undegraded":"2024-09-21T00:14:16.123003+0000","last_fullsized":"2024-09-21T00:14:16.123003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:10.161637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122640+0000","last_change":"2024-09-21T00:14:09.964594+0000","last_active":"2024-09-21T00:14:16.122640+0000","last_peered":"2024-09-21T00:14:16.122640+0000","last_clean":"2024-09-21T00:14:16.122640+0000","last_became_active":"2024-09-21T00:14:09.964239+0000","last_became_peered":"2024-09-21T00:14:09.964239+0000","last_unstale":"2024-09-21T00:14:16.122640+0000","last_undegraded":"2024-09-21T00:14:16.122640+0000","last_fullsized":"2024-09-21T00:14:16.122640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:17.805417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123967+0000","last_change":"2024-09-21T00:14:09.970898+0000","last_active":"2024-09-21T00:14:16.123967+0000","last_peered":"2024-09-21T00:14:16.123967+0000","last_clean":"2024-09-21T00:14:16.123967+0000","last_became_active":"2024-09-21T00:14:09.970587+0000","last_became_peered":"2024-09-21T00:14:09.970587+0000","last_unstale":"2024-09-21T00:14:16.123967+0000","last_undegraded":"2024-09-21T00:14:16.123967+0000","last_fullsized":"2024-09-21T00:14:16.123967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966562+0000","last_change":"2024-09-21T00:14:09.967642+0000","last_active":"2024-09-21T00:14:15.966562+0000","last_peered":"2024-09-21T00:14:15.966562+0000","last_clean":"2024-09-21T00:14:15.966562+0000","last_became_active":"2024-09-21T00:14:09.967322+0000","last_became_peered":"2024-09-21T00:14:09.967322+0000","last_unstale":"2024-09-21T00:14:15.966562+0000","last_undegraded":"2024-09-21T00:14:15.966562+0000","last_fullsized":"2024-09-21T00:14:15.966562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:40.005906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122249+0000","last_change":"2024-09-21T00:14:09.953742+0000","last_active":"2024-09-21T00:14:16.122249+0000","last_peered":"2024-09-21T00:14:16.122249+0000","last_clean":"2024-09-21T00:14:16.122249+0000","last_became_active":"2024-09-21T00:14:09.953446+0000","last_became_peered":"2024-09-21T00:14:09.953446+0000","last_unstale":"2024-09-21T00:14:16.122249+0000","last_undegraded":"2024-09-21T00:14:16.122249+0000","last_fullsized":"2024-09-21T00:14:16.122249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:02:57.284191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973747+0000","last_change":"2024-09-21T00:14:09.955667+0000","last_active":"2024-09-21T00:14:14.973747+0000","last_peered":"2024-09-21T00:14:14.973747+0000","last_clean":"2024-09-21T00:14:14.973747+0000","last_became_active":"2024-09-21T00:14:09.955303+0000","last_became_peered":"2024-09-21T00:14:09.955303+0000","last_unstale":"2024-09-21T00:14:14.973747+0000","last_undegraded":"2024-09-21T00:14:14.973747+0000","last_fullsized":"2024-09-21T00:14:14.973747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122650+0000","last_change":"2024-09-21T00:14:09.964455+0000","last_active":"2024-09-21T00:14:16.122650+0000","last_peered":"2024-09-21T00:14:16.122650+0000","last_clean":"2024-09-21T00:14:16.122650+0000","last_became_active":"2024-09-21T00:14:09.964121+0000","last_became_peered":"2024-09-21T00:14:09.964121+0000","last_unstale":"2024-09-21T00:14:16.122650+0000","last_undegraded":"2024-09-21T00:14:16.122650+0000","last_fullsized":"2024-09-21T00:14:16.122650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:02.020147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973720+0000","last_change":"2024-09-21T00:14:09.944636+0000","last_active":"2024-09-21T00:14:14.973720+0000","last_peered":"2024-09-21T00:14:14.973720+0000","last_clean":"2024-09-21T00:14:14.973720+0000","last_became_active":"2024-09-21T00:14:09.944026+0000","last_became_peered":"2024-09-21T00:14:09.944026+0000","last_unstale":"2024-09-21T00:14:14.973720+0000","last_undegraded":"2024-09-21T00:14:14.973720+0000","last_fullsized":"2024-09-21T00:14:14.973720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.302969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967108+0000","last_change":"2024-09-21T00:14:09.969613+0000","last_active":"2024-09-21T00:14:15.967108+0000","last_peered":"2024-09-21T00:14:15.967108+0000","last_clean":"2024-09-21T00:14:15.967108+0000","last_became_active":"2024-09-21T00:14:09.969262+0000","last_became_peered":"2024-09-21T00:14:09.969262+0000","last_unstale":"2024-09-21T00:14:15.967108+0000","last_undegraded":"2024-09-21T00:14:15.967108+0000","last_fullsized":"2024-09-21T00:14:15.967108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:39.405316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967234+0000","last_change":"2024-09-21T00:14:09.960527+0000","last_active":"2024-09-21T00:14:15.967234+0000","last_peered":"2024-09-21T00:14:15.967234+0000","last_clean":"2024-09-21T00:14:15.967234+0000","last_became_active":"2024-09-21T00:14:09.960225+0000","last_became_peered":"2024-09-21T00:14:09.960225+0000","last_unstale":"2024-09-21T00:14:15.967234+0000","last_undegraded":"2024-09-21T00:14:15.967234+0000","last_fullsized":"2024-09-21T00:14:15.967234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:48.961824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123379+0000","last_change":"2024-09-21T00:14:09.977233+0000","last_active":"2024-09-21T00:14:16.123379+0000","last_peered":"2024-09-21T00:14:16.123379+0000","last_clean":"2024-09-21T00:14:16.123379+0000","last_became_active":"2024-09-21T00:14:09.968098+0000","last_became_peered":"2024-09-21T00:14:09.968098+0000","last_unstale":"2024-09-21T00:14:16.123379+0000","last_undegraded":"2024-09-21T00:14:16.123379+0000","last_fullsized":"2024-09-21T00:14:16.123379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:56:31.946410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":303104,"data_stored":113298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":112626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:14:28.460 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:14:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.714+0000 7fabbbe00640 1 -- 172.21.15.83:0/3370945519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabb4160100 msgr2=0x7fabb4160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.714+0000 7fabbbe00640 1 --2- 172.21.15.83:0/3370945519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabb4160100 0x7fabb4160510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fabb415d7e0 tx=0x7fabac02aa10 comp rx=0 tx=0).stop 2024-09-21T00:14:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.715+0000 7fabbbe00640 1 -- 172.21.15.83:0/3370945519 shutdown_connections 2024-09-21T00:14:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.715+0000 7fabbbe00640 1 --2- 172.21.15.83:0/3370945519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabb4160100 0x7fabb4160510 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.715+0000 7fabbbe00640 1 --2- 172.21.15.83:0/3370945519 >> v2:172.21.15.142:3300/0 conn(0x7fabb40d12e0 0x7fabb40d16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.715+0000 7fabbbe00640 1 --2- 172.21.15.83:0/3370945519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabb415cb10 0x7fabb415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.715+0000 7fabbbe00640 1 -- 172.21.15.83:0/3370945519 >> 172.21.15.83:0/3370945519 conn(0x7fabb40d2350 msgr2=0x7fabb40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:28.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.715+0000 7fabbbe00640 1 -- 172.21.15.83:0/3370945519 shutdown_connections 2024-09-21T00:14:28.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.715+0000 7fabbbe00640 1 -- 172.21.15.83:0/3370945519 wait complete. 2024-09-21T00:14:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.717+0000 7fabbbe00640 1 Processor -- start 2024-09-21T00:14:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.717+0000 7fabbbe00640 1 -- start start 2024-09-21T00:14:28.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.718+0000 7fabbbe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabb40d12e0 0x7fabb41f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:28.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.718+0000 7fabbbe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabb415cb10 0x7fabb4155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:28.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.718+0000 7fabbbe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb4160100 0x7fabb4156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:28.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabbbe00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fabb4160bd0 con 0x7fabb40d12e0 2024-09-21T00:14:28.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabbbe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fabb4160a50 con 0x7fabb4160100 2024-09-21T00:14:28.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabbbe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fabb4160d50 con 0x7fabb415cb10 2024-09-21T00:14:28.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabb40d12e0 0x7fabb41f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:28.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabb40d12e0 0x7fabb41f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46442/0 (socket says 172.21.15.83:46442) 2024-09-21T00:14:28.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9400640 1 -- 172.21.15.83:0/1399769934 learned_addr learned my addr 172.21.15.83:0/1399769934 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb8a00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabb415cb10 0x7fabb4155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9e00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb4160100 0x7fabb4156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9400640 1 -- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabb415cb10 msgr2=0x7fabb4155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9400640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabb415cb10 0x7fabb4155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9400640 1 -- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb4160100 msgr2=0x7fabb4156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9400640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb4160100 0x7fabb4156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9400640 1 -- 172.21.15.83:0/1399769934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb41f94b0 con 0x7fabb40d12e0 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9e00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb4160100 0x7fabb4156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.719+0000 7fabb9400640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabb40d12e0 0x7fabb41f8560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faba800c970 tx=0x7faba800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.720+0000 7fabb1600640 1 -- 172.21.15.83:0/1399769934 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8007b50 con 0x7fabb40d12e0 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.720+0000 7fabb1600640 1 -- 172.21.15.83:0/1399769934 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faba8007de0 con 0x7fabb40d12e0 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.720+0000 7fabb1600640 1 -- 172.21.15.83:0/1399769934 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba800f6b0 con 0x7fabb40d12e0 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.720+0000 7fabbbe00640 1 -- 172.21.15.83:0/1399769934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb41f9790 con 0x7fabb40d12e0 2024-09-21T00:14:28.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.720+0000 7fabbbe00640 1 -- 172.21.15.83:0/1399769934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb41e8310 con 0x7fabb40d12e0 2024-09-21T00:14:28.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.721+0000 7fabbbe00640 1 -- 172.21.15.83:0/1399769934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb415eef0 con 0x7fabb40d12e0 2024-09-21T00:14:28.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.722+0000 7fabb1600640 1 -- 172.21.15.83:0/1399769934 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faba800f850 con 0x7fabb40d12e0 2024-09-21T00:14:28.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.723+0000 7fabb1600640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fab94078b90 0x7fab9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:28.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.723+0000 7fabb1600640 1 -- 172.21.15.83:0/1399769934 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7faba809b800 con 0x7fabb40d12e0 2024-09-21T00:14:28.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.723+0000 7fabb8a00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fab94078b90 0x7fab9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:28.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.724+0000 7fabb8a00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fab94078b90 0x7fab9407b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fabb40d1b40 tx=0x7faba000a460 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:28.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.727+0000 7fabb1600640 1 -- 172.21.15.83:0/1399769934 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fabb415eef0 con 0x7fabb40d12e0 2024-09-21T00:14:28.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.911+0000 7fabbbe00640 1 -- 172.21.15.83:0/1399769934 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabb41f9260 con 0x7fab94078b90 2024-09-21T00:14:28.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.918+0000 7fabb1600640 1 -- 172.21.15.83:0/1399769934 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332555 (secure 0 0 0) 0x7fabb41f9260 con 0x7fab94078b90 2024-09-21T00:14:28.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:28.925 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:14:28.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.922+0000 7fabbbe00640 1 -- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fab94078b90 msgr2=0x7fab9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:28.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.922+0000 7fabbbe00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fab94078b90 0x7fab9407b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fabb40d1b40 tx=0x7faba000a460 comp rx=0 tx=0).stop 2024-09-21T00:14:28.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.923+0000 7fabbbe00640 1 -- 172.21.15.83:0/1399769934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabb40d12e0 msgr2=0x7fabb41f8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:28.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.923+0000 7fabbbe00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabb40d12e0 0x7fabb41f8560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faba800c970 tx=0x7faba800ce30 comp rx=0 tx=0).stop 2024-09-21T00:14:28.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.923+0000 7fabbbe00640 1 -- 172.21.15.83:0/1399769934 shutdown_connections 2024-09-21T00:14:28.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.923+0000 7fabbbe00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fab94078b90 0x7fab9407b0a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.923+0000 7fabbbe00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb4160100 0x7fabb4156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.923+0000 7fabbbe00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabb415cb10 0x7fabb4155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.923+0000 7fabbbe00640 1 --2- 172.21.15.83:0/1399769934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabb40d12e0 0x7fabb41f8560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:28.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.923+0000 7fabbbe00640 1 -- 172.21.15.83:0/1399769934 >> 172.21.15.83:0/1399769934 conn(0x7fabb40d2350 msgr2=0x7fabb40b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:28.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.923+0000 7fabbbe00640 1 -- 172.21.15.83:0/1399769934 shutdown_connections 2024-09-21T00:14:28.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:28.923+0000 7fabbbe00640 1 -- 172.21.15.83:0/1399769934 wait complete. 2024-09-21T00:14:28.944 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-21T00:14:28.854271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219652,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755068,"statfs":{"total":773094113280,"available":772869189632,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003785"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979446+0000","last_change":"2024-09-21T00:14:08.955433+0000","last_active":"2024-09-21T00:14:14.979446+0000","last_peered":"2024-09-21T00:14:14.979446+0000","last_clean":"2024-09-21T00:14:14.979446+0000","last_became_active":"2024-09-21T00:14:08.955066+0000","last_became_peered":"2024-09-21T00:14:08.955066+0000","last_unstale":"2024-09-21T00:14:14.979446+0000","last_undegraded":"2024-09-21T00:14:14.979446+0000","last_fullsized":"2024-09-21T00:14:14.979446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:28.367381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967544+0000","last_change":"2024-09-21T00:14:09.966683+0000","last_active":"2024-09-21T00:14:15.967544+0000","last_peered":"2024-09-21T00:14:15.967544+0000","last_clean":"2024-09-21T00:14:15.967544+0000","last_became_active":"2024-09-21T00:14:09.966351+0000","last_became_peered":"2024-09-21T00:14:09.966351+0000","last_unstale":"2024-09-21T00:14:15.967544+0000","last_undegraded":"2024-09-21T00:14:15.967544+0000","last_fullsized":"2024-09-21T00:14:15.967544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:51.673086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977041+0000","last_change":"2024-09-21T00:14:14.002579+0000","last_active":"2024-09-21T00:14:14.977041+0000","last_peered":"2024-09-21T00:14:14.977041+0000","last_clean":"2024-09-21T00:14:14.977041+0000","last_became_active":"2024-09-21T00:14:13.998346+0000","last_became_peered":"2024-09-21T00:14:13.998346+0000","last_unstale":"2024-09-21T00:14:14.977041+0000","last_undegraded":"2024-09-21T00:14:14.977041+0000","last_fullsized":"2024-09-21T00:14:14.977041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:05.886343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967750+0000","last_change":"2024-09-21T00:14:08.969417+0000","last_active":"2024-09-21T00:14:15.967750+0000","last_peered":"2024-09-21T00:14:15.967750+0000","last_clean":"2024-09-21T00:14:15.967750+0000","last_became_active":"2024-09-21T00:14:08.969077+0000","last_became_peered":"2024-09-21T00:14:08.969077+0000","last_unstale":"2024-09-21T00:14:15.967750+0000","last_undegraded":"2024-09-21T00:14:15.967750+0000","last_fullsized":"2024-09-21T00:14:15.967750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:01.181700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967587+0000","last_change":"2024-09-21T00:14:09.975248+0000","last_active":"2024-09-21T00:14:15.967587+0000","last_peered":"2024-09-21T00:14:15.967587+0000","last_clean":"2024-09-21T00:14:15.967587+0000","last_became_active":"2024-09-21T00:14:09.974959+0000","last_became_peered":"2024-09-21T00:14:09.974959+0000","last_unstale":"2024-09-21T00:14:15.967587+0000","last_undegraded":"2024-09-21T00:14:15.967587+0000","last_fullsized":"2024-09-21T00:14:15.967587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:43.775786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973627+0000","last_change":"2024-09-21T00:14:14.001939+0000","last_active":"2024-09-21T00:14:14.973627+0000","last_peered":"2024-09-21T00:14:14.973627+0000","last_clean":"2024-09-21T00:14:14.973627+0000","last_became_active":"2024-09-21T00:14:14.001348+0000","last_became_peered":"2024-09-21T00:14:14.001348+0000","last_unstale":"2024-09-21T00:14:14.973627+0000","last_undegraded":"2024-09-21T00:14:14.973627+0000","last_fullsized":"2024-09-21T00:14:14.973627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:02.627970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123227+0000","last_change":"2024-09-21T00:14:08.964352+0000","last_active":"2024-09-21T00:14:16.123227+0000","last_peered":"2024-09-21T00:14:16.123227+0000","last_clean":"2024-09-21T00:14:16.123227+0000","last_became_active":"2024-09-21T00:14:08.958414+0000","last_became_peered":"2024-09-21T00:14:08.958414+0000","last_unstale":"2024-09-21T00:14:16.123227+0000","last_undegraded":"2024-09-21T00:14:16.123227+0000","last_fullsized":"2024-09-21T00:14:16.123227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:51.700187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123442+0000","last_change":"2024-09-21T00:14:09.962666+0000","last_active":"2024-09-21T00:14:16.123442+0000","last_peered":"2024-09-21T00:14:16.123442+0000","last_clean":"2024-09-21T00:14:16.123442+0000","last_became_active":"2024-09-21T00:14:09.961909+0000","last_became_peered":"2024-09-21T00:14:09.961909+0000","last_unstale":"2024-09-21T00:14:16.123442+0000","last_undegraded":"2024-09-21T00:14:16.123442+0000","last_fullsized":"2024-09-21T00:14:16.123442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:13.058730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974353+0000","last_change":"2024-09-21T00:14:14.009588+0000","last_active":"2024-09-21T00:14:14.974353+0000","last_peered":"2024-09-21T00:14:14.974353+0000","last_clean":"2024-09-21T00:14:14.974353+0000","last_became_active":"2024-09-21T00:14:14.008994+0000","last_became_peered":"2024-09-21T00:14:14.008994+0000","last_unstale":"2024-09-21T00:14:14.974353+0000","last_undegraded":"2024-09-21T00:14:14.974353+0000","last_fullsized":"2024-09-21T00:14:14.974353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:50.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122959+0000","last_change":"2024-09-21T00:14:08.962061+0000","last_active":"2024-09-21T00:14:16.122959+0000","last_peered":"2024-09-21T00:14:16.122959+0000","last_clean":"2024-09-21T00:14:16.122959+0000","last_became_active":"2024-09-21T00:14:08.961712+0000","last_became_peered":"2024-09-21T00:14:08.961712+0000","last_unstale":"2024-09-21T00:14:16.122959+0000","last_undegraded":"2024-09-21T00:14:16.122959+0000","last_fullsized":"2024-09-21T00:14:16.122959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:05:03.896547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500923+0000","last_change":"2024-09-21T00:14:09.957015+0000","last_active":"2024-09-21T00:14:15.500923+0000","last_peered":"2024-09-21T00:14:15.500923+0000","last_clean":"2024-09-21T00:14:15.500923+0000","last_became_active":"2024-09-21T00:14:09.956388+0000","last_became_peered":"2024-09-21T00:14:09.956388+0000","last_unstale":"2024-09-21T00:14:15.500923+0000","last_undegraded":"2024-09-21T00:14:15.500923+0000","last_fullsized":"2024-09-21T00:14:15.500923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:26.738282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973647+0000","last_change":"2024-09-21T00:14:14.004999+0000","last_active":"2024-09-21T00:14:14.973647+0000","last_peered":"2024-09-21T00:14:14.973647+0000","last_clean":"2024-09-21T00:14:14.973647+0000","last_became_active":"2024-09-21T00:14:14.003986+0000","last_became_peered":"2024-09-21T00:14:14.003986+0000","last_unstale":"2024-09-21T00:14:14.973647+0000","last_undegraded":"2024-09-21T00:14:14.973647+0000","last_fullsized":"2024-09-21T00:14:14.973647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:44.919521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500238+0000","last_change":"2024-09-21T00:14:09.955745+0000","last_active":"2024-09-21T00:14:15.500238+0000","last_peered":"2024-09-21T00:14:15.500238+0000","last_clean":"2024-09-21T00:14:15.500238+0000","last_became_active":"2024-09-21T00:14:09.954866+0000","last_became_peered":"2024-09-21T00:14:09.954866+0000","last_unstale":"2024-09-21T00:14:15.500238+0000","last_undegraded":"2024-09-21T00:14:15.500238+0000","last_fullsized":"2024-09-21T00:14:15.500238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:55.173826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500524+0000","last_change":"2024-09-21T00:14:08.962655+0000","last_active":"2024-09-21T00:14:15.500524+0000","last_peered":"2024-09-21T00:14:15.500524+0000","last_clean":"2024-09-21T00:14:15.500524+0000","last_became_active":"2024-09-21T00:14:08.962352+0000","last_became_peered":"2024-09-21T00:14:08.962352+0000","last_unstale":"2024-09-21T00:14:15.500524+0000","last_undegraded":"2024-09-21T00:14:15.500524+0000","last_fullsized":"2024-09-21T00:14:15.500524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:27.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500879+0000","last_change":"2024-09-21T00:14:14.006261+0000","last_active":"2024-09-21T00:14:15.500879+0000","last_peered":"2024-09-21T00:14:15.500879+0000","last_clean":"2024-09-21T00:14:15.500879+0000","last_became_active":"2024-09-21T00:14:14.003285+0000","last_became_peered":"2024-09-21T00:14:14.003285+0000","last_unstale":"2024-09-21T00:14:15.500879+0000","last_undegraded":"2024-09-21T00:14:15.500879+0000","last_fullsized":"2024-09-21T00:14:15.500879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:26.610299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977966+0000","last_change":"2024-09-21T00:14:09.955950+0000","last_active":"2024-09-21T00:14:14.977966+0000","last_peered":"2024-09-21T00:14:14.977966+0000","last_clean":"2024-09-21T00:14:14.977966+0000","last_became_active":"2024-09-21T00:14:09.953875+0000","last_became_peered":"2024-09-21T00:14:09.953875+0000","last_unstale":"2024-09-21T00:14:14.977966+0000","last_undegraded":"2024-09-21T00:14:14.977966+0000","last_fullsized":"2024-09-21T00:14:14.977966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123258+0000","last_change":"2024-09-21T00:14:08.969348+0000","last_active":"2024-09-21T00:14:16.123258+0000","last_peered":"2024-09-21T00:14:16.123258+0000","last_clean":"2024-09-21T00:14:16.123258+0000","last_became_active":"2024-09-21T00:14:08.969018+0000","last_became_peered":"2024-09-21T00:14:08.969018+0000","last_unstale":"2024-09-21T00:14:16.123258+0000","last_undegraded":"2024-09-21T00:14:16.123258+0000","last_fullsized":"2024-09-21T00:14:16.123258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:28.286333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122670+0000","last_change":"2024-09-21T00:14:13.994464+0000","last_active":"2024-09-21T00:14:16.122670+0000","last_peered":"2024-09-21T00:14:16.122670+0000","last_clean":"2024-09-21T00:14:16.122670+0000","last_became_active":"2024-09-21T00:14:13.993997+0000","last_became_peered":"2024-09-21T00:14:13.993997+0000","last_unstale":"2024-09-21T00:14:16.122670+0000","last_undegraded":"2024-09-21T00:14:16.122670+0000","last_fullsized":"2024-09-21T00:14:16.122670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:59.204344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977267+0000","last_change":"2024-09-21T00:14:09.944109+0000","last_active":"2024-09-21T00:14:14.977267+0000","last_peered":"2024-09-21T00:14:14.977267+0000","last_clean":"2024-09-21T00:14:14.977267+0000","last_became_active":"2024-09-21T00:14:09.943696+0000","last_became_peered":"2024-09-21T00:14:09.943696+0000","last_unstale":"2024-09-21T00:14:14.977267+0000","last_undegraded":"2024-09-21T00:14:14.977267+0000","last_fullsized":"2024-09-21T00:14:14.977267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:11.037361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978186+0000","last_change":"2024-09-21T00:14:08.952283+0000","last_active":"2024-09-21T00:14:14.978186+0000","last_peered":"2024-09-21T00:14:14.978186+0000","last_clean":"2024-09-21T00:14:14.978186+0000","last_became_active":"2024-09-21T00:14:08.951509+0000","last_became_peered":"2024-09-21T00:14:08.951509+0000","last_unstale":"2024-09-21T00:14:14.978186+0000","last_undegraded":"2024-09-21T00:14:14.978186+0000","last_fullsized":"2024-09-21T00:14:14.978186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:05.121425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979265+0000","last_change":"2024-09-21T00:14:14.009693+0000","last_active":"2024-09-21T00:14:14.979265+0000","last_peered":"2024-09-21T00:14:14.979265+0000","last_clean":"2024-09-21T00:14:14.979265+0000","last_became_active":"2024-09-21T00:14:14.009212+0000","last_became_peered":"2024-09-21T00:14:14.009212+0000","last_unstale":"2024-09-21T00:14:14.979265+0000","last_undegraded":"2024-09-21T00:14:14.979265+0000","last_fullsized":"2024-09-21T00:14:14.979265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:46.075015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500105+0000","last_change":"2024-09-21T00:14:09.952055+0000","last_active":"2024-09-21T00:14:15.500105+0000","last_peered":"2024-09-21T00:14:15.500105+0000","last_clean":"2024-09-21T00:14:15.500105+0000","last_became_active":"2024-09-21T00:14:09.951745+0000","last_became_peered":"2024-09-21T00:14:09.951745+0000","last_unstale":"2024-09-21T00:14:15.500105+0000","last_undegraded":"2024-09-21T00:14:15.500105+0000","last_fullsized":"2024-09-21T00:14:15.500105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:35.198862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.121996+0000","last_change":"2024-09-21T00:14:08.953140+0000","last_active":"2024-09-21T00:14:16.121996+0000","last_peered":"2024-09-21T00:14:16.121996+0000","last_clean":"2024-09-21T00:14:16.121996+0000","last_became_active":"2024-09-21T00:14:08.950002+0000","last_became_peered":"2024-09-21T00:14:08.950002+0000","last_unstale":"2024-09-21T00:14:16.121996+0000","last_undegraded":"2024-09-21T00:14:16.121996+0000","last_fullsized":"2024-09-21T00:14:16.121996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:05.121425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974140+0000","last_change":"2024-09-21T00:14:14.006167+0000","last_active":"2024-09-21T00:14:14.974140+0000","last_peered":"2024-09-21T00:14:14.974140+0000","last_clean":"2024-09-21T00:14:14.974140+0000","last_became_active":"2024-09-21T00:14:14.005001+0000","last_became_peered":"2024-09-21T00:14:14.005001+0000","last_unstale":"2024-09-21T00:14:14.974140+0000","last_undegraded":"2024-09-21T00:14:14.974140+0000","last_fullsized":"2024-09-21T00:14:14.974140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:57:27.249041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979047+0000","last_change":"2024-09-21T00:14:09.952929+0000","last_active":"2024-09-21T00:14:14.979047+0000","last_peered":"2024-09-21T00:14:14.979047+0000","last_clean":"2024-09-21T00:14:14.979047+0000","last_became_active":"2024-09-21T00:14:09.952574+0000","last_became_peered":"2024-09-21T00:14:09.952574+0000","last_unstale":"2024-09-21T00:14:14.979047+0000","last_undegraded":"2024-09-21T00:14:14.979047+0000","last_fullsized":"2024-09-21T00:14:14.979047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:02:57.284191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501092+0000","last_change":"2024-09-21T00:14:08.965568+0000","last_active":"2024-09-21T00:14:15.501092+0000","last_peered":"2024-09-21T00:14:15.501092+0000","last_clean":"2024-09-21T00:14:15.501092+0000","last_became_active":"2024-09-21T00:14:08.965239+0000","last_became_peered":"2024-09-21T00:14:08.965239+0000","last_unstale":"2024-09-21T00:14:15.501092+0000","last_undegraded":"2024-09-21T00:14:15.501092+0000","last_fullsized":"2024-09-21T00:14:15.501092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:00.848504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973649+0000","last_change":"2024-09-21T00:14:13.996979+0000","last_active":"2024-09-21T00:14:14.973649+0000","last_peered":"2024-09-21T00:14:14.973649+0000","last_clean":"2024-09-21T00:14:14.973649+0000","last_became_active":"2024-09-21T00:14:13.996457+0000","last_became_peered":"2024-09-21T00:14:13.996457+0000","last_unstale":"2024-09-21T00:14:14.973649+0000","last_undegraded":"2024-09-21T00:14:14.973649+0000","last_fullsized":"2024-09-21T00:14:14.973649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:14.192155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979358+0000","last_change":"2024-09-21T00:14:09.968623+0000","last_active":"2024-09-21T00:14:14.979358+0000","last_peered":"2024-09-21T00:14:14.979358+0000","last_clean":"2024-09-21T00:14:14.979358+0000","last_became_active":"2024-09-21T00:14:09.968243+0000","last_became_peered":"2024-09-21T00:14:09.968243+0000","last_unstale":"2024-09-21T00:14:14.979358+0000","last_undegraded":"2024-09-21T00:14:14.979358+0000","last_fullsized":"2024-09-21T00:14:14.979358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:54:02.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979198+0000","last_change":"2024-09-21T00:14:08.956965+0000","last_active":"2024-09-21T00:14:14.979198+0000","last_peered":"2024-09-21T00:14:14.979198+0000","last_clean":"2024-09-21T00:14:14.979198+0000","last_became_active":"2024-09-21T00:14:08.956594+0000","last_became_peered":"2024-09-21T00:14:08.956594+0000","last_unstale":"2024-09-21T00:14:14.979198+0000","last_undegraded":"2024-09-21T00:14:14.979198+0000","last_fullsized":"2024-09-21T00:14:14.979198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:51.700187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977217+0000","last_change":"2024-09-21T00:14:13.998452+0000","last_active":"2024-09-21T00:14:14.977217+0000","last_peered":"2024-09-21T00:14:14.977217+0000","last_clean":"2024-09-21T00:14:14.977217+0000","last_became_active":"2024-09-21T00:14:13.997896+0000","last_became_peered":"2024-09-21T00:14:13.997896+0000","last_unstale":"2024-09-21T00:14:14.977217+0000","last_undegraded":"2024-09-21T00:14:14.977217+0000","last_fullsized":"2024-09-21T00:14:14.977217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:06.050664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123575+0000","last_change":"2024-09-21T00:14:09.960305+0000","last_active":"2024-09-21T00:14:16.123575+0000","last_peered":"2024-09-21T00:14:16.123575+0000","last_clean":"2024-09-21T00:14:16.123575+0000","last_became_active":"2024-09-21T00:14:09.959991+0000","last_became_peered":"2024-09-21T00:14:09.959991+0000","last_unstale":"2024-09-21T00:14:16.123575+0000","last_undegraded":"2024-09-21T00:14:16.123575+0000","last_fullsized":"2024-09-21T00:14:16.123575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:01.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501177+0000","last_change":"2024-09-21T00:14:08.961047+0000","last_active":"2024-09-21T00:14:15.501177+0000","last_peered":"2024-09-21T00:14:15.501177+0000","last_clean":"2024-09-21T00:14:15.501177+0000","last_became_active":"2024-09-21T00:14:08.960716+0000","last_became_peered":"2024-09-21T00:14:08.960716+0000","last_unstale":"2024-09-21T00:14:15.501177+0000","last_undegraded":"2024-09-21T00:14:15.501177+0000","last_fullsized":"2024-09-21T00:14:15.501177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:06.314729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123221+0000","last_change":"2024-09-21T00:14:14.001333+0000","last_active":"2024-09-21T00:14:16.123221+0000","last_peered":"2024-09-21T00:14:16.123221+0000","last_clean":"2024-09-21T00:14:16.123221+0000","last_became_active":"2024-09-21T00:14:14.000838+0000","last_became_peered":"2024-09-21T00:14:14.000838+0000","last_unstale":"2024-09-21T00:14:16.123221+0000","last_undegraded":"2024-09-21T00:14:16.123221+0000","last_fullsized":"2024-09-21T00:14:16.123221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:04.996254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973835+0000","last_change":"2024-09-21T00:14:09.960278+0000","last_active":"2024-09-21T00:14:14.973835+0000","last_peered":"2024-09-21T00:14:14.973835+0000","last_clean":"2024-09-21T00:14:14.973835+0000","last_became_active":"2024-09-21T00:14:09.959949+0000","last_became_peered":"2024-09-21T00:14:09.959949+0000","last_unstale":"2024-09-21T00:14:14.973835+0000","last_undegraded":"2024-09-21T00:14:14.973835+0000","last_fullsized":"2024-09-21T00:14:14.973835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:09.105489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966906+0000","last_change":"2024-09-21T00:14:08.967871+0000","last_active":"2024-09-21T00:14:15.966906+0000","last_peered":"2024-09-21T00:14:15.966906+0000","last_clean":"2024-09-21T00:14:15.966906+0000","last_became_active":"2024-09-21T00:14:08.966840+0000","last_became_peered":"2024-09-21T00:14:08.966840+0000","last_unstale":"2024-09-21T00:14:15.966906+0000","last_undegraded":"2024-09-21T00:14:15.966906+0000","last_fullsized":"2024-09-21T00:14:15.966906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:12:50.931090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123068+0000","last_change":"2024-09-21T00:14:14.004129+0000","last_active":"2024-09-21T00:14:16.123068+0000","last_peered":"2024-09-21T00:14:16.123068+0000","last_clean":"2024-09-21T00:14:16.123068+0000","last_became_active":"2024-09-21T00:14:14.003631+0000","last_became_peered":"2024-09-21T00:14:14.003631+0000","last_unstale":"2024-09-21T00:14:16.123068+0000","last_undegraded":"2024-09-21T00:14:16.123068+0000","last_fullsized":"2024-09-21T00:14:16.123068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:31.535375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122448+0000","last_change":"2024-09-21T00:14:09.974665+0000","last_active":"2024-09-21T00:14:16.122448+0000","last_peered":"2024-09-21T00:14:16.122448+0000","last_clean":"2024-09-21T00:14:16.122448+0000","last_became_active":"2024-09-21T00:14:09.964253+0000","last_became_peered":"2024-09-21T00:14:09.964253+0000","last_unstale":"2024-09-21T00:14:16.122448+0000","last_undegraded":"2024-09-21T00:14:16.122448+0000","last_fullsized":"2024-09-21T00:14:16.122448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:40.707880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500462+0000","last_change":"2024-09-21T00:14:08.961331+0000","last_active":"2024-09-21T00:14:15.500462+0000","last_peered":"2024-09-21T00:14:15.500462+0000","last_clean":"2024-09-21T00:14:15.500462+0000","last_became_active":"2024-09-21T00:14:08.961064+0000","last_became_peered":"2024-09-21T00:14:08.961064+0000","last_unstale":"2024-09-21T00:14:15.500462+0000","last_undegraded":"2024-09-21T00:14:15.500462+0000","last_fullsized":"2024-09-21T00:14:15.500462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:09.528188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123408+0000","last_change":"2024-09-21T00:14:14.001325+0000","last_active":"2024-09-21T00:14:16.123408+0000","last_peered":"2024-09-21T00:14:16.123408+0000","last_clean":"2024-09-21T00:14:16.123408+0000","last_became_active":"2024-09-21T00:14:14.000838+0000","last_became_peered":"2024-09-21T00:14:14.000838+0000","last_unstale":"2024-09-21T00:14:16.123408+0000","last_undegraded":"2024-09-21T00:14:16.123408+0000","last_fullsized":"2024-09-21T00:14:16.123408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:14.306042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966733+0000","last_change":"2024-09-21T00:14:09.958391+0000","last_active":"2024-09-21T00:14:15.966733+0000","last_peered":"2024-09-21T00:14:15.966733+0000","last_clean":"2024-09-21T00:14:15.966733+0000","last_became_active":"2024-09-21T00:14:09.957844+0000","last_became_peered":"2024-09-21T00:14:09.957844+0000","last_unstale":"2024-09-21T00:14:15.966733+0000","last_undegraded":"2024-09-21T00:14:15.966733+0000","last_fullsized":"2024-09-21T00:14:15.966733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:30.770474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977238+0000","last_change":"2024-09-21T00:14:08.968128+0000","last_active":"2024-09-21T00:14:14.977238+0000","last_peered":"2024-09-21T00:14:14.977238+0000","last_clean":"2024-09-21T00:14:14.977238+0000","last_became_active":"2024-09-21T00:14:08.967257+0000","last_became_peered":"2024-09-21T00:14:08.967257+0000","last_unstale":"2024-09-21T00:14:14.977238+0000","last_undegraded":"2024-09-21T00:14:14.977238+0000","last_fullsized":"2024-09-21T00:14:14.977238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:03.075394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123840+0000","last_change":"2024-09-21T00:14:14.005119+0000","last_active":"2024-09-21T00:14:16.123840+0000","last_peered":"2024-09-21T00:14:16.123840+0000","last_clean":"2024-09-21T00:14:16.123840+0000","last_became_active":"2024-09-21T00:14:14.003742+0000","last_became_peered":"2024-09-21T00:14:14.003742+0000","last_unstale":"2024-09-21T00:14:16.123840+0000","last_undegraded":"2024-09-21T00:14:16.123840+0000","last_fullsized":"2024-09-21T00:14:16.123840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:06.050664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122838+0000","last_change":"2024-09-21T00:14:09.969231+0000","last_active":"2024-09-21T00:14:16.122838+0000","last_peered":"2024-09-21T00:14:16.122838+0000","last_clean":"2024-09-21T00:14:16.122838+0000","last_became_active":"2024-09-21T00:14:09.968567+0000","last_became_peered":"2024-09-21T00:14:09.968567+0000","last_unstale":"2024-09-21T00:14:16.122838+0000","last_undegraded":"2024-09-21T00:14:16.122838+0000","last_fullsized":"2024-09-21T00:14:16.122838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.302969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500274+0000","last_change":"2024-09-21T00:14:08.966891+0000","last_active":"2024-09-21T00:14:15.500274+0000","last_peered":"2024-09-21T00:14:15.500274+0000","last_clean":"2024-09-21T00:14:15.500274+0000","last_became_active":"2024-09-21T00:14:08.966521+0000","last_became_peered":"2024-09-21T00:14:08.966521+0000","last_unstale":"2024-09-21T00:14:15.500274+0000","last_undegraded":"2024-09-21T00:14:15.500274+0000","last_fullsized":"2024-09-21T00:14:15.500274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:17.687314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967312+0000","last_change":"2024-09-21T00:14:14.004905+0000","last_active":"2024-09-21T00:14:15.967312+0000","last_peered":"2024-09-21T00:14:15.967312+0000","last_clean":"2024-09-21T00:14:15.967312+0000","last_became_active":"2024-09-21T00:14:14.002340+0000","last_became_peered":"2024-09-21T00:14:14.002340+0000","last_unstale":"2024-09-21T00:14:15.967312+0000","last_undegraded":"2024-09-21T00:14:15.967312+0000","last_fullsized":"2024-09-21T00:14:15.967312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:46.951215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977585+0000","last_change":"2024-09-21T00:14:09.944543+0000","last_active":"2024-09-21T00:14:14.977585+0000","last_peered":"2024-09-21T00:14:14.977585+0000","last_clean":"2024-09-21T00:14:14.977585+0000","last_became_active":"2024-09-21T00:14:09.944211+0000","last_became_peered":"2024-09-21T00:14:09.944211+0000","last_unstale":"2024-09-21T00:14:14.977585+0000","last_undegraded":"2024-09-21T00:14:14.977585+0000","last_fullsized":"2024-09-21T00:14:14.977585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:26.273280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500607+0000","last_change":"2024-09-21T00:14:08.963265+0000","last_active":"2024-09-21T00:14:15.500607+0000","last_peered":"2024-09-21T00:14:15.500607+0000","last_clean":"2024-09-21T00:14:15.500607+0000","last_became_active":"2024-09-21T00:14:08.961984+0000","last_became_peered":"2024-09-21T00:14:08.961984+0000","last_unstale":"2024-09-21T00:14:15.500607+0000","last_undegraded":"2024-09-21T00:14:15.500607+0000","last_fullsized":"2024-09-21T00:14:15.500607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:23.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122745+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:14:16.122745+0000","last_peered":"2024-09-21T00:14:16.122745+0000","last_clean":"2024-09-21T00:14:16.122745+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:14:16.122745+0000","last_undegraded":"2024-09-21T00:14:16.122745+0000","last_fullsized":"2024-09-21T00:14:16.122745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501135+0000","last_change":"2024-09-21T00:14:13.987888+0000","last_active":"2024-09-21T00:14:15.501135+0000","last_peered":"2024-09-21T00:14:15.501135+0000","last_clean":"2024-09-21T00:14:15.501135+0000","last_became_active":"2024-09-21T00:14:13.987371+0000","last_became_peered":"2024-09-21T00:14:13.987371+0000","last_unstale":"2024-09-21T00:14:15.501135+0000","last_undegraded":"2024-09-21T00:14:15.501135+0000","last_fullsized":"2024-09-21T00:14:15.501135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:13.662595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500986+0000","last_change":"2024-09-21T00:14:09.976122+0000","last_active":"2024-09-21T00:14:15.500986+0000","last_peered":"2024-09-21T00:14:15.500986+0000","last_clean":"2024-09-21T00:14:15.500986+0000","last_became_active":"2024-09-21T00:14:09.975763+0000","last_became_peered":"2024-09-21T00:14:09.975763+0000","last_unstale":"2024-09-21T00:14:15.500986+0000","last_undegraded":"2024-09-21T00:14:15.500986+0000","last_fullsized":"2024-09-21T00:14:15.500986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:58.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123695+0000","last_change":"2024-09-21T00:14:08.965532+0000","last_active":"2024-09-21T00:14:16.123695+0000","last_peered":"2024-09-21T00:14:16.123695+0000","last_clean":"2024-09-21T00:14:16.123695+0000","last_became_active":"2024-09-21T00:14:08.965203+0000","last_became_peered":"2024-09-21T00:14:08.965203+0000","last_unstale":"2024-09-21T00:14:16.123695+0000","last_undegraded":"2024-09-21T00:14:16.123695+0000","last_fullsized":"2024-09-21T00:14:16.123695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:43:28.609507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973635+0000","last_change":"2024-09-21T00:14:14.010029+0000","last_active":"2024-09-21T00:14:14.973635+0000","last_peered":"2024-09-21T00:14:14.973635+0000","last_clean":"2024-09-21T00:14:14.973635+0000","last_became_active":"2024-09-21T00:14:14.009543+0000","last_became_peered":"2024-09-21T00:14:14.009543+0000","last_unstale":"2024-09-21T00:14:14.973635+0000","last_undegraded":"2024-09-21T00:14:14.973635+0000","last_fullsized":"2024-09-21T00:14:14.973635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:44.738397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122862+0000","last_change":"2024-09-21T00:14:09.956902+0000","last_active":"2024-09-21T00:14:16.122862+0000","last_peered":"2024-09-21T00:14:16.122862+0000","last_clean":"2024-09-21T00:14:16.122862+0000","last_became_active":"2024-09-21T00:14:09.956598+0000","last_became_peered":"2024-09-21T00:14:09.956598+0000","last_unstale":"2024-09-21T00:14:16.122862+0000","last_undegraded":"2024-09-21T00:14:16.122862+0000","last_fullsized":"2024-09-21T00:14:16.122862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:33.085847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967274+0000","last_change":"2024-09-21T00:14:08.960165+0000","last_active":"2024-09-21T00:14:15.967274+0000","last_peered":"2024-09-21T00:14:15.967274+0000","last_clean":"2024-09-21T00:14:15.967274+0000","last_became_active":"2024-09-21T00:14:08.959384+0000","last_became_peered":"2024-09-21T00:14:08.959384+0000","last_unstale":"2024-09-21T00:14:15.967274+0000","last_undegraded":"2024-09-21T00:14:15.967274+0000","last_fullsized":"2024-09-21T00:14:15.967274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:45.898250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967161+0000","last_change":"2024-09-21T00:14:13.991452+0000","last_active":"2024-09-21T00:14:15.967161+0000","last_peered":"2024-09-21T00:14:15.967161+0000","last_clean":"2024-09-21T00:14:15.967161+0000","last_became_active":"2024-09-21T00:14:13.991104+0000","last_became_peered":"2024-09-21T00:14:13.991104+0000","last_unstale":"2024-09-21T00:14:15.967161+0000","last_undegraded":"2024-09-21T00:14:15.967161+0000","last_fullsized":"2024-09-21T00:14:15.967161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:13.243815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123422+0000","last_change":"2024-09-21T00:14:09.965731+0000","last_active":"2024-09-21T00:14:16.123422+0000","last_peered":"2024-09-21T00:14:16.123422+0000","last_clean":"2024-09-21T00:14:16.123422+0000","last_became_active":"2024-09-21T00:14:09.965441+0000","last_became_peered":"2024-09-21T00:14:09.965441+0000","last_unstale":"2024-09-21T00:14:16.123422+0000","last_undegraded":"2024-09-21T00:14:16.123422+0000","last_fullsized":"2024-09-21T00:14:16.123422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:30.235970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979154+0000","last_change":"2024-09-21T00:14:08.956670+0000","last_active":"2024-09-21T00:14:14.979154+0000","last_peered":"2024-09-21T00:14:14.979154+0000","last_clean":"2024-09-21T00:14:14.979154+0000","last_became_active":"2024-09-21T00:14:08.955944+0000","last_became_peered":"2024-09-21T00:14:08.955944+0000","last_unstale":"2024-09-21T00:14:14.979154+0000","last_undegraded":"2024-09-21T00:14:14.979154+0000","last_fullsized":"2024-09-21T00:14:14.979154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:27.091939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500018+0000","last_change":"2024-09-21T00:14:13.993587+0000","last_active":"2024-09-21T00:14:15.500018+0000","last_peered":"2024-09-21T00:14:15.500018+0000","last_clean":"2024-09-21T00:14:15.500018+0000","last_became_active":"2024-09-21T00:14:13.993154+0000","last_became_peered":"2024-09-21T00:14:13.993154+0000","last_unstale":"2024-09-21T00:14:15.500018+0000","last_undegraded":"2024-09-21T00:14:15.500018+0000","last_fullsized":"2024-09-21T00:14:15.500018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:10.903336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974186+0000","last_change":"2024-09-21T00:14:09.956980+0000","last_active":"2024-09-21T00:14:14.974186+0000","last_peered":"2024-09-21T00:14:14.974186+0000","last_clean":"2024-09-21T00:14:14.974186+0000","last_became_active":"2024-09-21T00:14:09.956663+0000","last_became_peered":"2024-09-21T00:14:09.956663+0000","last_unstale":"2024-09-21T00:14:14.974186+0000","last_undegraded":"2024-09-21T00:14:14.974186+0000","last_fullsized":"2024-09-21T00:14:14.974186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.535510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123436+0000","last_change":"2024-09-21T00:14:08.962950+0000","last_active":"2024-09-21T00:14:16.123436+0000","last_peered":"2024-09-21T00:14:16.123436+0000","last_clean":"2024-09-21T00:14:16.123436+0000","last_became_active":"2024-09-21T00:14:08.962106+0000","last_became_peered":"2024-09-21T00:14:08.962106+0000","last_unstale":"2024-09-21T00:14:16.123436+0000","last_undegraded":"2024-09-21T00:14:16.123436+0000","last_fullsized":"2024-09-21T00:14:16.123436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:28.367381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123232+0000","last_change":"2024-09-21T00:14:13.998520+0000","last_active":"2024-09-21T00:14:16.123232+0000","last_peered":"2024-09-21T00:14:16.123232+0000","last_clean":"2024-09-21T00:14:16.123232+0000","last_became_active":"2024-09-21T00:14:13.998102+0000","last_became_peered":"2024-09-21T00:14:13.998102+0000","last_unstale":"2024-09-21T00:14:16.123232+0000","last_undegraded":"2024-09-21T00:14:16.123232+0000","last_fullsized":"2024-09-21T00:14:16.123232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:35.968823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500013+0000","last_change":"2024-09-21T00:14:09.971253+0000","last_active":"2024-09-21T00:14:15.500013+0000","last_peered":"2024-09-21T00:14:15.500013+0000","last_clean":"2024-09-21T00:14:15.500013+0000","last_became_active":"2024-09-21T00:14:09.966337+0000","last_became_peered":"2024-09-21T00:14:09.966337+0000","last_unstale":"2024-09-21T00:14:15.500013+0000","last_undegraded":"2024-09-21T00:14:15.500013+0000","last_fullsized":"2024-09-21T00:14:15.500013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:30.235970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977345+0000","last_change":"2024-09-21T00:14:08.956648+0000","last_active":"2024-09-21T00:14:14.977345+0000","last_peered":"2024-09-21T00:14:14.977345+0000","last_clean":"2024-09-21T00:14:14.977345+0000","last_became_active":"2024-09-21T00:14:08.956242+0000","last_became_peered":"2024-09-21T00:14:08.956242+0000","last_unstale":"2024-09-21T00:14:14.977345+0000","last_undegraded":"2024-09-21T00:14:14.977345+0000","last_fullsized":"2024-09-21T00:14:14.977345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:51:44.198197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967515+0000","last_change":"2024-09-21T00:14:14.010023+0000","last_active":"2024-09-21T00:14:15.967515+0000","last_peered":"2024-09-21T00:14:15.967515+0000","last_clean":"2024-09-21T00:14:15.967515+0000","last_became_active":"2024-09-21T00:14:14.009295+0000","last_became_peered":"2024-09-21T00:14:14.009295+0000","last_unstale":"2024-09-21T00:14:15.967515+0000","last_undegraded":"2024-09-21T00:14:15.967515+0000","last_fullsized":"2024-09-21T00:14:15.967515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:45.380314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122633+0000","last_change":"2024-09-21T00:14:09.958927+0000","last_active":"2024-09-21T00:14:16.122633+0000","last_peered":"2024-09-21T00:14:16.122633+0000","last_clean":"2024-09-21T00:14:16.122633+0000","last_became_active":"2024-09-21T00:14:09.958618+0000","last_became_peered":"2024-09-21T00:14:09.958618+0000","last_unstale":"2024-09-21T00:14:16.122633+0000","last_undegraded":"2024-09-21T00:14:16.122633+0000","last_fullsized":"2024-09-21T00:14:16.122633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122261+0000","last_change":"2024-09-21T00:14:08.962483+0000","last_active":"2024-09-21T00:14:16.122261+0000","last_peered":"2024-09-21T00:14:16.122261+0000","last_clean":"2024-09-21T00:14:16.122261+0000","last_became_active":"2024-09-21T00:14:08.961970+0000","last_became_peered":"2024-09-21T00:14:08.961970+0000","last_unstale":"2024-09-21T00:14:16.122261+0000","last_undegraded":"2024-09-21T00:14:16.122261+0000","last_fullsized":"2024-09-21T00:14:16.122261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:27.091939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967654+0000","last_change":"2024-09-21T00:14:13.994820+0000","last_active":"2024-09-21T00:14:15.967654+0000","last_peered":"2024-09-21T00:14:15.967654+0000","last_clean":"2024-09-21T00:14:15.967654+0000","last_became_active":"2024-09-21T00:14:13.994201+0000","last_became_peered":"2024-09-21T00:14:13.994201+0000","last_unstale":"2024-09-21T00:14:15.967654+0000","last_undegraded":"2024-09-21T00:14:15.967654+0000","last_fullsized":"2024-09-21T00:14:15.967654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.660541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500240+0000","last_change":"2024-09-21T00:14:09.954424+0000","last_active":"2024-09-21T00:14:15.500240+0000","last_peered":"2024-09-21T00:14:15.500240+0000","last_clean":"2024-09-21T00:14:15.500240+0000","last_became_active":"2024-09-21T00:14:09.953451+0000","last_became_peered":"2024-09-21T00:14:09.953451+0000","last_unstale":"2024-09-21T00:14:15.500240+0000","last_undegraded":"2024-09-21T00:14:15.500240+0000","last_fullsized":"2024-09-21T00:14:15.500240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:02.131667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500383+0000","last_change":"2024-09-21T00:14:08.955470+0000","last_active":"2024-09-21T00:14:15.500383+0000","last_peered":"2024-09-21T00:14:15.500383+0000","last_clean":"2024-09-21T00:14:15.500383+0000","last_became_active":"2024-09-21T00:14:08.952599+0000","last_became_peered":"2024-09-21T00:14:08.952599+0000","last_unstale":"2024-09-21T00:14:15.500383+0000","last_undegraded":"2024-09-21T00:14:15.500383+0000","last_fullsized":"2024-09-21T00:14:15.500383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:16.644911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123459+0000","last_change":"2024-09-21T00:14:14.004819+0000","last_active":"2024-09-21T00:14:16.123459+0000","last_peered":"2024-09-21T00:14:16.123459+0000","last_clean":"2024-09-21T00:14:16.123459+0000","last_became_active":"2024-09-21T00:14:14.003284+0000","last_became_peered":"2024-09-21T00:14:14.003284+0000","last_unstale":"2024-09-21T00:14:16.123459+0000","last_undegraded":"2024-09-21T00:14:16.123459+0000","last_fullsized":"2024-09-21T00:14:16.123459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:56:35.976927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123069+0000","last_change":"2024-09-21T00:14:09.966769+0000","last_active":"2024-09-21T00:14:16.123069+0000","last_peered":"2024-09-21T00:14:16.123069+0000","last_clean":"2024-09-21T00:14:16.123069+0000","last_became_active":"2024-09-21T00:14:09.966448+0000","last_became_peered":"2024-09-21T00:14:09.966448+0000","last_unstale":"2024-09-21T00:14:16.123069+0000","last_undegraded":"2024-09-21T00:14:16.123069+0000","last_fullsized":"2024-09-21T00:14:16.123069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978213+0000","last_change":"2024-09-21T00:14:08.967528+0000","last_active":"2024-09-21T00:14:14.978213+0000","last_peered":"2024-09-21T00:14:14.978213+0000","last_clean":"2024-09-21T00:14:14.978213+0000","last_became_active":"2024-09-21T00:14:08.966897+0000","last_became_peered":"2024-09-21T00:14:08.966897+0000","last_unstale":"2024-09-21T00:14:14.978213+0000","last_undegraded":"2024-09-21T00:14:14.978213+0000","last_fullsized":"2024-09-21T00:14:14.978213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:51:44.198197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501045+0000","last_change":"2024-09-21T00:14:13.989994+0000","last_active":"2024-09-21T00:14:15.501045+0000","last_peered":"2024-09-21T00:14:15.501045+0000","last_clean":"2024-09-21T00:14:15.501045+0000","last_became_active":"2024-09-21T00:14:13.989524+0000","last_became_peered":"2024-09-21T00:14:13.989524+0000","last_unstale":"2024-09-21T00:14:15.501045+0000","last_undegraded":"2024-09-21T00:14:15.501045+0000","last_fullsized":"2024-09-21T00:14:15.501045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:45.169356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123101+0000","last_change":"2024-09-21T00:14:09.955385+0000","last_active":"2024-09-21T00:14:16.123101+0000","last_peered":"2024-09-21T00:14:16.123101+0000","last_clean":"2024-09-21T00:14:16.123101+0000","last_became_active":"2024-09-21T00:14:09.955031+0000","last_became_peered":"2024-09-21T00:14:09.955031+0000","last_unstale":"2024-09-21T00:14:16.123101+0000","last_undegraded":"2024-09-21T00:14:16.123101+0000","last_fullsized":"2024-09-21T00:14:16.123101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:27.504857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:22.928007+0000","last_change":"2024-09-21T00:14:08.950520+0000","last_active":"2024-09-21T00:14:22.928007+0000","last_peered":"2024-09-21T00:14:22.928007+0000","last_clean":"2024-09-21T00:14:22.928007+0000","last_became_active":"2024-09-21T00:14:08.950052+0000","last_became_peered":"2024-09-21T00:14:08.950052+0000","last_unstale":"2024-09-21T00:14:22.928007+0000","last_undegraded":"2024-09-21T00:14:22.928007+0000","last_fullsized":"2024-09-21T00:14:22.928007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:03.572976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977762+0000","last_change":"2024-09-21T00:14:13.991051+0000","last_active":"2024-09-21T00:14:14.977762+0000","last_peered":"2024-09-21T00:14:14.977762+0000","last_clean":"2024-09-21T00:14:14.977762+0000","last_became_active":"2024-09-21T00:14:13.990544+0000","last_became_peered":"2024-09-21T00:14:13.990544+0000","last_unstale":"2024-09-21T00:14:14.977762+0000","last_undegraded":"2024-09-21T00:14:14.977762+0000","last_fullsized":"2024-09-21T00:14:14.977762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:21.835935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500587+0000","last_change":"2024-09-21T00:14:09.967875+0000","last_active":"2024-09-21T00:14:15.500587+0000","last_peered":"2024-09-21T00:14:15.500587+0000","last_clean":"2024-09-21T00:14:15.500587+0000","last_became_active":"2024-09-21T00:14:09.966515+0000","last_became_peered":"2024-09-21T00:14:09.966515+0000","last_unstale":"2024-09-21T00:14:15.500587+0000","last_undegraded":"2024-09-21T00:14:15.500587+0000","last_fullsized":"2024-09-21T00:14:15.500587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:18:31.266375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978569+0000","last_change":"2024-09-21T00:14:08.963443+0000","last_active":"2024-09-21T00:14:14.978569+0000","last_peered":"2024-09-21T00:14:14.978569+0000","last_clean":"2024-09-21T00:14:14.978569+0000","last_became_active":"2024-09-21T00:14:08.963001+0000","last_became_peered":"2024-09-21T00:14:08.963001+0000","last_unstale":"2024-09-21T00:14:14.978569+0000","last_undegraded":"2024-09-21T00:14:14.978569+0000","last_fullsized":"2024-09-21T00:14:14.978569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:38.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974431+0000","last_change":"2024-09-21T00:14:14.004423+0000","last_active":"2024-09-21T00:14:14.974431+0000","last_peered":"2024-09-21T00:14:14.974431+0000","last_clean":"2024-09-21T00:14:14.974431+0000","last_became_active":"2024-09-21T00:14:14.003993+0000","last_became_peered":"2024-09-21T00:14:14.003993+0000","last_unstale":"2024-09-21T00:14:14.974431+0000","last_undegraded":"2024-09-21T00:14:14.974431+0000","last_fullsized":"2024-09-21T00:14:14.974431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:07:20.224751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967722+0000","last_change":"2024-09-21T00:14:09.971797+0000","last_active":"2024-09-21T00:14:15.967722+0000","last_peered":"2024-09-21T00:14:15.967722+0000","last_clean":"2024-09-21T00:14:15.967722+0000","last_became_active":"2024-09-21T00:14:09.971424+0000","last_became_peered":"2024-09-21T00:14:09.971424+0000","last_unstale":"2024-09-21T00:14:15.967722+0000","last_undegraded":"2024-09-21T00:14:15.967722+0000","last_fullsized":"2024-09-21T00:14:15.967722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:26.244909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122745+0000","last_change":"2024-09-21T00:14:08.946131+0000","last_active":"2024-09-21T00:14:16.122745+0000","last_peered":"2024-09-21T00:14:16.122745+0000","last_clean":"2024-09-21T00:14:16.122745+0000","last_became_active":"2024-09-21T00:14:08.945798+0000","last_became_peered":"2024-09-21T00:14:08.945798+0000","last_unstale":"2024-09-21T00:14:16.122745+0000","last_undegraded":"2024-09-21T00:14:16.122745+0000","last_fullsized":"2024-09-21T00:14:16.122745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:19.481209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.976886+0000","last_change":"2024-09-21T00:14:14.009826+0000","last_active":"2024-09-21T00:14:14.976886+0000","last_peered":"2024-09-21T00:14:14.976886+0000","last_clean":"2024-09-21T00:14:14.976886+0000","last_became_active":"2024-09-21T00:14:14.009239+0000","last_became_peered":"2024-09-21T00:14:14.009239+0000","last_unstale":"2024-09-21T00:14:14.976886+0000","last_undegraded":"2024-09-21T00:14:14.976886+0000","last_fullsized":"2024-09-21T00:14:14.976886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:11.352568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974080+0000","last_change":"2024-09-21T00:14:09.961500+0000","last_active":"2024-09-21T00:14:14.974080+0000","last_peered":"2024-09-21T00:14:14.974080+0000","last_clean":"2024-09-21T00:14:14.974080+0000","last_became_active":"2024-09-21T00:14:09.960752+0000","last_became_peered":"2024-09-21T00:14:09.960752+0000","last_unstale":"2024-09-21T00:14:14.974080+0000","last_undegraded":"2024-09-21T00:14:14.974080+0000","last_fullsized":"2024-09-21T00:14:14.974080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123962+0000","last_change":"2024-09-21T00:14:08.951923+0000","last_active":"2024-09-21T00:14:16.123962+0000","last_peered":"2024-09-21T00:14:16.123962+0000","last_clean":"2024-09-21T00:14:16.123962+0000","last_became_active":"2024-09-21T00:14:08.947804+0000","last_became_peered":"2024-09-21T00:14:08.947804+0000","last_unstale":"2024-09-21T00:14:16.123962+0000","last_undegraded":"2024-09-21T00:14:16.123962+0000","last_fullsized":"2024-09-21T00:14:16.123962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:28.286333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977974+0000","last_change":"2024-09-21T00:14:13.997051+0000","last_active":"2024-09-21T00:14:14.977974+0000","last_peered":"2024-09-21T00:14:14.977974+0000","last_clean":"2024-09-21T00:14:14.977974+0000","last_became_active":"2024-09-21T00:14:13.996692+0000","last_became_peered":"2024-09-21T00:14:13.996692+0000","last_unstale":"2024-09-21T00:14:14.977974+0000","last_undegraded":"2024-09-21T00:14:14.977974+0000","last_fullsized":"2024-09-21T00:14:14.977974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:37.116365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979061+0000","last_change":"2024-09-21T00:14:13.993380+0000","last_active":"2024-09-21T00:14:14.979061+0000","last_peered":"2024-09-21T00:14:14.979061+0000","last_clean":"2024-09-21T00:14:14.979061+0000","last_became_active":"2024-09-21T00:14:13.992819+0000","last_became_peered":"2024-09-21T00:14:13.992819+0000","last_unstale":"2024-09-21T00:14:14.979061+0000","last_undegraded":"2024-09-21T00:14:14.979061+0000","last_fullsized":"2024-09-21T00:14:14.979061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.855429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978052+0000","last_change":"2024-09-21T00:14:09.962777+0000","last_active":"2024-09-21T00:14:14.978052+0000","last_peered":"2024-09-21T00:14:14.978052+0000","last_clean":"2024-09-21T00:14:14.978052+0000","last_became_active":"2024-09-21T00:14:09.962489+0000","last_became_peered":"2024-09-21T00:14:09.962489+0000","last_unstale":"2024-09-21T00:14:14.978052+0000","last_undegraded":"2024-09-21T00:14:14.978052+0000","last_fullsized":"2024-09-21T00:14:14.978052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:21.354918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500237+0000","last_change":"2024-09-21T00:14:08.955114+0000","last_active":"2024-09-21T00:14:15.500237+0000","last_peered":"2024-09-21T00:14:15.500237+0000","last_clean":"2024-09-21T00:14:15.500237+0000","last_became_active":"2024-09-21T00:14:08.954028+0000","last_became_peered":"2024-09-21T00:14:08.954028+0000","last_unstale":"2024-09-21T00:14:15.500237+0000","last_undegraded":"2024-09-21T00:14:15.500237+0000","last_fullsized":"2024-09-21T00:14:15.500237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:19.481209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500943+0000","last_change":"2024-09-21T00:14:13.993411+0000","last_active":"2024-09-21T00:14:15.500943+0000","last_peered":"2024-09-21T00:14:15.500943+0000","last_clean":"2024-09-21T00:14:15.500943+0000","last_became_active":"2024-09-21T00:14:13.992997+0000","last_became_peered":"2024-09-21T00:14:13.992997+0000","last_unstale":"2024-09-21T00:14:15.500943+0000","last_undegraded":"2024-09-21T00:14:15.500943+0000","last_fullsized":"2024-09-21T00:14:15.500943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:22.418960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967109+0000","last_change":"2024-09-21T00:14:09.962686+0000","last_active":"2024-09-21T00:14:15.967109+0000","last_peered":"2024-09-21T00:14:15.967109+0000","last_clean":"2024-09-21T00:14:15.967109+0000","last_became_active":"2024-09-21T00:14:09.961140+0000","last_became_peered":"2024-09-21T00:14:09.961140+0000","last_unstale":"2024-09-21T00:14:15.967109+0000","last_undegraded":"2024-09-21T00:14:15.967109+0000","last_fullsized":"2024-09-21T00:14:15.967109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:30.146682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122851+0000","last_change":"2024-09-21T00:14:08.961705+0000","last_active":"2024-09-21T00:14:16.122851+0000","last_peered":"2024-09-21T00:14:16.122851+0000","last_clean":"2024-09-21T00:14:16.122851+0000","last_became_active":"2024-09-21T00:14:08.961362+0000","last_became_peered":"2024-09-21T00:14:08.961362+0000","last_unstale":"2024-09-21T00:14:16.122851+0000","last_undegraded":"2024-09-21T00:14:16.122851+0000","last_fullsized":"2024-09-21T00:14:16.122851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:17.677016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500354+0000","last_change":"2024-09-21T00:14:08.967458+0000","last_active":"2024-09-21T00:14:15.500354+0000","last_peered":"2024-09-21T00:14:15.500354+0000","last_clean":"2024-09-21T00:14:15.500354+0000","last_became_active":"2024-09-21T00:14:08.966663+0000","last_became_peered":"2024-09-21T00:14:08.966663+0000","last_unstale":"2024-09-21T00:14:15.500354+0000","last_undegraded":"2024-09-21T00:14:15.500354+0000","last_fullsized":"2024-09-21T00:14:15.500354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:12.051409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978414+0000","last_change":"2024-09-21T00:14:09.955928+0000","last_active":"2024-09-21T00:14:14.978414+0000","last_peered":"2024-09-21T00:14:14.978414+0000","last_clean":"2024-09-21T00:14:14.978414+0000","last_became_active":"2024-09-21T00:14:09.955523+0000","last_became_peered":"2024-09-21T00:14:09.955523+0000","last_unstale":"2024-09-21T00:14:14.978414+0000","last_undegraded":"2024-09-21T00:14:14.978414+0000","last_fullsized":"2024-09-21T00:14:14.978414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:16.513288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978979+0000","last_change":"2024-09-21T00:14:14.003528+0000","last_active":"2024-09-21T00:14:14.978979+0000","last_peered":"2024-09-21T00:14:14.978979+0000","last_clean":"2024-09-21T00:14:14.978979+0000","last_became_active":"2024-09-21T00:14:14.002941+0000","last_became_peered":"2024-09-21T00:14:14.002941+0000","last_unstale":"2024-09-21T00:14:14.978979+0000","last_undegraded":"2024-09-21T00:14:14.978979+0000","last_fullsized":"2024-09-21T00:14:14.978979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:21.996124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967341+0000","last_change":"2024-09-21T00:14:08.968392+0000","last_active":"2024-09-21T00:14:15.967341+0000","last_peered":"2024-09-21T00:14:15.967341+0000","last_clean":"2024-09-21T00:14:15.967341+0000","last_became_active":"2024-09-21T00:14:08.967708+0000","last_became_peered":"2024-09-21T00:14:08.967708+0000","last_unstale":"2024-09-21T00:14:15.967341+0000","last_undegraded":"2024-09-21T00:14:15.967341+0000","last_fullsized":"2024-09-21T00:14:15.967341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:36.352016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123057+0000","last_change":"2024-09-21T00:14:09.961926+0000","last_active":"2024-09-21T00:14:16.123057+0000","last_peered":"2024-09-21T00:14:16.123057+0000","last_clean":"2024-09-21T00:14:16.123057+0000","last_became_active":"2024-09-21T00:14:09.961227+0000","last_became_peered":"2024-09-21T00:14:09.961227+0000","last_unstale":"2024-09-21T00:14:16.123057+0000","last_undegraded":"2024-09-21T00:14:16.123057+0000","last_fullsized":"2024-09-21T00:14:16.123057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978238+0000","last_change":"2024-09-21T00:14:14.013035+0000","last_active":"2024-09-21T00:14:14.978238+0000","last_peered":"2024-09-21T00:14:14.978238+0000","last_clean":"2024-09-21T00:14:14.978238+0000","last_became_active":"2024-09-21T00:14:14.011549+0000","last_became_peered":"2024-09-21T00:14:14.011549+0000","last_unstale":"2024-09-21T00:14:14.978238+0000","last_undegraded":"2024-09-21T00:14:14.978238+0000","last_fullsized":"2024-09-21T00:14:14.978238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:20.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973538+0000","last_change":"2024-09-21T00:14:09.960154+0000","last_active":"2024-09-21T00:14:14.973538+0000","last_peered":"2024-09-21T00:14:14.973538+0000","last_clean":"2024-09-21T00:14:14.973538+0000","last_became_active":"2024-09-21T00:14:09.959838+0000","last_became_peered":"2024-09-21T00:14:09.959838+0000","last_unstale":"2024-09-21T00:14:14.973538+0000","last_undegraded":"2024-09-21T00:14:14.973538+0000","last_fullsized":"2024-09-21T00:14:14.973538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977119+0000","last_change":"2024-09-21T00:14:09.961472+0000","last_active":"2024-09-21T00:14:14.977119+0000","last_peered":"2024-09-21T00:14:14.977119+0000","last_clean":"2024-09-21T00:14:14.977119+0000","last_became_active":"2024-09-21T00:14:09.961159+0000","last_became_peered":"2024-09-21T00:14:09.961159+0000","last_unstale":"2024-09-21T00:14:14.977119+0000","last_undegraded":"2024-09-21T00:14:14.977119+0000","last_fullsized":"2024-09-21T00:14:14.977119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:18.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500115+0000","last_change":"2024-09-21T00:14:09.960102+0000","last_active":"2024-09-21T00:14:15.500115+0000","last_peered":"2024-09-21T00:14:15.500115+0000","last_clean":"2024-09-21T00:14:15.500115+0000","last_became_active":"2024-09-21T00:14:09.959770+0000","last_became_peered":"2024-09-21T00:14:09.959770+0000","last_unstale":"2024-09-21T00:14:15.500115+0000","last_undegraded":"2024-09-21T00:14:15.500115+0000","last_fullsized":"2024-09-21T00:14:15.500115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:48:17.648660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967160+0000","last_change":"2024-09-21T00:14:09.967922+0000","last_active":"2024-09-21T00:14:15.967160+0000","last_peered":"2024-09-21T00:14:15.967160+0000","last_clean":"2024-09-21T00:14:15.967160+0000","last_became_active":"2024-09-21T00:14:09.964230+0000","last_became_peered":"2024-09-21T00:14:09.964230+0000","last_unstale":"2024-09-21T00:14:15.967160+0000","last_undegraded":"2024-09-21T00:14:15.967160+0000","last_fullsized":"2024-09-21T00:14:15.967160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:12.855251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123529+0000","last_change":"2024-09-21T00:14:09.971876+0000","last_active":"2024-09-21T00:14:16.123529+0000","last_peered":"2024-09-21T00:14:16.123529+0000","last_clean":"2024-09-21T00:14:16.123529+0000","last_became_active":"2024-09-21T00:14:09.968741+0000","last_became_peered":"2024-09-21T00:14:09.968741+0000","last_unstale":"2024-09-21T00:14:16.123529+0000","last_undegraded":"2024-09-21T00:14:16.123529+0000","last_fullsized":"2024-09-21T00:14:16.123529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:16.513288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123468+0000","last_change":"2024-09-21T00:14:09.957134+0000","last_active":"2024-09-21T00:14:16.123468+0000","last_peered":"2024-09-21T00:14:16.123468+0000","last_clean":"2024-09-21T00:14:16.123468+0000","last_became_active":"2024-09-21T00:14:09.956848+0000","last_became_peered":"2024-09-21T00:14:09.956848+0000","last_unstale":"2024-09-21T00:14:16.123468+0000","last_undegraded":"2024-09-21T00:14:16.123468+0000","last_fullsized":"2024-09-21T00:14:16.123468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:42.044497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973970+0000","last_change":"2024-09-21T00:14:09.969393+0000","last_active":"2024-09-21T00:14:14.973970+0000","last_peered":"2024-09-21T00:14:14.973970+0000","last_clean":"2024-09-21T00:14:14.973970+0000","last_became_active":"2024-09-21T00:14:09.967322+0000","last_became_peered":"2024-09-21T00:14:09.967322+0000","last_unstale":"2024-09-21T00:14:14.973970+0000","last_undegraded":"2024-09-21T00:14:14.973970+0000","last_fullsized":"2024-09-21T00:14:14.973970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:13.058730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967420+0000","last_change":"2024-09-21T00:14:09.975534+0000","last_active":"2024-09-21T00:14:15.967420+0000","last_peered":"2024-09-21T00:14:15.967420+0000","last_clean":"2024-09-21T00:14:15.967420+0000","last_became_active":"2024-09-21T00:14:09.975223+0000","last_became_peered":"2024-09-21T00:14:09.975223+0000","last_unstale":"2024-09-21T00:14:15.967420+0000","last_undegraded":"2024-09-21T00:14:15.967420+0000","last_fullsized":"2024-09-21T00:14:15.967420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:34.284952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500162+0000","last_change":"2024-09-21T00:14:09.955799+0000","last_active":"2024-09-21T00:14:15.500162+0000","last_peered":"2024-09-21T00:14:15.500162+0000","last_clean":"2024-09-21T00:14:15.500162+0000","last_became_active":"2024-09-21T00:14:09.955490+0000","last_became_peered":"2024-09-21T00:14:09.955490+0000","last_unstale":"2024-09-21T00:14:15.500162+0000","last_undegraded":"2024-09-21T00:14:15.500162+0000","last_fullsized":"2024-09-21T00:14:15.500162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:17.805417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966906+0000","last_change":"2024-09-21T00:14:09.967087+0000","last_active":"2024-09-21T00:14:15.966906+0000","last_peered":"2024-09-21T00:14:15.966906+0000","last_clean":"2024-09-21T00:14:15.966906+0000","last_became_active":"2024-09-21T00:14:09.966758+0000","last_became_peered":"2024-09-21T00:14:09.966758+0000","last_unstale":"2024-09-21T00:14:15.966906+0000","last_undegraded":"2024-09-21T00:14:15.966906+0000","last_fullsized":"2024-09-21T00:14:15.966906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:56.369574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122953+0000","last_change":"2024-09-21T00:14:09.959275+0000","last_active":"2024-09-21T00:14:16.122953+0000","last_peered":"2024-09-21T00:14:16.122953+0000","last_clean":"2024-09-21T00:14:16.122953+0000","last_became_active":"2024-09-21T00:14:09.956637+0000","last_became_peered":"2024-09-21T00:14:09.956637+0000","last_unstale":"2024-09-21T00:14:16.122953+0000","last_undegraded":"2024-09-21T00:14:16.122953+0000","last_fullsized":"2024-09-21T00:14:16.122953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:18.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978300+0000","last_change":"2024-09-21T00:14:09.966758+0000","last_active":"2024-09-21T00:14:14.978300+0000","last_peered":"2024-09-21T00:14:14.978300+0000","last_clean":"2024-09-21T00:14:14.978300+0000","last_became_active":"2024-09-21T00:14:09.966435+0000","last_became_peered":"2024-09-21T00:14:09.966435+0000","last_unstale":"2024-09-21T00:14:14.978300+0000","last_undegraded":"2024-09-21T00:14:14.978300+0000","last_fullsized":"2024-09-21T00:14:14.978300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:14.814291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122756+0000","last_change":"2024-09-21T00:14:09.970050+0000","last_active":"2024-09-21T00:14:16.122756+0000","last_peered":"2024-09-21T00:14:16.122756+0000","last_clean":"2024-09-21T00:14:16.122756+0000","last_became_active":"2024-09-21T00:14:09.969400+0000","last_became_peered":"2024-09-21T00:14:09.969400+0000","last_unstale":"2024-09-21T00:14:16.122756+0000","last_undegraded":"2024-09-21T00:14:16.122756+0000","last_fullsized":"2024-09-21T00:14:16.122756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:10.275524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501120+0000","last_change":"2024-09-21T00:14:09.967005+0000","last_active":"2024-09-21T00:14:15.501120+0000","last_peered":"2024-09-21T00:14:15.501120+0000","last_clean":"2024-09-21T00:14:15.501120+0000","last_became_active":"2024-09-21T00:14:09.966713+0000","last_became_peered":"2024-09-21T00:14:09.966713+0000","last_unstale":"2024-09-21T00:14:15.501120+0000","last_undegraded":"2024-09-21T00:14:15.501120+0000","last_fullsized":"2024-09-21T00:14:15.501120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:46.902750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978761+0000","last_change":"2024-09-21T00:14:09.963493+0000","last_active":"2024-09-21T00:14:14.978761+0000","last_peered":"2024-09-21T00:14:14.978761+0000","last_clean":"2024-09-21T00:14:14.978761+0000","last_became_active":"2024-09-21T00:14:09.963165+0000","last_became_peered":"2024-09-21T00:14:09.963165+0000","last_unstale":"2024-09-21T00:14:14.978761+0000","last_undegraded":"2024-09-21T00:14:14.978761+0000","last_fullsized":"2024-09-21T00:14:14.978761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501052+0000","last_change":"2024-09-21T00:14:09.958838+0000","last_active":"2024-09-21T00:14:15.501052+0000","last_peered":"2024-09-21T00:14:15.501052+0000","last_clean":"2024-09-21T00:14:15.501052+0000","last_became_active":"2024-09-21T00:14:09.958571+0000","last_became_peered":"2024-09-21T00:14:09.958571+0000","last_unstale":"2024-09-21T00:14:15.501052+0000","last_undegraded":"2024-09-21T00:14:15.501052+0000","last_fullsized":"2024-09-21T00:14:15.501052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:25.477700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500012+0000","last_change":"2024-09-21T00:14:09.966624+0000","last_active":"2024-09-21T00:14:15.500012+0000","last_peered":"2024-09-21T00:14:15.500012+0000","last_clean":"2024-09-21T00:14:15.500012+0000","last_became_active":"2024-09-21T00:14:09.966263+0000","last_became_peered":"2024-09-21T00:14:09.966263+0000","last_unstale":"2024-09-21T00:14:15.500012+0000","last_undegraded":"2024-09-21T00:14:15.500012+0000","last_fullsized":"2024-09-21T00:14:15.500012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:34.688163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966562+0000","last_change":"2024-09-21T00:14:09.968374+0000","last_active":"2024-09-21T00:14:15.966562+0000","last_peered":"2024-09-21T00:14:15.966562+0000","last_clean":"2024-09-21T00:14:15.966562+0000","last_became_active":"2024-09-21T00:14:09.966302+0000","last_became_peered":"2024-09-21T00:14:09.966302+0000","last_unstale":"2024-09-21T00:14:15.966562+0000","last_undegraded":"2024-09-21T00:14:15.966562+0000","last_fullsized":"2024-09-21T00:14:15.966562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:02.471950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122938+0000","last_change":"2024-09-21T00:14:09.957691+0000","last_active":"2024-09-21T00:14:16.122938+0000","last_peered":"2024-09-21T00:14:16.122938+0000","last_clean":"2024-09-21T00:14:16.122938+0000","last_became_active":"2024-09-21T00:14:09.957412+0000","last_became_peered":"2024-09-21T00:14:09.957412+0000","last_unstale":"2024-09-21T00:14:16.122938+0000","last_undegraded":"2024-09-21T00:14:16.122938+0000","last_fullsized":"2024-09-21T00:14:16.122938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.535510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123180+0000","last_change":"2024-09-21T00:14:09.975745+0000","last_active":"2024-09-21T00:14:16.123180+0000","last_peered":"2024-09-21T00:14:16.123180+0000","last_clean":"2024-09-21T00:14:16.123180+0000","last_became_active":"2024-09-21T00:14:09.975384+0000","last_became_peered":"2024-09-21T00:14:09.975384+0000","last_unstale":"2024-09-21T00:14:16.123180+0000","last_undegraded":"2024-09-21T00:14:16.123180+0000","last_fullsized":"2024-09-21T00:14:16.123180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:07.322051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123056+0000","last_change":"2024-09-21T00:14:09.969705+0000","last_active":"2024-09-21T00:14:16.123056+0000","last_peered":"2024-09-21T00:14:16.123056+0000","last_clean":"2024-09-21T00:14:16.123056+0000","last_became_active":"2024-09-21T00:14:09.969022+0000","last_became_peered":"2024-09-21T00:14:09.969022+0000","last_unstale":"2024-09-21T00:14:16.123056+0000","last_undegraded":"2024-09-21T00:14:16.123056+0000","last_fullsized":"2024-09-21T00:14:16.123056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:00.965737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123003+0000","last_change":"2024-09-21T00:14:09.967788+0000","last_active":"2024-09-21T00:14:16.123003+0000","last_peered":"2024-09-21T00:14:16.123003+0000","last_clean":"2024-09-21T00:14:16.123003+0000","last_became_active":"2024-09-21T00:14:09.967437+0000","last_became_peered":"2024-09-21T00:14:09.967437+0000","last_unstale":"2024-09-21T00:14:16.123003+0000","last_undegraded":"2024-09-21T00:14:16.123003+0000","last_fullsized":"2024-09-21T00:14:16.123003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:10.161637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122640+0000","last_change":"2024-09-21T00:14:09.964594+0000","last_active":"2024-09-21T00:14:16.122640+0000","last_peered":"2024-09-21T00:14:16.122640+0000","last_clean":"2024-09-21T00:14:16.122640+0000","last_became_active":"2024-09-21T00:14:09.964239+0000","last_became_peered":"2024-09-21T00:14:09.964239+0000","last_unstale":"2024-09-21T00:14:16.122640+0000","last_undegraded":"2024-09-21T00:14:16.122640+0000","last_fullsized":"2024-09-21T00:14:16.122640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:17.805417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123967+0000","last_change":"2024-09-21T00:14:09.970898+0000","last_active":"2024-09-21T00:14:16.123967+0000","last_peered":"2024-09-21T00:14:16.123967+0000","last_clean":"2024-09-21T00:14:16.123967+0000","last_became_active":"2024-09-21T00:14:09.970587+0000","last_became_peered":"2024-09-21T00:14:09.970587+0000","last_unstale":"2024-09-21T00:14:16.123967+0000","last_undegraded":"2024-09-21T00:14:16.123967+0000","last_fullsized":"2024-09-21T00:14:16.123967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966562+0000","last_change":"2024-09-21T00:14:09.967642+0000","last_active":"2024-09-21T00:14:15.966562+0000","last_peered":"2024-09-21T00:14:15.966562+0000","last_clean":"2024-09-21T00:14:15.966562+0000","last_became_active":"2024-09-21T00:14:09.967322+0000","last_became_peered":"2024-09-21T00:14:09.967322+0000","last_unstale":"2024-09-21T00:14:15.966562+0000","last_undegraded":"2024-09-21T00:14:15.966562+0000","last_fullsized":"2024-09-21T00:14:15.966562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:40.005906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122249+0000","last_change":"2024-09-21T00:14:09.953742+0000","last_active":"2024-09-21T00:14:16.122249+0000","last_peered":"2024-09-21T00:14:16.122249+0000","last_clean":"2024-09-21T00:14:16.122249+0000","last_became_active":"2024-09-21T00:14:09.953446+0000","last_became_peered":"2024-09-21T00:14:09.953446+0000","last_unstale":"2024-09-21T00:14:16.122249+0000","last_undegraded":"2024-09-21T00:14:16.122249+0000","last_fullsized":"2024-09-21T00:14:16.122249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:02:57.284191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973747+0000","last_change":"2024-09-21T00:14:09.955667+0000","last_active":"2024-09-21T00:14:14.973747+0000","last_peered":"2024-09-21T00:14:14.973747+0000","last_clean":"2024-09-21T00:14:14.973747+0000","last_became_active":"2024-09-21T00:14:09.955303+0000","last_became_peered":"2024-09-21T00:14:09.955303+0000","last_unstale":"2024-09-21T00:14:14.973747+0000","last_undegraded":"2024-09-21T00:14:14.973747+0000","last_fullsized":"2024-09-21T00:14:14.973747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122650+0000","last_change":"2024-09-21T00:14:09.964455+0000","last_active":"2024-09-21T00:14:16.122650+0000","last_peered":"2024-09-21T00:14:16.122650+0000","last_clean":"2024-09-21T00:14:16.122650+0000","last_became_active":"2024-09-21T00:14:09.964121+0000","last_became_peered":"2024-09-21T00:14:09.964121+0000","last_unstale":"2024-09-21T00:14:16.122650+0000","last_undegraded":"2024-09-21T00:14:16.122650+0000","last_fullsized":"2024-09-21T00:14:16.122650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:02.020147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973720+0000","last_change":"2024-09-21T00:14:09.944636+0000","last_active":"2024-09-21T00:14:14.973720+0000","last_peered":"2024-09-21T00:14:14.973720+0000","last_clean":"2024-09-21T00:14:14.973720+0000","last_became_active":"2024-09-21T00:14:09.944026+0000","last_became_peered":"2024-09-21T00:14:09.944026+0000","last_unstale":"2024-09-21T00:14:14.973720+0000","last_undegraded":"2024-09-21T00:14:14.973720+0000","last_fullsized":"2024-09-21T00:14:14.973720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.302969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967108+0000","last_change":"2024-09-21T00:14:09.969613+0000","last_active":"2024-09-21T00:14:15.967108+0000","last_peered":"2024-09-21T00:14:15.967108+0000","last_clean":"2024-09-21T00:14:15.967108+0000","last_became_active":"2024-09-21T00:14:09.969262+0000","last_became_peered":"2024-09-21T00:14:09.969262+0000","last_unstale":"2024-09-21T00:14:15.967108+0000","last_undegraded":"2024-09-21T00:14:15.967108+0000","last_fullsized":"2024-09-21T00:14:15.967108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:39.405316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967234+0000","last_change":"2024-09-21T00:14:09.960527+0000","last_active":"2024-09-21T00:14:15.967234+0000","last_peered":"2024-09-21T00:14:15.967234+0000","last_clean":"2024-09-21T00:14:15.967234+0000","last_became_active":"2024-09-21T00:14:09.960225+0000","last_became_peered":"2024-09-21T00:14:09.960225+0000","last_unstale":"2024-09-21T00:14:15.967234+0000","last_undegraded":"2024-09-21T00:14:15.967234+0000","last_fullsized":"2024-09-21T00:14:15.967234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:48.961824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123379+0000","last_change":"2024-09-21T00:14:09.977233+0000","last_active":"2024-09-21T00:14:16.123379+0000","last_peered":"2024-09-21T00:14:16.123379+0000","last_clean":"2024-09-21T00:14:16.123379+0000","last_became_active":"2024-09-21T00:14:09.968098+0000","last_became_peered":"2024-09-21T00:14:09.968098+0000","last_unstale":"2024-09-21T00:14:16.123379+0000","last_undegraded":"2024-09-21T00:14:16.123379+0000","last_fullsized":"2024-09-21T00:14:16.123379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:56:31.946410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:14:28.949 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T00:14:28.950 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-21T00:14:28.950 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T00:14:29.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.206+0000 7fc117e00640 1 -- 172.21.15.83:0/714104963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11006ff00 msgr2=0x7fc110070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:29.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.206+0000 7fc117e00640 1 --2- 172.21.15.83:0/714104963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11006ff00 0x7fc110070b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009830 tx=0x7fc0fc02a510 comp rx=0 tx=0).stop 2024-09-21T00:14:29.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.206+0000 7fc117e00640 1 -- 172.21.15.83:0/714104963 shutdown_connections 2024-09-21T00:14:29.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.206+0000 7fc117e00640 1 --2- 172.21.15.83:0/714104963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11006ff00 0x7fc110070b50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.206+0000 7fc117e00640 1 --2- 172.21.15.83:0/714104963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100706e0 0x7fc11015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.206+0000 7fc117e00640 1 -- 172.21.15.83:0/714104963 >> 172.21.15.83:0/714104963 conn(0x7fc1100cdca0 msgr2=0x7fc1100ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:29.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.206+0000 7fc117e00640 1 -- 172.21.15.83:0/714104963 shutdown_connections 2024-09-21T00:14:29.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.206+0000 7fc117e00640 1 -- 172.21.15.83:0/714104963 wait complete. 2024-09-21T00:14:29.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.208+0000 7fc117e00640 1 Processor -- start 2024-09-21T00:14:29.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.209+0000 7fc117e00640 1 -- start start 2024-09-21T00:14:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc117e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc11006ff00 0x7fc11015f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc117e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100706e0 0x7fc11015fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc117e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc110071090 0x7fc110160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc117e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc110162bb0 con 0x7fc11006ff00 2024-09-21T00:14:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc117e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc110070310 con 0x7fc110071090 2024-09-21T00:14:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc117e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc110162d30 con 0x7fc1100706e0 2024-09-21T00:14:29.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc115400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc11006ff00 0x7fc11015f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc115400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc11006ff00 0x7fc11015f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46456/0 (socket says 172.21.15.83:46456) 2024-09-21T00:14:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc115400640 1 -- 172.21.15.83:0/2967546058 learned_addr learned my addr 172.21.15.83:0/2967546058 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc114a00640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100706e0 0x7fc11015fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.210+0000 7fc115e00640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc110071090 0x7fc110160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.211+0000 7fc115400640 1 -- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100706e0 msgr2=0x7fc11015fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.211+0000 7fc115400640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100706e0 0x7fc11015fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.211+0000 7fc115400640 1 -- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc110071090 msgr2=0x7fc110160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.211+0000 7fc115400640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc110071090 0x7fc110160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.211+0000 7fc115400640 1 -- 172.21.15.83:0/2967546058 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1100b2810 con 0x7fc11006ff00 2024-09-21T00:14:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.211+0000 7fc115400640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc11006ff00 0x7fc11015f8a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc10400ef60 tx=0x7fc10400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.211+0000 7fc10d600640 1 -- 172.21.15.83:0/2967546058 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc104003970 con 0x7fc11006ff00 2024-09-21T00:14:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.212+0000 7fc10d600640 1 -- 172.21.15.83:0/2967546058 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc104003c00 con 0x7fc11006ff00 2024-09-21T00:14:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.212+0000 7fc117e00640 1 -- 172.21.15.83:0/2967546058 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1100b2ab0 con 0x7fc11006ff00 2024-09-21T00:14:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.212+0000 7fc10d600640 1 -- 172.21.15.83:0/2967546058 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc104004020 con 0x7fc11006ff00 2024-09-21T00:14:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.212+0000 7fc117e00640 1 -- 172.21.15.83:0/2967546058 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc110160920 con 0x7fc11006ff00 2024-09-21T00:14:29.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.213+0000 7fc117e00640 1 -- 172.21.15.83:0/2967546058 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc110163250 con 0x7fc11006ff00 2024-09-21T00:14:29.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.214+0000 7fc10d600640 1 -- 172.21.15.83:0/2967546058 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc104009780 con 0x7fc11006ff00 2024-09-21T00:14:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.215+0000 7fc10d600640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc0f0078bc0 0x7fc0f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.215+0000 7fc10d600640 1 -- 172.21.15.83:0/2967546058 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc10409b7d0 con 0x7fc11006ff00 2024-09-21T00:14:29.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.215+0000 7fc114a00640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc0f0078bc0 0x7fc0f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:29.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.216+0000 7fc114a00640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc0f0078bc0 0x7fc0f007b0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc034000 tx=0x7fc0fc004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:29.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.219+0000 7fc10d600640 1 -- 172.21.15.83:0/2967546058 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc104063280 con 0x7fc11006ff00 2024-09-21T00:14:29.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.405+0000 7fc117e00640 1 -- 172.21.15.83:0/2967546058 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fc1100b2c80 con 0x7fc11006ff00 2024-09-21T00:14:29.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.406+0000 7fc10d600640 1 -- 172.21.15.83:0/2967546058 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7fc104067cb0 con 0x7fc11006ff00 2024-09-21T00:14:29.407 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:29.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 -- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc0f0078bc0 msgr2=0x7fc0f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:29.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc0f0078bc0 0x7fc0f007b0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc034000 tx=0x7fc0fc004730 comp rx=0 tx=0).stop 2024-09-21T00:14:29.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 -- 172.21.15.83:0/2967546058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc11006ff00 msgr2=0x7fc11015f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:29.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc11006ff00 0x7fc11015f8a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc10400ef60 tx=0x7fc10400ef90 comp rx=0 tx=0).stop 2024-09-21T00:14:29.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 -- 172.21.15.83:0/2967546058 shutdown_connections 2024-09-21T00:14:29.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc0f0078bc0 0x7fc0f007b0d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc110071090 0x7fc110160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100706e0 0x7fc11015fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 --2- 172.21.15.83:0/2967546058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc11006ff00 0x7fc11015f8a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 -- 172.21.15.83:0/2967546058 >> 172.21.15.83:0/2967546058 conn(0x7fc1100cdca0 msgr2=0x7fc1100d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:29.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 -- 172.21.15.83:0/2967546058 shutdown_connections 2024-09-21T00:14:29.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.408+0000 7fc117e00640 1 -- 172.21.15.83:0/2967546058 wait complete. 2024-09-21T00:14:29.430 INFO:teuthology.orchestra.run.smithi083.stdout:[{"version":31,"timestamp":"2024-09-21T00:13:57.410127+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"3210.622046"}]}] 2024-09-21T00:14:29.430 INFO:tasks.ceph_manager:config epoch is 31 2024-09-21T00:14:29.431 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T00:14:29.431 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T00:14:29.431 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T00:14:29.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.648+0000 7fc9efc00640 1 -- 172.21.15.83:0/3538794050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e815b9f0 msgr2=0x7fc9e80cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:29.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.648+0000 7fc9efc00640 1 --2- 172.21.15.83:0/3538794050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e815b9f0 0x7fc9e80cf930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8005fd0 tx=0x7fc9d802a5d0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.648+0000 7fc9efc00640 1 -- 172.21.15.83:0/3538794050 shutdown_connections 2024-09-21T00:14:29.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.648+0000 7fc9efc00640 1 --2- 172.21.15.83:0/3538794050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9e815f5a0 0x7fc9e815f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.648+0000 7fc9efc00640 1 --2- 172.21.15.83:0/3538794050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e815b9f0 0x7fc9e80cf930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.648+0000 7fc9efc00640 1 -- 172.21.15.83:0/3538794050 >> 172.21.15.83:0/3538794050 conn(0x7fc9e80cca40 msgr2=0x7fc9e80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:29.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.648+0000 7fc9efc00640 1 -- 172.21.15.83:0/3538794050 shutdown_connections 2024-09-21T00:14:29.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.648+0000 7fc9efc00640 1 -- 172.21.15.83:0/3538794050 wait complete. 2024-09-21T00:14:29.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.650+0000 7fc9efc00640 1 Processor -- start 2024-09-21T00:14:29.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.650+0000 7fc9efc00640 1 -- start start 2024-09-21T00:14:29.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9efc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9e80cefa0 0x7fc9e809eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:29.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9efc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9e815b9f0 0x7fc9e81f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:29.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9efc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e815f5a0 0x7fc9e809a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:29.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9efc00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e806df70 con 0x7fc9e815f5a0 2024-09-21T00:14:29.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9efc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e806ddf0 con 0x7fc9e80cefa0 2024-09-21T00:14:29.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9efc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e806e0f0 con 0x7fc9e815b9f0 2024-09-21T00:14:29.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9edc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e815f5a0 0x7fc9e809a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:29.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9edc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e815f5a0 0x7fc9e809a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46474/0 (socket says 172.21.15.83:46474) 2024-09-21T00:14:29.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9edc00640 1 -- 172.21.15.83:0/2287715537 learned_addr learned my addr 172.21.15.83:0/2287715537 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:29.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9ed200640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9e80cefa0 0x7fc9e809eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:29.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9dfe00640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9e815b9f0 0x7fc9e81f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:29.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9edc00640 1 -- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9e815b9f0 msgr2=0x7fc9e81f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:29.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.652+0000 7fc9edc00640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9e815b9f0 0x7fc9e81f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.653+0000 7fc9edc00640 1 -- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9e80cefa0 msgr2=0x7fc9e809eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:29.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.653+0000 7fc9edc00640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9e80cefa0 0x7fc9e809eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.653+0000 7fc9edc00640 1 -- 172.21.15.83:0/2287715537 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e809f1e0 con 0x7fc9e815f5a0 2024-09-21T00:14:29.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.653+0000 7fc9edc00640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e815f5a0 0x7fc9e809a9e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000e9c0 tx=0x7fc9e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:29.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.653+0000 7fc9e5600640 1 -- 172.21.15.83:0/2287715537 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0004d20 con 0x7fc9e815f5a0 2024-09-21T00:14:29.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.653+0000 7fc9e5600640 1 -- 172.21.15.83:0/2287715537 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9e000cb20 con 0x7fc9e815f5a0 2024-09-21T00:14:29.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.653+0000 7fc9efc00640 1 -- 172.21.15.83:0/2287715537 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e809f470 con 0x7fc9e815f5a0 2024-09-21T00:14:29.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.653+0000 7fc9e5600640 1 -- 172.21.15.83:0/2287715537 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0005020 con 0x7fc9e815f5a0 2024-09-21T00:14:29.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.653+0000 7fc9efc00640 1 -- 172.21.15.83:0/2287715537 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e80b4f10 con 0x7fc9e815f5a0 2024-09-21T00:14:29.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.654+0000 7fc9efc00640 1 -- 172.21.15.83:0/2287715537 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e806e610 con 0x7fc9e815f5a0 2024-09-21T00:14:29.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.655+0000 7fc9e5600640 1 -- 172.21.15.83:0/2287715537 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9e00051c0 con 0x7fc9e815f5a0 2024-09-21T00:14:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.656+0000 7fc9e5600640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc9c4078b90 0x7fc9c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.656+0000 7fc9e5600640 1 -- 172.21.15.83:0/2287715537 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc9e009b9b0 con 0x7fc9e815f5a0 2024-09-21T00:14:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.657+0000 7fc9ed200640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc9c4078b90 0x7fc9c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:29.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.658+0000 7fc9ed200640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc9c4078b90 0x7fc9c407b0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8033000 tx=0x7fc9d8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:29.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.661+0000 7fc9e5600640 1 -- 172.21.15.83:0/2287715537 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc9e0016030 con 0x7fc9e815f5a0 2024-09-21T00:14:29.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.893+0000 7fc9efc00640 1 -- 172.21.15.83:0/2287715537 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc9e815fb50 con 0x7fc9e815f5a0 2024-09-21T00:14:29.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.897+0000 7fc9e5600640 1 -- 172.21.15.83:0/2287715537 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194722 (secure 0 0 0) 0x7fc9e00633c0 con 0x7fc9e815f5a0 2024-09-21T00:14:29.900 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:29.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 -- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc9c4078b90 msgr2=0x7fc9c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:29.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc9c4078b90 0x7fc9c407b0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8033000 tx=0x7fc9d8004730 comp rx=0 tx=0).stop 2024-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 -- 172.21.15.83:0/2287715537 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e815f5a0 msgr2=0x7fc9e809a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e815f5a0 0x7fc9e809a9e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000e9c0 tx=0x7fc9e000ee80 comp rx=0 tx=0).stop 2024-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 -- 172.21.15.83:0/2287715537 shutdown_connections 2024-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc9c4078b90 0x7fc9c407b0a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9e815f5a0 0x7fc9e809a9e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9e815b9f0 0x7fc9e81f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 --2- 172.21.15.83:0/2287715537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9e80cefa0 0x7fc9e809eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 -- 172.21.15.83:0/2287715537 >> 172.21.15.83:0/2287715537 conn(0x7fc9e80cca40 msgr2=0x7fc9e80afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 -- 172.21.15.83:0/2287715537 shutdown_connections 2024-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:29.900+0000 7fc9efc00640 1 -- 172.21.15.83:0/2287715537 wait complete. 2024-09-21T00:14:29.925 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":5,"flags":0,"active_gid":4117,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3113341479},{"type":"v1","addr":"172.21.15.142:6801","nonce":3113341479}]},"active_addr":"172.21.15.142:6801/3113341479","active_change":"2024-09-21T00:13:46.833600+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2183969189}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1543923898}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2662051594}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2853486864}]}]} 2024-09-21T00:14:29.929 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T00:14:29.930 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T00:14:29.930 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:30.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.155+0000 7feba6800640 1 -- 172.21.15.83:0/2233440816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba0073dd0 msgr2=0x7feba006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:30.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.155+0000 7feba6800640 1 --2- 172.21.15.83:0/2233440816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba0073dd0 0x7feba006ddf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb88005fd0 tx=0x7feb8802a5d0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.155+0000 7feba6800640 1 -- 172.21.15.83:0/2233440816 shutdown_connections 2024-09-21T00:14:30.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.155+0000 7feba6800640 1 --2- 172.21.15.83:0/2233440816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba0073dd0 0x7feba006ddf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.155+0000 7feba6800640 1 -- 172.21.15.83:0/2233440816 >> 172.21.15.83:0/2233440816 conn(0x7feba00cca40 msgr2=0x7feba00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:30.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.155+0000 7feba6800640 1 -- 172.21.15.83:0/2233440816 shutdown_connections 2024-09-21T00:14:30.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.155+0000 7feba6800640 1 -- 172.21.15.83:0/2233440816 wait complete. 2024-09-21T00:14:30.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.159+0000 7feba6800640 1 Processor -- start 2024-09-21T00:14:30.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.159+0000 7feba6800640 1 -- start start 2024-09-21T00:14:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feba6800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba006e330 0x7feba015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feba6800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba0073dd0 0x7feba01f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feba6800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba0074cb0 0x7feba00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feba6800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feba006f670 con 0x7feba006e330 2024-09-21T00:14:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feba6800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feba006f4f0 con 0x7feba0074cb0 2024-09-21T00:14:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feba6800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7feba006f7f0 con 0x7feba0073dd0 2024-09-21T00:14:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feb9f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba006e330 0x7feba015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feb9f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba006e330 0x7feba015e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46488/0 (socket says 172.21.15.83:46488) 2024-09-21T00:14:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feb9f400640 1 -- 172.21.15.83:0/4007220121 learned_addr learned my addr 172.21.15.83:0/4007220121 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feb97e00640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba0073dd0 0x7feba01f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.162+0000 7feb9fe00640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba0074cb0 0x7feba00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feb9f400640 1 -- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba0073dd0 msgr2=0x7feba01f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feb9f400640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba0073dd0 0x7feba01f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feb9f400640 1 -- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba0074cb0 msgr2=0x7feba00c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feb9f400640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba0074cb0 0x7feba00c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feb9f400640 1 -- 172.21.15.83:0/4007220121 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba00a0ec0 con 0x7feba006e330 2024-09-21T00:14:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feb9f400640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba006e330 0x7feba015e2c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c3a0 tx=0x7feb9000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feb97400640 1 -- 172.21.15.83:0/4007220121 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90017070 con 0x7feba006e330 2024-09-21T00:14:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feb97400640 1 -- 172.21.15.83:0/4007220121 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb900053c0 con 0x7feba006e330 2024-09-21T00:14:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feb97400640 1 -- 172.21.15.83:0/4007220121 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90003850 con 0x7feba006e330 2024-09-21T00:14:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feba6800640 1 -- 172.21.15.83:0/4007220121 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba0151e40 con 0x7feba006e330 2024-09-21T00:14:30.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.163+0000 7feba6800640 1 -- 172.21.15.83:0/4007220121 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba01f7fa0 con 0x7feba006e330 2024-09-21T00:14:30.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.165+0000 7feba6800640 1 -- 172.21.15.83:0/4007220121 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba0159d50 con 0x7feba006e330 2024-09-21T00:14:30.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.166+0000 7feb97400640 1 -- 172.21.15.83:0/4007220121 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb9001a070 con 0x7feba006e330 2024-09-21T00:14:30.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.167+0000 7feb97400640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7feb7c078b90 0x7feb7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:30.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.167+0000 7feb97400640 1 -- 172.21.15.83:0/4007220121 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7feb9009a230 con 0x7feba006e330 2024-09-21T00:14:30.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.167+0000 7feb97e00640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7feb7c078b90 0x7feb7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:30.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.168+0000 7feb97e00640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7feb7c078b90 0x7feb7c07b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb88033000 tx=0x7feb88004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.171+0000 7feb97400640 1 -- 172.21.15.83:0/4007220121 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feba0159d50 con 0x7feba006e330 2024-09-21T00:14:30.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.356+0000 7feba6800640 1 -- 172.21.15.83:0/4007220121 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feba006e120 con 0x7feba006e330 2024-09-21T00:14:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.357+0000 7feb97400640 1 -- 172.21.15.83:0/4007220121 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7feba006e120 con 0x7feba006e330 2024-09-21T00:14:30.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:30.359 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":27,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:14.484147+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 -- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7feb7c078b90 msgr2=0x7feb7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7feb7c078b90 0x7feb7c07b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb88033000 tx=0x7feb88004730 comp rx=0 tx=0).stop 2024-09-21T00:14:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 -- 172.21.15.83:0/4007220121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba006e330 msgr2=0x7feba015e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba006e330 0x7feba015e2c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c3a0 tx=0x7feb9000c860 comp rx=0 tx=0).stop 2024-09-21T00:14:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 -- 172.21.15.83:0/4007220121 shutdown_connections 2024-09-21T00:14:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7feb7c078b90 0x7feb7c07b0a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba0074cb0 0x7feba00c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba0073dd0 0x7feba01f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 --2- 172.21.15.83:0/4007220121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba006e330 0x7feba015e2c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 -- 172.21.15.83:0/4007220121 >> 172.21.15.83:0/4007220121 conn(0x7feba00cca40 msgr2=0x7feba00ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 -- 172.21.15.83:0/4007220121 shutdown_connections 2024-09-21T00:14:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.360+0000 7feba6800640 1 -- 172.21.15.83:0/4007220121 wait complete. 2024-09-21T00:14:30.383 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T00:14:30.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.600+0000 7f0389800640 1 -- 172.21.15.83:0/582049769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f038406ddf0 msgr2=0x7f038406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.600+0000 7f0389800640 1 --2- 172.21.15.83:0/582049769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f038406ddf0 0x7f038406e200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0384076360 tx=0x7f037c02aa30 comp rx=0 tx=0).stop 2024-09-21T00:14:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.601+0000 7f0389800640 1 -- 172.21.15.83:0/582049769 shutdown_connections 2024-09-21T00:14:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.601+0000 7f0389800640 1 --2- 172.21.15.83:0/582049769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f038406ddf0 0x7f038406e200 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.601+0000 7f0389800640 1 --2- 172.21.15.83:0/582049769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cbc10 0x7f03840cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.601+0000 7f0389800640 1 --2- 172.21.15.83:0/582049769 >> v2:172.21.15.142:3300/0 conn(0x7f0384074cb0 0x7f0384073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.601+0000 7f0389800640 1 -- 172.21.15.83:0/582049769 >> 172.21.15.83:0/582049769 conn(0x7f03840cca40 msgr2=0x7f03840cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.601+0000 7f0389800640 1 -- 172.21.15.83:0/582049769 shutdown_connections 2024-09-21T00:14:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.601+0000 7f0389800640 1 -- 172.21.15.83:0/582049769 wait complete. 2024-09-21T00:14:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.603+0000 7f0389800640 1 Processor -- start 2024-09-21T00:14:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.603+0000 7f0389800640 1 -- start start 2024-09-21T00:14:30.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.604+0000 7f0389800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f038406ddf0 0x7f0384152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:30.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.604+0000 7f0389800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0384074cb0 0x7f0384156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:30.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0389800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cbc10 0x7f0384153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0389800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f038406f170 con 0x7f038406ddf0 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0389800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f038406eff0 con 0x7f0384074cb0 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0389800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f038406f2f0 con 0x7f03840cbc10 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0382a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f038406ddf0 0x7f0384152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0382a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f038406ddf0 0x7f0384152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46512/0 (socket says 172.21.15.83:46512) 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0382a00640 1 -- 172.21.15.83:0/989481124 learned_addr learned my addr 172.21.15.83:0/989481124 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0383400640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cbc10 0x7f0384153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0382000640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0384074cb0 0x7f0384156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0382a00640 1 -- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cbc10 msgr2=0x7f0384153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0382a00640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cbc10 0x7f0384153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0382a00640 1 -- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0384074cb0 msgr2=0x7f0384156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0382a00640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0384074cb0 0x7f0384156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0382a00640 1 -- 172.21.15.83:0/989481124 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0384155e80 con 0x7f038406ddf0 2024-09-21T00:14:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.605+0000 7f0382a00640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f038406ddf0 0x7f0384152700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f037400d680 tx=0x7f037400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:30.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.606+0000 7f037aa00640 1 -- 172.21.15.83:0/989481124 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374017070 con 0x7f038406ddf0 2024-09-21T00:14:30.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.606+0000 7f037aa00640 1 -- 172.21.15.83:0/989481124 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0374009b10 con 0x7f038406ddf0 2024-09-21T00:14:30.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.606+0000 7f0389800640 1 -- 172.21.15.83:0/989481124 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0384156160 con 0x7f038406ddf0 2024-09-21T00:14:30.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.606+0000 7f037aa00640 1 -- 172.21.15.83:0/989481124 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374010460 con 0x7f038406ddf0 2024-09-21T00:14:30.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.606+0000 7f0389800640 1 -- 172.21.15.83:0/989481124 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0384156720 con 0x7f038406ddf0 2024-09-21T00:14:30.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.607+0000 7f0389800640 1 -- 172.21.15.83:0/989481124 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038415fae0 con 0x7f038406ddf0 2024-09-21T00:14:30.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.608+0000 7f037aa00640 1 -- 172.21.15.83:0/989481124 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f037401a070 con 0x7f038406ddf0 2024-09-21T00:14:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.609+0000 7f037aa00640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0364078bc0 0x7f036407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.609+0000 7f037aa00640 1 -- 172.21.15.83:0/989481124 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f037409b1f0 con 0x7f038406ddf0 2024-09-21T00:14:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.609+0000 7f0382000640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0364078bc0 0x7f036407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:30.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.610+0000 7f0382000640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0364078bc0 0x7f036407b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f03841f7210 tx=0x7f0370005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:30.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.614+0000 7f037aa00640 1 -- 172.21.15.83:0/989481124 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0374063250 con 0x7f038406ddf0 2024-09-21T00:14:30.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.829+0000 7f0389800640 1 -- 172.21.15.83:0/989481124 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f038415a0b0 con 0x7f038406ddf0 2024-09-21T00:14:30.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.830+0000 7f037aa00640 1 -- 172.21.15.83:0/989481124 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f0374062b50 con 0x7f038406ddf0 2024-09-21T00:14:30.831 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:30.831 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":27,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:14.484147+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.832+0000 7f0389800640 1 -- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0364078bc0 msgr2=0x7f036407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.832+0000 7f0389800640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0364078bc0 0x7f036407b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f03841f7210 tx=0x7f0370005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.832+0000 7f0389800640 1 -- 172.21.15.83:0/989481124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f038406ddf0 msgr2=0x7f0384152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.832+0000 7f0389800640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f038406ddf0 0x7f0384152700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f037400d680 tx=0x7f037400db40 comp rx=0 tx=0).stop 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.832+0000 7f0389800640 1 -- 172.21.15.83:0/989481124 shutdown_connections 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.833+0000 7f0389800640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0364078bc0 0x7f036407b0d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.833+0000 7f0389800640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cbc10 0x7f0384153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.833+0000 7f0389800640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0384074cb0 0x7f0384156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.833+0000 7f0389800640 1 --2- 172.21.15.83:0/989481124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f038406ddf0 0x7f0384152700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.833+0000 7f0389800640 1 -- 172.21.15.83:0/989481124 >> 172.21.15.83:0/989481124 conn(0x7f03840cca40 msgr2=0x7f038415aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.833+0000 7f0389800640 1 -- 172.21.15.83:0/989481124 shutdown_connections 2024-09-21T00:14:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:30.833+0000 7f0389800640 1 -- 172.21.15.83:0/989481124 wait complete. 2024-09-21T00:14:30.855 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T00:14:30.856 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T00:14:30.856 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T00:14:30.857 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T00:14:30.857 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T00:14:30.857 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T00:14:30.858 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T00:14:30.858 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T00:14:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.245+0000 7f8b1b000640 1 -- 172.21.15.83:0/3564622457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b0c036400 msgr2=0x7f8b0c036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.245+0000 7f8b1b000640 1 --2- 172.21.15.83:0/3564622457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b0c036400 0x7f8b0c036810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8b1406c560 tx=0x7f8b140a6450 comp rx=0 tx=0).stop 2024-09-21T00:14:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.245+0000 7f8b1b000640 1 -- 172.21.15.83:0/3564622457 shutdown_connections 2024-09-21T00:14:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.245+0000 7f8b1b000640 1 --2- 172.21.15.83:0/3564622457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b0c036400 0x7f8b0c036810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.245+0000 7f8b1b000640 1 --2- 172.21.15.83:0/3564622457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b0c009ba0 0x7f8b0c005c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.245+0000 7f8b1b000640 1 -- 172.21.15.83:0/3564622457 >> 172.21.15.83:0/3564622457 conn(0x7f8b0c051420 msgr2=0x7f8b0c051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.247+0000 7f8b1b000640 1 -- 172.21.15.83:0/3564622457 shutdown_connections 2024-09-21T00:14:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.247+0000 7f8b1b000640 1 -- 172.21.15.83:0/3564622457 wait complete. 2024-09-21T00:14:31.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.250+0000 7f8b1b000640 1 Processor -- start 2024-09-21T00:14:31.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.251+0000 7f8b1b000640 1 -- start start 2024-09-21T00:14:31.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.253+0000 7f8b1b000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b0c009ba0 0x7f8b0c020040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.253+0000 7f8b1b000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b0c00bc30 0x7f8b0c0da930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.253+0000 7f8b1b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b0c036400 0x7f8b0c17e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.253+0000 7f8b1b000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c006a70 con 0x7f8b0c00bc30 2024-09-21T00:14:31.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.253+0000 7f8b1b000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c0068f0 con 0x7f8b0c009ba0 2024-09-21T00:14:31.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.253+0000 7f8b1b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0c006bf0 con 0x7f8b0c036400 2024-09-21T00:14:31.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.255+0000 7f8b19c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b0c009ba0 0x7f8b0c020040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.255+0000 7f8b19c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b0c009ba0 0x7f8b0c020040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:34630/0 (socket says 172.21.15.83:34630) 2024-09-21T00:14:31.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.255+0000 7f8b19200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b0c00bc30 0x7f8b0c0da930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.255+0000 7f8b19c00640 1 -- 172.21.15.83:0/1085760429 learned_addr learned my addr 172.21.15.83:0/1085760429 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.255+0000 7f8b1a600640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b0c036400 0x7f8b0c17e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.256+0000 7f8b19c00640 1 -- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b0c036400 msgr2=0x7f8b0c17e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.256+0000 7f8b19c00640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b0c036400 0x7f8b0c17e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.256+0000 7f8b19c00640 1 -- 172.21.15.83:0/1085760429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b0c00bc30 msgr2=0x7f8b0c0da930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.256+0000 7f8b19c00640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b0c00bc30 0x7f8b0c0da930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.256+0000 7f8b19c00640 1 -- 172.21.15.83:0/1085760429 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c022330 con 0x7f8b0c009ba0 2024-09-21T00:14:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.256+0000 7f8b19200640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b0c00bc30 0x7f8b0c0da930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.257+0000 7f8b19c00640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b0c009ba0 0x7f8b0c020040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800c3c0 tx=0x7f8b0800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.258+0000 7f8b11600640 1 -- 172.21.15.83:0/1085760429 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b080052d0 con 0x7f8b0c009ba0 2024-09-21T00:14:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.258+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0c01efa0 con 0x7f8b0c009ba0 2024-09-21T00:14:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.258+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0c01f560 con 0x7f8b0c009ba0 2024-09-21T00:14:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.259+0000 7f6d9dc00640 1 -- 172.21.15.83:0/2585655323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d7c004800 msgr2=0x7f6d7c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.259+0000 7f6d9dc00640 1 --2- 172.21.15.83:0/2585655323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d7c004800 0x7f6d7c004c10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800bb20 tx=0x7f6d7c005830 comp rx=0 tx=0).stop 2024-09-21T00:14:31.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.260+0000 7f6d97400640 1 -- 172.21.15.83:0/2585655323 reap_dead start 2024-09-21T00:14:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.259+0000 7f8b11600640 1 -- 172.21.15.83:0/1085760429 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b08007020 con 0x7f8b0c009ba0 2024-09-21T00:14:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.259+0000 7f8b11600640 1 -- 172.21.15.83:0/1085760429 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08007470 con 0x7f8b0c009ba0 2024-09-21T00:14:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.260+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8af0001030 con 0x7f8b0c009ba0 2024-09-21T00:14:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.261+0000 7f6d9dc00640 1 -- 172.21.15.83:0/2585655323 shutdown_connections 2024-09-21T00:14:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.261+0000 7f6d9dc00640 1 -- 172.21.15.83:0/2585655323 >> 172.21.15.83:0/2585655323 conn(0x7f6d980b1b90 msgr2=0x7f6d980b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.261+0000 7fa26f400640 1 -- 172.21.15.83:0/2363912815 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2640047a0 con 0x7fa27015e990 2024-09-21T00:14:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.261+0000 7f6d9dc00640 1 -- 172.21.15.83:0/2585655323 shutdown_connections 2024-09-21T00:14:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.261+0000 7f6d9dc00640 1 -- 172.21.15.83:0/2585655323 wait complete. 2024-09-21T00:14:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.262+0000 7fa277400640 1 -- 172.21.15.83:0/2363912815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27015e990 msgr2=0x7fa2700cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.262+0000 7fa277400640 1 --2- 172.21.15.83:0/2363912815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27015e990 0x7fa2700cee70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa2700d01f0 tx=0x7fa26402a650 comp rx=0 tx=0).stop 2024-09-21T00:14:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.262+0000 7fa277400640 1 -- 172.21.15.83:0/2363912815 shutdown_connections 2024-09-21T00:14:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.262+0000 7fa277400640 1 --2- 172.21.15.83:0/2363912815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27015e990 0x7fa2700cee70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.262+0000 7fa277400640 1 -- 172.21.15.83:0/2363912815 >> 172.21.15.83:0/2363912815 conn(0x7fa2700735d0 msgr2=0x7fa2700739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.263+0000 7fa277400640 1 -- 172.21.15.83:0/2363912815 shutdown_connections 2024-09-21T00:14:31.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.264+0000 7fd59fe00640 1 -- 172.21.15.83:0/2869128834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd598009ba0 msgr2=0x7fd5980df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.264+0000 7fd59fe00640 1 --2- 172.21.15.83:0/2869128834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd598009ba0 0x7fd5980df180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5a006c560 tx=0x7fd5a00a6360 comp rx=0 tx=0).stop 2024-09-21T00:14:31.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.263+0000 7fa277400640 1 -- 172.21.15.83:0/2363912815 wait complete. 2024-09-21T00:14:31.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.263+0000 7f95ea000640 1 -- 172.21.15.83:0/1680271094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95dc005c60 msgr2=0x7f95dc01ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.263+0000 7f95ea000640 1 --2- 172.21.15.83:0/1680271094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95dc005c60 0x7f95dc01ccc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f95d400b9c0 tx=0x7f95d402c280 comp rx=0 tx=0).stop 2024-09-21T00:14:31.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.264+0000 7f8b11600640 1 -- 172.21.15.83:0/1085760429 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b080067d0 con 0x7f8b0c009ba0 2024-09-21T00:14:31.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.265+0000 7f95ea000640 1 -- 172.21.15.83:0/1680271094 shutdown_connections 2024-09-21T00:14:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.265+0000 7f95ea000640 1 --2- 172.21.15.83:0/1680271094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95dc005c60 0x7f95dc01ccc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.265+0000 7f95ea000640 1 --2- 172.21.15.83:0/1680271094 >> v2:172.21.15.142:3300/0 conn(0x7f95dc00bc30 0x7f95dc0df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.265+0000 7f95ea000640 1 -- 172.21.15.83:0/1680271094 >> 172.21.15.83:0/1680271094 conn(0x7f95dc051420 msgr2=0x7f95dc051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.265+0000 7fd59fe00640 1 -- 172.21.15.83:0/2869128834 shutdown_connections 2024-09-21T00:14:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.265+0000 7fd59fe00640 1 --2- 172.21.15.83:0/2869128834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd598009ba0 0x7fd5980df180 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.265+0000 7fd59fe00640 1 -- 172.21.15.83:0/2869128834 >> 172.21.15.83:0/2869128834 conn(0x7fd598051420 msgr2=0x7fd598051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.265+0000 7f95ea000640 1 -- 172.21.15.83:0/1680271094 shutdown_connections 2024-09-21T00:14:31.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.265+0000 7fd59fe00640 1 -- 172.21.15.83:0/2869128834 shutdown_connections 2024-09-21T00:14:31.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.265+0000 7f95ea000640 1 -- 172.21.15.83:0/1680271094 wait complete. 2024-09-21T00:14:31.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.266+0000 7f8b11600640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8af4078b90 0x7f8af407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.266+0000 7fd59fe00640 1 -- 172.21.15.83:0/2869128834 wait complete. 2024-09-21T00:14:31.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.266+0000 7f6d9dc00640 1 Processor -- start 2024-09-21T00:14:31.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.266+0000 7f8b11600640 1 -- 172.21.15.83:0/1085760429 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8b0809a4f0 con 0x7f8b0c009ba0 2024-09-21T00:14:31.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.266+0000 7f8b11600640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] conn(0x7f8af40822d0 0x7f8af4084760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.267+0000 7f8b11600640 1 -- 172.21.15.83:0/1085760429 --> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b0800ae50 con 0x7f8af40822d0 2024-09-21T00:14:31.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.267+0000 7f8b11600640 1 -- 172.21.15.83:0/1085760429 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b080a1050 con 0x7f8b0c009ba0 2024-09-21T00:14:31.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.267+0000 7f8b19200640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8af4078b90 0x7f8af407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.267+0000 7fa277400640 1 Processor -- start 2024-09-21T00:14:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.266+0000 7f6d9dc00640 1 -- start start 2024-09-21T00:14:31.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.267+0000 7f8b1a600640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] conn(0x7f8af40822d0 0x7f8af4084760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.267+0000 7fa277400640 1 -- start start 2024-09-21T00:14:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.269+0000 7fd59fe00640 1 Processor -- start 2024-09-21T00:14:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.269+0000 7fd59fe00640 1 -- start start 2024-09-21T00:14:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.269+0000 7f6d9dc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d7c004800 0x7f6d98149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7f6d9dc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d9814c120 0x7f6d9809cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7f95ea000640 1 Processor -- start 2024-09-21T00:14:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7f95ea000640 1 -- start start 2024-09-21T00:14:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7fa277400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2700cf3b0 0x7fa270151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7f6d9dc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d9815d020 0x7f6d9815d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7f6d96000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d9814c120 0x7f6d9809cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7f6d9dc00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9815e6b0 con 0x7f6d9814c120 2024-09-21T00:14:31.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7f6d96000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d9814c120 0x7f6d9809cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46562/0 (socket says 172.21.15.83:46562) 2024-09-21T00:14:31.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7f6d9dc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9815f8b0 con 0x7f6d9815d020 2024-09-21T00:14:31.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7f6d96000640 1 -- 172.21.15.83:0/1905002200 learned_addr learned my addr 172.21.15.83:0/1905002200 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6d9815e830 con 0x7f6d7c004800 2024-09-21T00:14:31.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.271+0000 7f6d97400640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d9815d020 0x7f6d9815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7fa277400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa27015e990 0x7fa2700c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7fa277400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27015add0 0x7fa2700c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7fa277400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa2700cc900 con 0x7fa27015e990 2024-09-21T00:14:31.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7fa277400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa2700cc780 con 0x7fa27015add0 2024-09-21T00:14:31.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.270+0000 7fa277400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa2700cca80 con 0x7fa2700cf3b0 2024-09-21T00:14:31.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.271+0000 7f6d96000640 1 -- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d7c004800 msgr2=0x7f6d98149ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T00:14:31.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.271+0000 7fa274a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2700cf3b0 0x7fa270151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.271+0000 7fa275400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27015add0 0x7fa2700c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.271+0000 7f6d96000640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d7c004800 0x7f6d98149ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7f6d96000640 1 -- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d9815d020 msgr2=0x7f6d9815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.268+0000 7f8b19200640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8af4078b90 0x7f8af407b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b00006fd0 tx=0x7f8b00008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7f8b1a600640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] conn(0x7f8af40822d0 0x7f8af4084760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7f6d96000640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d9815d020 0x7f6d9815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7fd59fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd598005c60 0x7fd59816e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7fd59fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd598009ba0 0x7fd59817df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7fd59fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd59817e4a0 0x7fd59801f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7fd59e000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd598009ba0 0x7fd59817df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7fd59e000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd598009ba0 0x7fd59817df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46578/0 (socket says 172.21.15.83:46578) 2024-09-21T00:14:31.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7fd59e000640 1 -- 172.21.15.83:0/2389574237 learned_addr learned my addr 172.21.15.83:0/2389574237 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7fd59ea00640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd598005c60 0x7fd59816e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7fd59f400640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd59817e4a0 0x7fd59801f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd598006d70 con 0x7fd598009ba0 2024-09-21T00:14:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd59800be40 con 0x7fd59817e4a0 2024-09-21T00:14:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd598006ef0 con 0x7fd598005c60 2024-09-21T00:14:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7fa274a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2700cf3b0 0x7fa270151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:57396/0 (socket says 172.21.15.83:57396) 2024-09-21T00:14:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7fa274a00640 1 -- 172.21.15.83:0/4144226236 learned_addr learned my addr 172.21.15.83:0/4144226236 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7f6d96000640 1 -- 172.21.15.83:0/1905002200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d980a1250 con 0x7f6d9814c120 2024-09-21T00:14:31.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7f6d97400640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d9815d020 0x7f6d9815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f95ea000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95dc005c60 0x7f95dc021920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.272+0000 7fa26fe00640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa27015e990 0x7fa2700c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f95ea000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95dc009ba0 0x7f95dc17e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f95ea000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95dc00bc30 0x7f95dc043350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f95ea000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc01d410 con 0x7f95dc00bc30 2024-09-21T00:14:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f95ea000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc036400 con 0x7f95dc005c60 2024-09-21T00:14:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f95ea000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f95dc043c50 con 0x7f95dc009ba0 2024-09-21T00:14:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f8b11600640 1 -- 172.21.15.83:0/1085760429 <== osd.0 v2:172.21.15.83:6816/3973258171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b0800ae50 con 0x7f8af40822d0 2024-09-21T00:14:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f6d96000640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d9814c120 0x7f6d9809cce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800ba40 tx=0x7f6d88031f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f8cf7600640 1 -- 172.21.15.83:0/1855107351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cd8005130 msgr2=0x7f8cd80037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fa275400640 1 -- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2700cf3b0 msgr2=0x7fa270151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fa275400640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2700cf3b0 0x7fa270151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fa275400640 1 -- 172.21.15.83:0/4144226236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa27015e990 msgr2=0x7fa2700c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fa275400640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa27015e990 0x7fa2700c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fa275400640 1 -- 172.21.15.83:0/4144226236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2700b4c40 con 0x7fa27015add0 2024-09-21T00:14:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7f8cf7600640 1 --2- 172.21.15.83:0/1855107351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cd8005130 0x7f8cd80037a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8011f40 tx=0x7f8cd8005830 comp rx=0 tx=0).stop 2024-09-21T00:14:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fd59f400640 1 -- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd598005c60 msgr2=0x7fd59816e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fd59f400640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd598005c60 0x7fd59816e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fd59f400640 1 -- 172.21.15.83:0/2389574237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd598009ba0 msgr2=0x7fd59817df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fd59f400640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd598009ba0 0x7fd59817df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fd59f400640 1 -- 172.21.15.83:0/2389574237 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59816cb50 con 0x7fd59817e4a0 2024-09-21T00:14:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7f8cf5600640 1 -- 172.21.15.83:0/1855107351 reap_dead start 2024-09-21T00:14:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7fa274a00640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2700cf3b0 0x7fa270151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:14:31.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7f6d8ea00640 1 -- 172.21.15.83:0/1905002200 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88040070 con 0x7f6d9814c120 2024-09-21T00:14:31.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7f6d8ea00640 1 -- 172.21.15.83:0/1905002200 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d88004320 con 0x7f6d9814c120 2024-09-21T00:14:31.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7f6d8ea00640 1 -- 172.21.15.83:0/1905002200 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88035040 con 0x7f6d9814c120 2024-09-21T00:14:31.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7fd59f400640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd59817e4a0 0x7fd59801f220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00c4d0 tx=0x7fd58c00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7fa275400640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27015add0 0x7fa2700c7ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa26800c6e0 tx=0x7fa26800cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7f8cf7600640 1 -- 172.21.15.83:0/1855107351 shutdown_connections 2024-09-21T00:14:31.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7f8cf7600640 1 -- 172.21.15.83:0/1855107351 >> 172.21.15.83:0/1855107351 conn(0x7f8ce8021df0 msgr2=0x7f8ce8058bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f95e2a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95dc009ba0 0x7f95dc17e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7f95e2a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95dc009ba0 0x7f95dc17e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:57428/0 (socket says 172.21.15.83:57428) 2024-09-21T00:14:31.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.274+0000 7f95e2a00640 1 -- 172.21.15.83:0/97092933 learned_addr learned my addr 172.21.15.83:0/97092933 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f95e3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95dc00bc30 0x7f95dc043350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.273+0000 7f95e3400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95dc005c60 0x7f95dc021920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9814c980 con 0x7f6d9814c120 2024-09-21T00:14:31.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7f8cf7600640 1 -- 172.21.15.83:0/1855107351 shutdown_connections 2024-09-21T00:14:31.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7f95e2a00640 1 -- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95dc005c60 msgr2=0x7f95dc021920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7f95e2a00640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95dc005c60 0x7f95dc021920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7f95e2a00640 1 -- 172.21.15.83:0/97092933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95dc00bc30 msgr2=0x7f95dc043350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.276+0000 7fa26cc00640 1 -- 172.21.15.83:0/4144226236 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268003b70 con 0x7fa27015add0 2024-09-21T00:14:31.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.276+0000 7fa26cc00640 1 -- 172.21.15.83:0/4144226236 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa268003d30 con 0x7fa27015add0 2024-09-21T00:14:31.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.276+0000 7fa26cc00640 1 -- 172.21.15.83:0/4144226236 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268005330 con 0x7fa27015add0 2024-09-21T00:14:31.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.276+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2701f9750 con 0x7fa27015add0 2024-09-21T00:14:31.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.276+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2700ae170 con 0x7fa27015add0 2024-09-21T00:14:31.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d980b3250 con 0x7f6d9814c120 2024-09-21T00:14:31.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.276+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d9815edc0 con 0x7f6d9814c120 2024-09-21T00:14:31.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.276+0000 7fd596a00640 1 -- 172.21.15.83:0/2389574237 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0035f0 con 0x7fd59817e4a0 2024-09-21T00:14:31.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.276+0000 7fd596a00640 1 -- 172.21.15.83:0/2389574237 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd58c003790 con 0x7fd59817e4a0 2024-09-21T00:14:31.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.276+0000 7fd596a00640 1 -- 172.21.15.83:0/2389574237 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c003be0 con 0x7fd59817e4a0 2024-09-21T00:14:31.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.277+0000 7fa4d1200640 1 -- 172.21.15.83:0/95659266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc15f6d0 msgr2=0x7fa4cc15e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.277+0000 7fa4d1200640 1 --2- 172.21.15.83:0/95659266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc15f6d0 0x7fa4cc15e3d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc005fd0 tx=0x7fa4bc02a5d0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.277+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59816ce30 con 0x7fd59817e4a0 2024-09-21T00:14:31.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.277+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59816d3f0 con 0x7fd59817e4a0 2024-09-21T00:14:31.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.278+0000 7f95e2a00640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95dc00bc30 0x7f95dc043350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.278+0000 7f95e2a00640 1 -- 172.21.15.83:0/97092933 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95dc046c10 con 0x7f95dc009ba0 2024-09-21T00:14:31.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.278+0000 7f95e3e00640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95dc00bc30 0x7f95dc043350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:31.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.278+0000 7f6d8ea00640 1 -- 172.21.15.83:0/1905002200 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6d88038020 con 0x7f6d9814c120 2024-09-21T00:14:31.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.275+0000 7f8cf7600640 1 -- 172.21.15.83:0/1855107351 wait complete. 2024-09-21T00:14:31.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.279+0000 7f95e2a00640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95dc009ba0 0x7f95dc17e270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c400 tx=0x7f95d800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.278+0000 7fa4d1200640 1 -- 172.21.15.83:0/95659266 shutdown_connections 2024-09-21T00:14:31.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.279+0000 7fa4d1200640 1 --2- 172.21.15.83:0/95659266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc0cef00 0x7fa4cc0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.279+0000 7fa4d1200640 1 --2- 172.21.15.83:0/95659266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc15f6d0 0x7fa4cc15e3d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.279+0000 7fa4d1200640 1 -- 172.21.15.83:0/95659266 >> 172.21.15.83:0/95659266 conn(0x7fa4cc0d41e0 msgr2=0x7fa4cc0d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.279+0000 7fa4d1200640 1 -- 172.21.15.83:0/95659266 shutdown_connections 2024-09-21T00:14:31.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.279+0000 7f95d3400640 1 -- 172.21.15.83:0/97092933 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8011790 con 0x7f95dc009ba0 2024-09-21T00:14:31.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.279+0000 7f95d3400640 1 -- 172.21.15.83:0/97092933 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95d8017070 con 0x7f95dc009ba0 2024-09-21T00:14:31.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.279+0000 7f95d3400640 1 -- 172.21.15.83:0/97092933 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8011ca0 con 0x7f95dc009ba0 2024-09-21T00:14:31.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.279+0000 7fa4d1200640 1 -- 172.21.15.83:0/95659266 wait complete. 2024-09-21T00:14:31.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.280+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95dc17eb80 con 0x7f95dc009ba0 2024-09-21T00:14:31.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.280+0000 7f6d8ea00640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6d74078c60 0x7f6d7407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.280+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f95dc17f140 con 0x7f95dc009ba0 2024-09-21T00:14:31.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.280+0000 7f6d8ea00640 1 -- 172.21.15.83:0/1905002200 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6d880bc0a0 con 0x7f6d9814c120 2024-09-21T00:14:31.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.280+0000 7f6d8ea00640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] conn(0x7f6d74082430 0x7f6d740848c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.280+0000 7f6d8ea00640 1 -- 172.21.15.83:0/1905002200 --> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d88032e50 con 0x7f6d74082430 2024-09-21T00:14:31.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.280+0000 7f6d8ea00640 1 -- 172.21.15.83:0/1905002200 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6d880bc490 con 0x7f6d9814c120 2024-09-21T00:14:31.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.281+0000 7f6d96a00640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6d74078c60 0x7f6d7407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.281+0000 7f6d97400640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] conn(0x7f6d74082430 0x7f6d740848c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.280+0000 7f8cf7600640 1 Processor -- start 2024-09-21T00:14:31.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.280+0000 7f8cf7600640 1 -- start start 2024-09-21T00:14:31.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.281+0000 7f6d96a00640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6d74078c60 0x7f6d7407b170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6d80000f70 tx=0x7f6d80006b10 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.279+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd598007420 con 0x7fd59817e4a0 2024-09-21T00:14:31.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.282+0000 7f6d97400640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] conn(0x7f6d74082430 0x7f6d740848c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.282+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95dc0df180 con 0x7f95dc009ba0 2024-09-21T00:14:31.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.280+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2700cee70 con 0x7fa27015add0 2024-09-21T00:14:31.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.283+0000 7f6d8ea00640 1 -- 172.21.15.83:0/1905002200 <== osd.3 v2:172.21.15.83:6824/1075763441 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d88032e50 con 0x7f6d74082430 2024-09-21T00:14:31.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.283+0000 7f8cf7600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8cd8005130 0x7f8ce80e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.283+0000 7f8cf7600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce803d050 0x7f8ce803d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.283+0000 7f8cf7600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce8180850 0x7f8ce8180c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.283+0000 7f8cf7600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce8038130 con 0x7f8cd8005130 2024-09-21T00:14:31.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.283+0000 7fd596a00640 1 -- 172.21.15.83:0/2389574237 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd58c012400 con 0x7fd59817e4a0 2024-09-21T00:14:31.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.283+0000 7f8cf7600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce8037fb0 con 0x7f8ce803d050 2024-09-21T00:14:31.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.283+0000 7f8cf7600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce80382b0 con 0x7f8ce8180850 2024-09-21T00:14:31.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.283+0000 7f8cf5600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce8180850 0x7f8ce8180c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.284+0000 7f8cf5600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce8180850 0x7f8ce8180c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:57444/0 (socket says 172.21.15.83:57444) 2024-09-21T00:14:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.284+0000 7f8cf5600640 1 -- 172.21.15.83:0/793478759 learned_addr learned my addr 172.21.15.83:0/793478759 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.284+0000 7f8cf5600640 1 -- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce803d050 msgr2=0x7f8ce803d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.285+0000 7fd596a00640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd580078c60 0x7fd58007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.285+0000 7fa4d1200640 1 Processor -- start 2024-09-21T00:14:31.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.285+0000 7fd596a00640 1 -- 172.21.15.83:0/2389574237 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd58c09ad20 con 0x7fd59817e4a0 2024-09-21T00:14:31.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.285+0000 7fd59ea00640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd580078c60 0x7fd58007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.285+0000 7fa4d1200640 1 -- start start 2024-09-21T00:14:31.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.285+0000 7fd596a00640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] conn(0x7fd580082420 0x7fd5800848b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.285+0000 7fd596a00640 1 -- 172.21.15.83:0/2389574237 --> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd580084f80 con 0x7fd580082420 2024-09-21T00:14:31.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.286+0000 7fd596a00640 1 -- 172.21.15.83:0/2389574237 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd58c09b110 con 0x7fd59817e4a0 2024-09-21T00:14:31.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.286+0000 7fd59e000640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] conn(0x7fd580082420 0x7fd5800848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.286+0000 7fd59ea00640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd580078c60 0x7fd58007b170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd59801da50 tx=0x7fd5a00a8070 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.286+0000 7f95d3400640 1 -- 172.21.15.83:0/97092933 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95d801c460 con 0x7f95dc009ba0 2024-09-21T00:14:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.286+0000 7f8cf4c00640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8cd8005130 0x7f8ce80e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.287+0000 7f8cefe00640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce803d050 0x7f8ce803d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.287+0000 7f8cf5600640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce803d050 0x7f8ce803d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.287+0000 7f8cf5600640 1 -- 172.21.15.83:0/793478759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8cd8005130 msgr2=0x7f8ce80e0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.287+0000 7f8cf5600640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8cd8005130 0x7f8ce80e0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.287+0000 7f8cf5600640 1 -- 172.21.15.83:0/793478759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce81811a0 con 0x7f8ce8180850 2024-09-21T00:14:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.287+0000 7f8cf4c00640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8cd8005130 0x7f8ce80e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.287+0000 7f8cefe00640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce803d050 0x7f8ce803d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.288+0000 7f8cf5600640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce8180850 0x7f8ce8180c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80057e0 tx=0x7f8cdc00da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.288+0000 7f8cecc00640 1 -- 172.21.15.83:0/793478759 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc016070 con 0x7f8ce8180850 2024-09-21T00:14:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.288+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce80e1510 con 0x7f8ce8180850 2024-09-21T00:14:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.288+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce818a8c0 con 0x7f8ce8180850 2024-09-21T00:14:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.288+0000 7f8cecc00640 1 -- 172.21.15.83:0/793478759 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cdc005310 con 0x7f8ce8180850 2024-09-21T00:14:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.288+0000 7fd59e000640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] conn(0x7fd580082420 0x7fd5800848b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.284+0000 7fa26cc00640 1 -- 172.21.15.83:0/4144226236 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa2680054d0 con 0x7fa27015add0 2024-09-21T00:14:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.285+0000 7fa26cc00640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa254078be0 0x7fa25407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.286+0000 7fa26cc00640 1 -- 172.21.15.83:0/4144226236 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa26809a800 con 0x7fa27015add0 2024-09-21T00:14:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.286+0000 7fa26cc00640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] conn(0x7fa2540823b0 0x7fa254084840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.286+0000 7fa26cc00640 1 -- 172.21.15.83:0/4144226236 --> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa26801ae50 con 0x7fa2540823b0 2024-09-21T00:14:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.286+0000 7fa26cc00640 1 -- 172.21.15.83:0/4144226236 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa2680a1050 con 0x7fa27015add0 2024-09-21T00:14:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.288+0000 7f8cecc00640 1 -- 172.21.15.83:0/793478759 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc016070 con 0x7f8ce8180850 2024-09-21T00:14:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.288+0000 7fa4d1200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc0cef00 0x7fa4cc159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.289+0000 7fa4d1200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15f6d0 0x7fa4cc0ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.289+0000 7fa4cb400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc0cef00 0x7fa4cc159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.289+0000 7fa4cb400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc0cef00 0x7fa4cc159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:34704/0 (socket says 172.21.15.83:34704) 2024-09-21T00:14:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.289+0000 7fa4cb400640 1 -- 172.21.15.83:0/1185461383 learned_addr learned my addr 172.21.15.83:0/1185461383 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.289+0000 7fa4d1200640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4cc162240 0x7fa4cc0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.288+0000 7f95d3400640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f95c8078b90 0x7f95c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.288+0000 7f95d3400640 1 -- 172.21.15.83:0/97092933 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f95d809b0f0 con 0x7f95dc009ba0 2024-09-21T00:14:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.289+0000 7f95d3400640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] conn(0x7f95c8082350 0x7f95c80847e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.289+0000 7f95d3400640 1 -- 172.21.15.83:0/97092933 --> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95c8084eb0 con 0x7f95c8082350 2024-09-21T00:14:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.289+0000 7f95d3400640 1 -- 172.21.15.83:0/97092933 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f95d809b4e0 con 0x7f95dc009ba0 2024-09-21T00:14:31.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.289+0000 7f95e3400640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f95c8078b90 0x7f95c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.289+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc0d32a0 con 0x7fa4cc162240 2024-09-21T00:14:31.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.290+0000 7fa274a00640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa254078be0 0x7fa25407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.290+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc06dd20 con 0x7fa4cc0cef00 2024-09-21T00:14:31.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.290+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa4cc0d3420 con 0x7fa4cc15f6d0 2024-09-21T00:14:31.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.290+0000 7fd596a00640 1 -- 172.21.15.83:0/2389574237 <== osd.1 v2:172.21.15.83:6808/1381138332 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd580084f80 con 0x7fd580082420 2024-09-21T00:14:31.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.290+0000 7fa26fe00640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] conn(0x7fa2540823b0 0x7fa254084840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.290+0000 7fa4cbe00640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4cc162240 0x7fa4cc0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.290+0000 7fa4caa00640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15f6d0 0x7fa4cc0ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.290+0000 7f95e3400640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f95c8078b90 0x7f95c807b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f95e407acc0 tx=0x7f95e4051fb0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.290+0000 7fa4cb400640 1 -- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15f6d0 msgr2=0x7fa4cc0ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7fa4cb400640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15f6d0 0x7fa4cc0ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7f95e3e00640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] conn(0x7f95c8082350 0x7f95c80847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7fa4cb400640 1 -- 172.21.15.83:0/1185461383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4cc162240 msgr2=0x7fa4cc0acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7fa4cb400640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4cc162240 0x7fa4cc0acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ccc001030 con 0x7f8ce8180850 2024-09-21T00:14:31.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7fa4cb400640 1 -- 172.21.15.83:0/1185461383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc15aae0 con 0x7fa4cc0cef00 2024-09-21T00:14:31.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7fa26fe00640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] conn(0x7fa2540823b0 0x7fa254084840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7fa4caa00640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15f6d0 0x7fa4cc0ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:31.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7fa4cbe00640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4cc162240 0x7fa4cc0acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:31.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7fc8f9a00640 1 -- 172.21.15.83:0/485355286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f406ddf0 msgr2=0x7fc8f406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.291+0000 7fc8f9a00640 1 --2- 172.21.15.83:0/485355286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f406ddf0 0x7fc8f406e200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009860 tx=0x7fc8e002a460 comp rx=0 tx=0).stop 2024-09-21T00:14:31.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.292+0000 7fa274a00640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa254078be0 0x7fa25407b0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa264009230 tx=0x7fa264004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.292+0000 7fc8f9a00640 1 -- 172.21.15.83:0/485355286 shutdown_connections 2024-09-21T00:14:31.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.292+0000 7fc8f9a00640 1 --2- 172.21.15.83:0/485355286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f4072d90 0x7fc8f40731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.292+0000 7fc8f9a00640 1 --2- 172.21.15.83:0/485355286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f406ddf0 0x7fc8f406e200 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.292+0000 7fc8f9a00640 1 -- 172.21.15.83:0/485355286 >> 172.21.15.83:0/485355286 conn(0x7fc8f40b1b90 msgr2=0x7fc8f40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.292+0000 7fc8f9a00640 1 -- 172.21.15.83:0/485355286 shutdown_connections 2024-09-21T00:14:31.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.292+0000 7f95e3e00640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] conn(0x7f95c8082350 0x7f95c80847e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.292+0000 7fa4cb400640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc0cef00 0x7fa4cc159c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc034040 tx=0x7fa4bc003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.293+0000 7fa4c3400640 1 -- 172.21.15.83:0/1185461383 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc03e030 con 0x7fa4cc0cef00 2024-09-21T00:14:31.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.293+0000 7fa4c3400640 1 -- 172.21.15.83:0/1185461383 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4bc003c20 con 0x7fa4cc0cef00 2024-09-21T00:14:31.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.293+0000 7fa4c3400640 1 -- 172.21.15.83:0/1185461383 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc035040 con 0x7fa4cc0cef00 2024-09-21T00:14:31.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.293+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc0cb300 con 0x7fa4cc0cef00 2024-09-21T00:14:31.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.293+0000 7f8cecc00640 1 -- 172.21.15.83:0/793478759 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8cdc0054e0 con 0x7f8ce8180850 2024-09-21T00:14:31.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.293+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc0ab950 con 0x7fa4cc0cef00 2024-09-21T00:14:31.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.294+0000 7f95d3400640 1 -- 172.21.15.83:0/97092933 <== osd.6 v2:172.21.15.142:6818/2503212538 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95c8084eb0 con 0x7f95c8082350 2024-09-21T00:14:31.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.294+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4cc0ce260 con 0x7fa4cc0cef00 2024-09-21T00:14:31.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.295+0000 7fa26cc00640 1 -- 172.21.15.83:0/4144226236 <== osd.2 v2:172.21.15.83:6800/4285051206 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa26801ae50 con 0x7fa2540823b0 2024-09-21T00:14:31.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.293+0000 7fc8f9a00640 1 -- 172.21.15.83:0/485355286 wait complete. 2024-09-21T00:14:31.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.295+0000 7f8cecc00640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8cd0078f90 0x7f8cd007b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.298+0000 7f8cecc00640 1 -- 172.21.15.83:0/793478759 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8cdc005020 con 0x7f8ce8180850 2024-09-21T00:14:31.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.298+0000 7f8cf4c00640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8cd0078f90 0x7f8cd007b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.298+0000 7f8cecc00640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] conn(0x7f8cd0082650 0x7f8cd0084ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.298+0000 7f8cecc00640 1 -- 172.21.15.83:0/793478759 --> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8cd00851b0 con 0x7f8cd0082650 2024-09-21T00:14:31.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.298+0000 7f8cecc00640 1 -- 172.21.15.83:0/793478759 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8cdc0a1050 con 0x7f8ce8180850 2024-09-21T00:14:31.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.298+0000 7fc8f9a00640 1 Processor -- start 2024-09-21T00:14:31.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.299+0000 7fc8f9a00640 1 -- start start 2024-09-21T00:14:31.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.299+0000 7f8cefe00640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] conn(0x7f8cd0082650 0x7f8cd0084ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.298+0000 7fa4c3400640 1 -- 172.21.15.83:0/1185461383 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa4bc041030 con 0x7fa4cc0cef00 2024-09-21T00:14:31.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.300+0000 7f8cf4c00640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8cd0078f90 0x7f8cd007b4a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0000b60 tx=0x7f8cf00770b0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.300+0000 7f8cefe00640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] conn(0x7f8cd0082650 0x7f8cd0084ae0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.300+0000 7fa4c3400640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa4ac078b90 0x7fa4ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.300+0000 7fa4c3400640 1 -- 172.21.15.83:0/1185461383 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa4bc0bba80 con 0x7fa4cc0cef00 2024-09-21T00:14:31.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.301+0000 7fa4caa00640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa4ac078b90 0x7fa4ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.301+0000 7fa4c3400640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] conn(0x7fa4ac082350 0x7fa4ac0847e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.301+0000 7fa4c3400640 1 -- 172.21.15.83:0/1185461383 --> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4bc005310 con 0x7fa4ac082350 2024-09-21T00:14:31.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.301+0000 7fa4c3400640 1 -- 172.21.15.83:0/1185461383 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa4bc0bbe70 con 0x7fa4cc0cef00 2024-09-21T00:14:31.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.301+0000 7fc8f9a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f406ddf0 0x7fc8f41571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.301+0000 7fc8f9a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f4072d90 0x7fc8f41f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.301+0000 7fc8f9a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f415ac20 0x7fc8f40c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.302+0000 7fa4caa00640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa4ac078b90 0x7fa4ac07b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0b75a0 tx=0x7fa4b8005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.301+0000 7fc8f9a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4071000 con 0x7fc8f4072d90 2024-09-21T00:14:31.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.301+0000 7fc8f9a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4070e80 con 0x7fc8f415ac20 2024-09-21T00:14:31.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.301+0000 7fc8f9a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f40736e0 con 0x7fc8f406ddf0 2024-09-21T00:14:31.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.302+0000 7fc8f2a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f406ddf0 0x7fc8f41571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.302+0000 7fc8f2a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f406ddf0 0x7fc8f41571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:57470/0 (socket says 172.21.15.83:57470) 2024-09-21T00:14:31.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.302+0000 7fc8f2a00640 1 -- 172.21.15.83:0/3128120462 learned_addr learned my addr 172.21.15.83:0/3128120462 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.302+0000 7fc8f2000640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f4072d90 0x7fc8f41f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.302+0000 7fa4cbe00640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] conn(0x7fa4ac082350 0x7fa4ac0847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.303+0000 7fc8f2a00640 1 -- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f415ac20 msgr2=0x7fc8f40c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.302+0000 7f8cecc00640 1 -- 172.21.15.83:0/793478759 <== osd.4 v2:172.21.15.142:6802/1069372226 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8cd00851b0 con 0x7f8cd0082650 2024-09-21T00:14:31.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.303+0000 7fc8f3400640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f415ac20 0x7fc8f40c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.303+0000 7fc8f2a00640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f415ac20 0x7fc8f40c5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.303+0000 7fc8f2a00640 1 -- 172.21.15.83:0/3128120462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f4072d90 msgr2=0x7fc8f41f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.303+0000 7fc8f2a00640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f4072d90 0x7fc8f41f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.303+0000 7fc8f2a00640 1 -- 172.21.15.83:0/3128120462 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f41f23f0 con 0x7fc8f406ddf0 2024-09-21T00:14:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.303+0000 7fc8f3400640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f415ac20 0x7fc8f40c5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.304+0000 7fc8f2000640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f4072d90 0x7fc8f41f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:14:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.304+0000 7fc8f2a00640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f406ddf0 0x7fc8f41571c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400c530 tx=0x7fc8e400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.304+0000 7fc8eaa00640 1 -- 172.21.15.83:0/3128120462 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4016020 con 0x7fc8f406ddf0 2024-09-21T00:14:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.304+0000 7fc8eaa00640 1 -- 172.21.15.83:0/3128120462 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8e4012920 con 0x7fc8f406ddf0 2024-09-21T00:14:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.304+0000 7fc8f9a00640 1 -- 172.21.15.83:0/3128120462 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f40b5510 con 0x7fc8f406ddf0 2024-09-21T00:14:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.305+0000 7fc8eaa00640 1 -- 172.21.15.83:0/3128120462 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4016020 con 0x7fc8f406ddf0 2024-09-21T00:14:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.305+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 --> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6d981fe120 con 0x7f6d74082430 2024-09-21T00:14:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.306+0000 7f6d8ea00640 1 -- 172.21.15.83:0/1905002200 <== osd.3 v2:172.21.15.83:6824/1075763441 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6d981fe120 con 0x7f6d74082430 2024-09-21T00:14:31.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.306+0000 7fc8f9a00640 1 -- 172.21.15.83:0/3128120462 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f40b2ed0 con 0x7fc8f406ddf0 2024-09-21T00:14:31.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.306+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 >> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] conn(0x7f6d74082430 msgr2=0x7f6d740848c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.307+0000 7f6d9dc00640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] conn(0x7f6d74082430 0x7f6d740848c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.307+0000 7fa4cbe00640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] conn(0x7fa4ac082350 0x7fa4ac0847e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.307+0000 7fc8f9a00640 1 -- 172.21.15.83:0/3128120462 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8f40b3590 con 0x7fc8f406ddf0 2024-09-21T00:14:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.307+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6d74078c60 msgr2=0x7f6d7407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.307+0000 7f6d9dc00640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6d74078c60 0x7f6d7407b170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6d80000f70 tx=0x7f6d80006b10 comp rx=0 tx=0).stop 2024-09-21T00:14:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.307+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d9814c120 msgr2=0x7f6d9809cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.307+0000 7f6d9dc00640 1 --2- 172.21.15.83:0/1905002200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d9814c120 0x7f6d9809cce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800ba40 tx=0x7f6d88031f80 comp rx=0 tx=0).stop 2024-09-21T00:14:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.308+0000 7f6d97400640 1 -- 172.21.15.83:0/1905002200 reap_dead start 2024-09-21T00:14:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.308+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 shutdown_connections 2024-09-21T00:14:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.308+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 >> 172.21.15.83:0/1905002200 conn(0x7f6d980b1b90 msgr2=0x7f6d98160df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.308+0000 7fa4c3400640 1 -- 172.21.15.83:0/1185461383 <== osd.5 v2:172.21.15.142:6810/3942773776 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa4bc005310 con 0x7fa4ac082350 2024-09-21T00:14:31.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.308+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 shutdown_connections 2024-09-21T00:14:31.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.308+0000 7f6d9dc00640 1 -- 172.21.15.83:0/1905002200 wait complete. 2024-09-21T00:14:31.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.310+0000 7fc8eaa00640 1 -- 172.21.15.83:0/3128120462 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc8e4019020 con 0x7fc8f406ddf0 2024-09-21T00:14:31.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.311+0000 7fc8eaa00640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc8d4078d90 0x7fc8d407b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.311+0000 7fc8eaa00640 1 -- 172.21.15.83:0/3128120462 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc8e409a3d0 con 0x7fc8f406ddf0 2024-09-21T00:14:31.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.312+0000 7fc8eaa00640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] conn(0x7fc8d4082550 0x7fc8d40849e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.312+0000 7fc8eaa00640 1 -- 172.21.15.83:0/3128120462 --> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8d40850b0 con 0x7fc8d4082550 2024-09-21T00:14:31.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.312+0000 7fc8eaa00640 1 -- 172.21.15.83:0/3128120462 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc8e40a1050 con 0x7fc8f406ddf0 2024-09-21T00:14:31.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.311+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 --> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8af0002dd0 con 0x7f8af40822d0 2024-09-21T00:14:31.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.312+0000 7fc8f2000640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc8d4078d90 0x7fc8d407b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.312+0000 7fc8f3400640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] conn(0x7fc8d4082550 0x7fc8d40849e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.313+0000 7f8b11600640 1 -- 172.21.15.83:0/1085760429 <== osd.0 v2:172.21.15.83:6816/3973258171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8af0002dd0 con 0x7f8af40822d0 2024-09-21T00:14:31.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.313+0000 7fc8f2000640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc8d4078d90 0x7fc8d407b2a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0034000 tx=0x7fc8e002bf90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.313+0000 7fc8f3400640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] conn(0x7fc8d4082550 0x7fc8d40849e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.314+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 >> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] conn(0x7f8af40822d0 msgr2=0x7f8af4084760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.314+0000 7f8b1b000640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] conn(0x7f8af40822d0 0x7f8af4084760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.314+0000 7fc8eaa00640 1 -- 172.21.15.83:0/3128120462 <== osd.7 v2:172.21.15.142:6826/2409799611 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8d40850b0 con 0x7fc8d4082550 2024-09-21T00:14:31.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.315+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8af4078b90 msgr2=0x7f8af407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.315+0000 7f8b1b000640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8af4078b90 0x7f8af407b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b00006fd0 tx=0x7f8b00008040 comp rx=0 tx=0).stop 2024-09-21T00:14:31.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.315+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b0c009ba0 msgr2=0x7f8b0c020040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.315+0000 7f8b1b000640 1 --2- 172.21.15.83:0/1085760429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b0c009ba0 0x7f8b0c020040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800c3c0 tx=0x7f8b0800c880 comp rx=0 tx=0).stop 2024-09-21T00:14:31.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.318+0000 7f8b1a600640 1 -- 172.21.15.83:0/1085760429 reap_dead start 2024-09-21T00:14:31.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.318+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 shutdown_connections 2024-09-21T00:14:31.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.318+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 >> 172.21.15.83:0/1085760429 conn(0x7f8b0c051420 msgr2=0x7f8b0c0e1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.318+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 shutdown_connections 2024-09-21T00:14:31.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.318+0000 7f8b1b000640 1 -- 172.21.15.83:0/1085760429 wait complete. 2024-09-21T00:14:31.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.321+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 --> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd5980392a0 con 0x7fd580082420 2024-09-21T00:14:31.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.321+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 --> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f95dc005790 con 0x7f95c8082350 2024-09-21T00:14:31.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.322+0000 7fd596a00640 1 -- 172.21.15.83:0/2389574237 <== osd.1 v2:172.21.15.83:6808/1381138332 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd5980392a0 con 0x7fd580082420 2024-09-21T00:14:31.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.322+0000 7f95d3400640 1 -- 172.21.15.83:0/97092933 <== osd.6 v2:172.21.15.142:6818/2503212538 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f95dc005790 con 0x7f95c8082350 2024-09-21T00:14:31.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.322+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 >> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] conn(0x7fd580082420 msgr2=0x7fd5800848b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.322+0000 7fd59fe00640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] conn(0x7fd580082420 0x7fd5800848b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.323+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] conn(0x7f95c8082350 msgr2=0x7f95c80847e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.323+0000 7f95ea000640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] conn(0x7f95c8082350 0x7f95c80847e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f95c8078b90 msgr2=0x7f95c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7f95ea000640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f95c8078b90 0x7f95c807b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f95e407acc0 tx=0x7f95e4051fb0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95dc009ba0 msgr2=0x7f95dc17e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7f95ea000640 1 --2- 172.21.15.83:0/97092933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95dc009ba0 0x7f95dc17e270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c400 tx=0x7f95d800c8c0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd580078c60 msgr2=0x7fd58007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7fd59fe00640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd580078c60 0x7fd58007b170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd59801da50 tx=0x7fd5a00a8070 comp rx=0 tx=0).stop 2024-09-21T00:14:31.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd59817e4a0 msgr2=0x7fd59801f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7fd59fe00640 1 --2- 172.21.15.83:0/2389574237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd59817e4a0 0x7fd59801f220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00c4d0 tx=0x7fd58c00c990 comp rx=0 tx=0).stop 2024-09-21T00:14:31.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7fd59f400640 1 -- 172.21.15.83:0/2389574237 reap_dead start 2024-09-21T00:14:31.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 shutdown_connections 2024-09-21T00:14:31.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 >> 172.21.15.83:0/2389574237 conn(0x7fd598051420 msgr2=0x7fd5980358c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7f95e3e00640 1 -- 172.21.15.83:0/97092933 reap_dead start 2024-09-21T00:14:31.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 shutdown_connections 2024-09-21T00:14:31.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 >> 172.21.15.83:0/97092933 conn(0x7f95dc051420 msgr2=0x7f95dc0368a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.324+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 shutdown_connections 2024-09-21T00:14:31.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.325+0000 7fd59fe00640 1 -- 172.21.15.83:0/2389574237 wait complete. 2024-09-21T00:14:31.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.326+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 shutdown_connections 2024-09-21T00:14:31.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.326+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 --> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2700ae3d0 con 0x7fa2540823b0 2024-09-21T00:14:31.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.326+0000 7f95ea000640 1 -- 172.21.15.83:0/97092933 wait complete. 2024-09-21T00:14:31.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.327+0000 7fa26cc00640 1 -- 172.21.15.83:0/4144226236 <== osd.2 v2:172.21.15.83:6800/4285051206 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa2700ae3d0 con 0x7fa2540823b0 2024-09-21T00:14:31.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.328+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 >> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] conn(0x7fa2540823b0 msgr2=0x7fa254084840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.328+0000 7fa277400640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] conn(0x7fa2540823b0 0x7fa254084840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.329+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa254078be0 msgr2=0x7fa25407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.329+0000 7fa277400640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa254078be0 0x7fa25407b0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa264009230 tx=0x7fa264004730 comp rx=0 tx=0).stop 2024-09-21T00:14:31.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.329+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27015add0 msgr2=0x7fa2700c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.329+0000 7fa277400640 1 --2- 172.21.15.83:0/4144226236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27015add0 0x7fa2700c7ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa26800c6e0 tx=0x7fa26800cba0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.329+0000 7fa275400640 1 -- 172.21.15.83:0/4144226236 reap_dead start 2024-09-21T00:14:31.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.329+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 shutdown_connections 2024-09-21T00:14:31.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.329+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 >> 172.21.15.83:0/4144226236 conn(0x7fa2700735d0 msgr2=0x7fa27015e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.331+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 shutdown_connections 2024-09-21T00:14:31.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.331+0000 7fa277400640 1 -- 172.21.15.83:0/4144226236 wait complete. 2024-09-21T00:14:31.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.332+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 --> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ccc002dd0 con 0x7f8cd0082650 2024-09-21T00:14:31.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.336+0000 7f8cecc00640 1 -- 172.21.15.83:0/793478759 <== osd.4 v2:172.21.15.142:6802/1069372226 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ccc002dd0 con 0x7f8cd0082650 2024-09-21T00:14:31.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.336+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] conn(0x7f8cd0082650 msgr2=0x7f8cd0084ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.336+0000 7f8cf7600640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] conn(0x7f8cd0082650 0x7f8cd0084ae0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.337+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8cd0078f90 msgr2=0x7f8cd007b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.337+0000 7f8cf7600640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8cd0078f90 0x7f8cd007b4a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0000b60 tx=0x7f8cf00770b0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.337+0000 7fc8f9a00640 1 -- 172.21.15.83:0/3128120462 --> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc8f4073c60 con 0x7fc8d4082550 2024-09-21T00:14:31.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.337+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce8180850 msgr2=0x7f8ce8180c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.337+0000 7f8cf7600640 1 --2- 172.21.15.83:0/793478759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce8180850 0x7f8ce8180c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80057e0 tx=0x7f8cdc00da20 comp rx=0 tx=0).stop 2024-09-21T00:14:31.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.337+0000 7f8cf5600640 1 -- 172.21.15.83:0/793478759 reap_dead start 2024-09-21T00:14:31.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.337+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 shutdown_connections 2024-09-21T00:14:31.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.337+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 >> 172.21.15.83:0/793478759 conn(0x7f8ce8021df0 msgr2=0x7f8ce80386a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.337+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 shutdown_connections 2024-09-21T00:14:31.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.337+0000 7f8cf7600640 1 -- 172.21.15.83:0/793478759 wait complete. 2024-09-21T00:14:31.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.338+0000 7fc8eaa00640 1 -- 172.21.15.83:0/3128120462 <== osd.7 v2:172.21.15.142:6826/2409799611 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc8f4073c60 con 0x7fc8d4082550 2024-09-21T00:14:31.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.339+0000 7fc8dfe00640 1 -- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] conn(0x7fc8d4082550 msgr2=0x7fc8d40849e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.339+0000 7fc8dfe00640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] conn(0x7fc8d4082550 0x7fc8d40849e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.339+0000 7fc8dfe00640 1 -- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc8d4078d90 msgr2=0x7fc8d407b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.339+0000 7fc8dfe00640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc8d4078d90 0x7fc8d407b2a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0034000 tx=0x7fc8e002bf90 comp rx=0 tx=0).stop 2024-09-21T00:14:31.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.339+0000 7fc8dfe00640 1 -- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f406ddf0 msgr2=0x7fc8f41571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.339+0000 7fc8dfe00640 1 --2- 172.21.15.83:0/3128120462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f406ddf0 0x7fc8f41571c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400c530 tx=0x7fc8e400c9f0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.340+0000 7fc8f3400640 1 -- 172.21.15.83:0/3128120462 reap_dead start 2024-09-21T00:14:31.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.340+0000 7fc8dfe00640 1 -- 172.21.15.83:0/3128120462 shutdown_connections 2024-09-21T00:14:31.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.340+0000 7fc8dfe00640 1 -- 172.21.15.83:0/3128120462 >> 172.21.15.83:0/3128120462 conn(0x7fc8f40b1b90 msgr2=0x7fc8f4159ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.340+0000 7fc8dfe00640 1 -- 172.21.15.83:0/3128120462 shutdown_connections 2024-09-21T00:14:31.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.341+0000 7fc8dfe00640 1 -- 172.21.15.83:0/3128120462 wait complete. 2024-09-21T00:14:31.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.341+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 --> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa4cc162db0 con 0x7fa4ac082350 2024-09-21T00:14:31.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.342+0000 7fa4c3400640 1 -- 172.21.15.83:0/1185461383 <== osd.5 v2:172.21.15.142:6810/3942773776 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa4cc162db0 con 0x7fa4ac082350 2024-09-21T00:14:31.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.343+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] conn(0x7fa4ac082350 msgr2=0x7fa4ac0847e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.343+0000 7fa4d1200640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] conn(0x7fa4ac082350 0x7fa4ac0847e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.343+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa4ac078b90 msgr2=0x7fa4ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.343+0000 7fa4d1200640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa4ac078b90 0x7fa4ac07b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0b75a0 tx=0x7fa4b8005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:31.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.343+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc0cef00 msgr2=0x7fa4cc159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.343+0000 7fa4d1200640 1 --2- 172.21.15.83:0/1185461383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc0cef00 0x7fa4cc159c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc034040 tx=0x7fa4bc003820 comp rx=0 tx=0).stop 2024-09-21T00:14:31.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.343+0000 7fa4cbe00640 1 -- 172.21.15.83:0/1185461383 reap_dead start 2024-09-21T00:14:31.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.347+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 shutdown_connections 2024-09-21T00:14:31.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.347+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 >> 172.21.15.83:0/1185461383 conn(0x7fa4cc0d41e0 msgr2=0x7fa4cc0d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.347+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 shutdown_connections 2024-09-21T00:14:31.349 INFO:teuthology.orchestra.run.smithi083.stdout:64424509450 2024-09-21T00:14:31.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.348+0000 7fa4d1200640 1 -- 172.21.15.83:0/1185461383 wait complete. 2024-09-21T00:14:31.350 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T00:14:31.359 INFO:teuthology.orchestra.run.smithi083.stdout:64424509449 2024-09-21T00:14:31.359 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T00:14:31.360 INFO:teuthology.orchestra.run.smithi083.stdout:64424509448 2024-09-21T00:14:31.360 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T00:14:31.364 INFO:teuthology.orchestra.run.smithi083.stdout:64424509449 2024-09-21T00:14:31.364 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T00:14:31.376 INFO:teuthology.orchestra.run.smithi083.stdout:64424509450 2024-09-21T00:14:31.376 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T00:14:31.382 INFO:teuthology.orchestra.run.smithi083.stdout:64424509449 2024-09-21T00:14:31.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T00:14:31.393 INFO:teuthology.orchestra.run.smithi083.stdout:55834574858 2024-09-21T00:14:31.394 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T00:14:31.398 INFO:teuthology.orchestra.run.smithi083.stdout:64424509451 2024-09-21T00:14:31.398 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T00:14:31.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.737+0000 7f899ca00640 1 -- 172.21.15.83:0/4293443167 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8990032bf0 con 0x7f8998009ba0 2024-09-21T00:14:31.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.739+0000 7f899f200640 1 -- 172.21.15.83:0/4293443167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8998009ba0 msgr2=0x7f89980df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.739+0000 7f899f200640 1 --2- 172.21.15.83:0/4293443167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8998009ba0 0x7f89980df180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8990009850 tx=0x7f899002b6d0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.739+0000 7f899f200640 1 -- 172.21.15.83:0/4293443167 shutdown_connections 2024-09-21T00:14:31.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.739+0000 7f899f200640 1 --2- 172.21.15.83:0/4293443167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8998009ba0 0x7f89980df180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.739+0000 7f899f200640 1 -- 172.21.15.83:0/4293443167 >> 172.21.15.83:0/4293443167 conn(0x7f8998051420 msgr2=0x7f8998051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.740+0000 7f899f200640 1 -- 172.21.15.83:0/4293443167 shutdown_connections 2024-09-21T00:14:31.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.740+0000 7f899f200640 1 -- 172.21.15.83:0/4293443167 wait complete. 2024-09-21T00:14:31.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.743+0000 7f899f200640 1 Processor -- start 2024-09-21T00:14:31.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.744+0000 7f899f200640 1 -- start start 2024-09-21T00:14:31.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.747+0000 7f899f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8998005c60 0x7f89980dcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.747+0000 7f899f200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8998009ba0 0x7f89980df6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.747+0000 7f899f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89980dc5a0 0x7f8998175d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.748+0000 7f899de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8998005c60 0x7f89980dcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.748+0000 7f899f200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8998006d70 con 0x7f8998009ba0 2024-09-21T00:14:31.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.748+0000 7f899f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f899800be40 con 0x7f89980dc5a0 2024-09-21T00:14:31.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.748+0000 7f899f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8998006ef0 con 0x7f8998005c60 2024-09-21T00:14:31.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.748+0000 7f899e800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89980dc5a0 0x7f8998175d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.748+0000 7f899e800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89980dc5a0 0x7f8998175d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:34732/0 (socket says 172.21.15.83:34732) 2024-09-21T00:14:31.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.748+0000 7f899e800640 1 -- 172.21.15.83:0/939338773 learned_addr learned my addr 172.21.15.83:0/939338773 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.749+0000 7f899d400640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8998009ba0 0x7f89980df6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.749+0000 7f899e800640 1 -- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8998005c60 msgr2=0x7f89980dcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.749+0000 7f899e800640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8998005c60 0x7f89980dcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.749+0000 7f899e800640 1 -- 172.21.15.83:0/939338773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8998009ba0 msgr2=0x7f89980df6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.749+0000 7f899e800640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8998009ba0 0x7f89980df6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.750+0000 7f899e800640 1 -- 172.21.15.83:0/939338773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89980e1da0 con 0x7f89980dc5a0 2024-09-21T00:14:31.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.750+0000 7f899d400640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8998009ba0 0x7f89980df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:31.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.750+0000 7f899e800640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89980dc5a0 0x7f8998175d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f89a006ba80 tx=0x7f89a006a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.751+0000 7f8996000640 1 -- 172.21.15.83:0/939338773 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0075cd0 con 0x7f89980dc5a0 2024-09-21T00:14:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.751+0000 7f8996000640 1 -- 172.21.15.83:0/939338773 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89a0076180 con 0x7f89980dc5a0 2024-09-21T00:14:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.752+0000 7f8996000640 1 -- 172.21.15.83:0/939338773 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a00765b0 con 0x7f89980dc5a0 2024-09-21T00:14:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.752+0000 7f899f200640 1 -- 172.21.15.83:0/939338773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89980e2060 con 0x7f89980dc5a0 2024-09-21T00:14:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.752+0000 7f899f200640 1 -- 172.21.15.83:0/939338773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89980dfd20 con 0x7f89980dc5a0 2024-09-21T00:14:31.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.755+0000 7fa14a800640 1 -- 172.21.15.83:0/1258611885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa12c004800 msgr2=0x7fa12c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.755+0000 7fa14a800640 1 --2- 172.21.15.83:0/1258611885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa12c004800 0x7fa12c004c10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0e3520 tx=0x7fa12c005830 comp rx=0 tx=0).stop 2024-09-21T00:14:31.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.755+0000 7fa143e00640 1 -- 172.21.15.83:0/1258611885 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa138006c00 con 0x7fa12c004800 2024-09-21T00:14:31.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.755+0000 7fa149e00640 1 -- 172.21.15.83:0/1258611885 reap_dead start 2024-09-21T00:14:31.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.755+0000 7fa14a800640 1 -- 172.21.15.83:0/1258611885 shutdown_connections 2024-09-21T00:14:31.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.755+0000 7fa14a800640 1 -- 172.21.15.83:0/1258611885 >> 172.21.15.83:0/1258611885 conn(0x7fa13c03a5f0 msgr2=0x7fa13c03aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.756+0000 7fa14a800640 1 -- 172.21.15.83:0/1258611885 shutdown_connections 2024-09-21T00:14:31.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.756+0000 7fa14a800640 1 -- 172.21.15.83:0/1258611885 wait complete. 2024-09-21T00:14:31.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.755+0000 7f899f200640 1 -- 172.21.15.83:0/939338773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8978005290 con 0x7f89980dc5a0 2024-09-21T00:14:31.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.757+0000 7f8996000640 1 -- 172.21.15.83:0/939338773 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f89a0093400 con 0x7f89980dc5a0 2024-09-21T00:14:31.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.758+0000 7f8996000640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8980078c60 0x7f898007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.759+0000 7f8996000640 1 -- 172.21.15.83:0/939338773 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f89a0116250 con 0x7f89980dc5a0 2024-09-21T00:14:31.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.759+0000 7f899de00640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8980078c60 0x7f898007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.760+0000 7f899de00640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8980078c60 0x7f898007b170 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8990035000 tx=0x7f8990004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.761+0000 7fa14a800640 1 Processor -- start 2024-09-21T00:14:31.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.761+0000 7fa14a800640 1 -- start start 2024-09-21T00:14:31.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.764+0000 7f8996000640 1 -- 172.21.15.83:0/939338773 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f89a008f030 con 0x7f89980dc5a0 2024-09-21T00:14:31.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.764+0000 7f71e4e00640 1 -- 172.21.15.83:0/286215195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c40053f0 msgr2=0x7f71c4007a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.764+0000 7fa14a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa12c004800 0x7fa13c04b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.764+0000 7f71e4e00640 1 --2- 172.21.15.83:0/286215195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c40053f0 0x7f71c4007a60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009c40 tx=0x7f71c4005830 comp rx=0 tx=0).stop 2024-09-21T00:14:31.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.765+0000 7f71e4e00640 1 -- 172.21.15.83:0/286215195 shutdown_connections 2024-09-21T00:14:31.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.765+0000 7f71e4e00640 1 --2- 172.21.15.83:0/286215195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c40053f0 0x7f71c4007a60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.765+0000 7f71e4e00640 1 -- 172.21.15.83:0/286215195 >> 172.21.15.83:0/286215195 conn(0x7f71e00b1b90 msgr2=0x7f71e00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.764+0000 7fa14a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0da3a0 0x7fa13c04eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.765+0000 7f71e4e00640 1 -- 172.21.15.83:0/286215195 shutdown_connections 2024-09-21T00:14:31.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.765+0000 7f71e4e00640 1 -- 172.21.15.83:0/286215195 wait complete. 2024-09-21T00:14:31.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.765+0000 7fa14a800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa13c04eff0 0x7fa13c0db6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.765+0000 7fa14a800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c006d10 con 0x7fa13c04eff0 2024-09-21T00:14:31.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.765+0000 7fa14a800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c006b90 con 0x7fa12c004800 2024-09-21T00:14:31.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.765+0000 7fa14a800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa13c006e90 con 0x7fa13c0da3a0 2024-09-21T00:14:31.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fa149e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa13c04eff0 0x7fa13c0db6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fa149400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa12c004800 0x7fa13c04b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fa149400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa12c004800 0x7fa13c04b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:34764/0 (socket says 172.21.15.83:34764) 2024-09-21T00:14:31.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fa149400640 1 -- 172.21.15.83:0/1608399544 learned_addr learned my addr 172.21.15.83:0/1608399544 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fa148a00640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0da3a0 0x7fa13c04eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fd68a800640 1 -- 172.21.15.83:0/1001560968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd684151080 msgr2=0x7fd684151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fd68a800640 1 --2- 172.21.15.83:0/1001560968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd684151080 0x7fd684151490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd678009830 tx=0x7fd67802a3f0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fd68a800640 1 -- 172.21.15.83:0/1001560968 shutdown_connections 2024-09-21T00:14:31.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fa149e00640 1 -- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0da3a0 msgr2=0x7fa13c04eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.767+0000 7fa149e00640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0da3a0 0x7fa13c04eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.767+0000 7fa149e00640 1 -- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa12c004800 msgr2=0x7fa13c04b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.767+0000 7fa149e00640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa12c004800 0x7fa13c04b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.767+0000 7fa149e00640 1 -- 172.21.15.83:0/1608399544 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c04bea0 con 0x7fa13c04eff0 2024-09-21T00:14:31.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.767+0000 7fa148a00640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0da3a0 0x7fa13c04eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:14:31.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fd68a800640 1 --2- 172.21.15.83:0/1001560968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd68406edf0 0x7fd68406f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fd68a800640 1 --2- 172.21.15.83:0/1001560968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd684151080 0x7fd684151490 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.766+0000 7fd68a800640 1 -- 172.21.15.83:0/1001560968 >> 172.21.15.83:0/1001560968 conn(0x7fd6840d05c0 msgr2=0x7fd68406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.767+0000 7fd68a800640 1 -- 172.21.15.83:0/1001560968 shutdown_connections 2024-09-21T00:14:31.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.767+0000 7fd68a800640 1 -- 172.21.15.83:0/1001560968 wait complete. 2024-09-21T00:14:31.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.767+0000 7fa149e00640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa13c04eff0 0x7fa13c0db6f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa144075fd0 tx=0x7fa14406b270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.768+0000 7fa141600640 1 -- 172.21.15.83:0/1608399544 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14409a070 con 0x7fa13c04eff0 2024-09-21T00:14:31.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.768+0000 7fa14a800640 1 -- 172.21.15.83:0/1608399544 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c04f400 con 0x7fa13c04eff0 2024-09-21T00:14:31.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.768+0000 7fa14a800640 1 -- 172.21.15.83:0/1608399544 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c179c90 con 0x7fa13c04eff0 2024-09-21T00:14:31.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.769+0000 7f71e4e00640 1 Processor -- start 2024-09-21T00:14:31.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.769+0000 7f71e4e00640 1 -- start start 2024-09-21T00:14:31.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.770+0000 7fd68a800640 1 Processor -- start 2024-09-21T00:14:31.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.770+0000 7fd68a800640 1 -- start start 2024-09-21T00:14:31.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.768+0000 7fa141600640 1 -- 172.21.15.83:0/1608399544 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa144076180 con 0x7fa13c04eff0 2024-09-21T00:14:31.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.768+0000 7fa141600640 1 -- 172.21.15.83:0/1608399544 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14409a070 con 0x7fa13c04eff0 2024-09-21T00:14:31.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.772+0000 7f71e4e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71e0201b00 0x7f71e0153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.772+0000 7f71e4e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71e0153f70 0x7f71e0157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.773+0000 7f71e4e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71e0157ca0 0x7f71e0155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.773+0000 7f71dde00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71e0201b00 0x7f71e0153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.774+0000 7fd68a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd68406edf0 0x7fd6840c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.774+0000 7fd68a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd684151080 0x7fd68414f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.774+0000 7fd68a800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd68415e1c0 0x7fd68414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.775+0000 7fd68a800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd68406f740 con 0x7fd68415e1c0 2024-09-21T00:14:31.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.775+0000 7fd68a800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd684070ea0 con 0x7fd68406edf0 2024-09-21T00:14:31.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.775+0000 7fd68a800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd68406f8c0 con 0x7fd684151080 2024-09-21T00:14:31.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.775+0000 7fd689e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd68415e1c0 0x7fd68414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.775+0000 7fd689e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd68415e1c0 0x7fd68414f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46690/0 (socket says 172.21.15.83:46690) 2024-09-21T00:14:31.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.775+0000 7fd689e00640 1 -- 172.21.15.83:0/1410453091 learned_addr learned my addr 172.21.15.83:0/1410453091 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.775+0000 7fd689400640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd68406edf0 0x7fd6840c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.776+0000 7fd688a00640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd684151080 0x7fd68414f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.776+0000 7f71dde00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71e0201b00 0x7f71e0153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:57558/0 (socket says 172.21.15.83:57558) 2024-09-21T00:14:31.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.776+0000 7f71dde00640 1 -- 172.21.15.83:0/3939862333 learned_addr learned my addr 172.21.15.83:0/3939862333 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.776+0000 7f71dd400640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71e0153f70 0x7f71e0157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.776+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f71e0070070 con 0x7f71e0157ca0 2024-09-21T00:14:31.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.776+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f71e0071150 con 0x7f71e0153f70 2024-09-21T00:14:31.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.777+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f71e00701f0 con 0x7f71e0201b00 2024-09-21T00:14:31.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.771+0000 7fa14a800640 1 -- 172.21.15.83:0/1608399544 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa120005290 con 0x7fa13c04eff0 2024-09-21T00:14:31.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.777+0000 7fd689e00640 1 -- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd684151080 msgr2=0x7fd68414f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.777+0000 7fd689e00640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd684151080 0x7fd68414f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.777+0000 7fd689e00640 1 -- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd68406edf0 msgr2=0x7fd6840c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.777+0000 7fd689e00640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd68406edf0 0x7fd6840c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.777+0000 7fd689e00640 1 -- 172.21.15.83:0/1410453091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6841f3ab0 con 0x7fd68415e1c0 2024-09-21T00:14:31.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.777+0000 7fd689400640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd68406edf0 0x7fd6840c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:31.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.778+0000 7f71dd400640 1 -- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71e0201b00 msgr2=0x7f71e0153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.778+0000 7f71dd400640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71e0201b00 0x7f71e0153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.778+0000 7f71dd400640 1 -- 172.21.15.83:0/3939862333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71e0157ca0 msgr2=0x7f71e0155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.778+0000 7fd689e00640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd68415e1c0 0x7fd68414f9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd67000e6d0 tx=0x7fd67000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.778+0000 7f71dd400640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71e0157ca0 0x7f71e0155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.778+0000 7f71dd400640 1 -- 172.21.15.83:0/3939862333 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e0154380 con 0x7f71e0153f70 2024-09-21T00:14:31.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.778+0000 7fa141600640 1 -- 172.21.15.83:0/1608399544 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa14409d070 con 0x7fa13c04eff0 2024-09-21T00:14:31.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.778+0000 7f71dd400640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71e0153f70 0x7f71e0157760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71e0072d40 tx=0x7f71cc00fae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.779+0000 7f71d6000640 1 -- 172.21.15.83:0/3939862333 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc015070 con 0x7f71e0153f70 2024-09-21T00:14:31.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.779+0000 7fa141600640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa124078d90 0x7fa12407b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.779+0000 7f71d6000640 1 -- 172.21.15.83:0/3939862333 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71cc006380 con 0x7f71e0153f70 2024-09-21T00:14:31.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.779+0000 7f71d6000640 1 -- 172.21.15.83:0/3939862333 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc003a90 con 0x7f71e0153f70 2024-09-21T00:14:31.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.780+0000 7fa141600640 1 -- 172.21.15.83:0/1608399544 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa1441169a0 con 0x7fa13c04eff0 2024-09-21T00:14:31.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.780+0000 7f3dc0a00640 1 -- 172.21.15.83:0/3196629636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc073000 msgr2=0x7f3dbc0cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.780+0000 7f3dc0a00640 1 --2- 172.21.15.83:0/3196629636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc073000 0x7f3dbc0cc160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0b26b0 tx=0x7f3dac032bb0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.780+0000 7f3dc0a00640 1 -- 172.21.15.83:0/3196629636 shutdown_connections 2024-09-21T00:14:31.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.780+0000 7f3dc0a00640 1 --2- 172.21.15.83:0/3196629636 >> v2:172.21.15.83:3300/0 conn(0x7f3dbc0cf6b0 0x7f3dbc15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.780+0000 7f3dc0a00640 1 --2- 172.21.15.83:0/3196629636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc073000 0x7f3dbc0cc160 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.780+0000 7f3dc0a00640 1 -- 172.21.15.83:0/3196629636 >> 172.21.15.83:0/3196629636 conn(0x7f3dbc0b1b90 msgr2=0x7f3dbc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.780+0000 7fa149400640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa124078d90 0x7fa12407b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.781+0000 7f3dc0a00640 1 -- 172.21.15.83:0/3196629636 shutdown_connections 2024-09-21T00:14:31.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.781+0000 7f3dc0a00640 1 -- 172.21.15.83:0/3196629636 wait complete. 2024-09-21T00:14:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.781+0000 7fa149400640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa124078d90 0x7fa12407b2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa130009b90 tx=0x7fa1300096a0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.780+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e01580b0 con 0x7f71e0153f70 2024-09-21T00:14:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.780+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e0205a30 con 0x7f71e0153f70 2024-09-21T00:14:31.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.785+0000 7f3dc0a00640 1 Processor -- start 2024-09-21T00:14:31.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.783+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b8005290 con 0x7f71e0153f70 2024-09-21T00:14:31.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.785+0000 7f71d6000640 1 -- 172.21.15.83:0/3939862333 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71cc018070 con 0x7f71e0153f70 2024-09-21T00:14:31.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.785+0000 7f3dc0a00640 1 -- start start 2024-09-21T00:14:31.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.786+0000 7fa141600640 1 -- 172.21.15.83:0/1608399544 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa13c04f400 con 0x7fa13c04eff0 2024-09-21T00:14:31.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.786+0000 7fd681600640 1 -- 172.21.15.83:0/1410453091 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67000cab0 con 0x7fd68415e1c0 2024-09-21T00:14:31.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.786+0000 7fd68a800640 1 -- 172.21.15.83:0/1410453091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6841f3d90 con 0x7fd68415e1c0 2024-09-21T00:14:31.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.786+0000 7fd68a800640 1 -- 172.21.15.83:0/1410453091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6841f4350 con 0x7fd68415e1c0 2024-09-21T00:14:31.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.788+0000 7f71d6000640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f71c0078c60 0x7f71c007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.788+0000 7f3dc0a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc073000 0x7f3dbc0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.788+0000 7f3dc0a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dbc0cf6b0 0x7f3dbc15b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f3dc0a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc0cfac0 0x7f3dbc09d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.788+0000 7f71d6000640 1 -- 172.21.15.83:0/3939862333 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f71cc09aea0 con 0x7f71e0153f70 2024-09-21T00:14:31.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f5874a00640 1 -- 172.21.15.83:0/2588880568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58680ebe80 msgr2=0x7f58680ee2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f5874a00640 1 --2- 172.21.15.83:0/2588880568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58680ebe80 0x7f58680ee2a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5870051d10 tx=0x7f58700a6420 comp rx=0 tx=0).stop 2024-09-21T00:14:31.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f5874a00640 1 -- 172.21.15.83:0/2588880568 shutdown_connections 2024-09-21T00:14:31.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f5874a00640 1 --2- 172.21.15.83:0/2588880568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58680ebe80 0x7f58680ee2a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f5874a00640 1 -- 172.21.15.83:0/2588880568 >> 172.21.15.83:0/2588880568 conn(0x7f586801d9a0 msgr2=0x7f5868039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f3dc0a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc15fe80 con 0x7f3dbc0cfac0 2024-09-21T00:14:31.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f3dc0a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc15fd00 con 0x7f3dbc073000 2024-09-21T00:14:31.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f3dc0a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc06ddf0 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f3db1400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dbc0cf6b0 0x7f3dbc15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f3db1400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dbc0cf6b0 0x7f3dbc15b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:57586/0 (socket says 172.21.15.83:57586) 2024-09-21T00:14:31.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f3db1400640 1 -- 172.21.15.83:0/6719929 learned_addr learned my addr 172.21.15.83:0/6719929 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f71dde00640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f71c0078c60 0x7f71c007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.789+0000 7f3dba800640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc0cfac0 0x7f3dbc09d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.790+0000 7f3db9e00640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc073000 0x7f3dbc0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.788+0000 7fd68a800640 1 -- 172.21.15.83:0/1410453091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd68406fd10 con 0x7fd68415e1c0 2024-09-21T00:14:31.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.790+0000 7fd681600640 1 -- 172.21.15.83:0/1410453091 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd67000cc50 con 0x7fd68415e1c0 2024-09-21T00:14:31.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.790+0000 7fd681600640 1 -- 172.21.15.83:0/1410453091 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67000cab0 con 0x7fd68415e1c0 2024-09-21T00:14:31.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.790+0000 7f5874a00640 1 -- 172.21.15.83:0/2588880568 shutdown_connections 2024-09-21T00:14:31.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.790+0000 7f5874a00640 1 -- 172.21.15.83:0/2588880568 wait complete. 2024-09-21T00:14:31.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.790+0000 7f3db1400640 1 -- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc073000 msgr2=0x7f3dbc0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.790+0000 7f3db1400640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc073000 0x7f3dbc0b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.790+0000 7f3db1400640 1 -- 172.21.15.83:0/6719929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc0cfac0 msgr2=0x7f3dbc09d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.790+0000 7f3db1400640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc0cfac0 0x7f3dbc09d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.790+0000 7f3db1400640 1 -- 172.21.15.83:0/6719929 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc0b44d0 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.791+0000 7f71dde00640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f71c0078c60 0x7f71c007b170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71e01599e0 tx=0x7f71d00067d0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.791+0000 7f3db1400640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dbc0cf6b0 0x7f3dbc15b300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3da400d730 tx=0x7f3da400dbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.793+0000 7f3db2a00640 1 -- 172.21.15.83:0/6719929 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da4017070 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.793+0000 7f3db2a00640 1 -- 172.21.15.83:0/6719929 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3da4009ac0 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.793+0000 7f3db2a00640 1 -- 172.21.15.83:0/6719929 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da4010460 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.793+0000 7f3dc0a00640 1 -- 172.21.15.83:0/6719929 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc0a1330 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.793+0000 7f3dc0a00640 1 -- 172.21.15.83:0/6719929 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc0a1050 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.794+0000 7fd681600640 1 -- 172.21.15.83:0/1410453091 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd670021440 con 0x7fd68415e1c0 2024-09-21T00:14:31.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.796+0000 7fd681600640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd66407d1d0 0x7fd66407f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.796+0000 7fd681600640 1 -- 172.21.15.83:0/1410453091 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd67009b6a0 con 0x7fd68415e1c0 2024-09-21T00:14:31.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.794+0000 7f5874a00640 1 Processor -- start 2024-09-21T00:14:31.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.795+0000 7f5874a00640 1 -- start start 2024-09-21T00:14:31.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.795+0000 7f3dc0a00640 1 -- 172.21.15.83:0/6719929 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d94005290 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.791+0000 7f71d6000640 1 -- 172.21.15.83:0/3939862333 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f71e0154380 con 0x7f71e0153f70 2024-09-21T00:14:31.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.797+0000 7fd689400640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd66407d1d0 0x7fd66407f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.797+0000 7fd689400640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd66407d1d0 0x7fd66407f6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd67c007f20 tx=0x7fd67c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.798+0000 7f5874a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5868051630 0x7f58680d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.798+0000 7f5874a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868052360 0x7f58680da860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.798+0000 7f5874a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58680ebe80 0x7f58680d9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.798+0000 7f5874a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5868033ea0 con 0x7f5868052360 2024-09-21T00:14:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.798+0000 7f5874a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5868052980 con 0x7f5868051630 2024-09-21T00:14:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.798+0000 7f5874a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f58680ee7e0 con 0x7f58680ebe80 2024-09-21T00:14:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.799+0000 7f586f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58680ebe80 0x7f58680d9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.799+0000 7f586de00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868052360 0x7f58680da860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.799+0000 7f586f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58680ebe80 0x7f58680d9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:57604/0 (socket says 172.21.15.83:57604) 2024-09-21T00:14:31.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.799+0000 7f586f200640 1 -- 172.21.15.83:0/2336625905 learned_addr learned my addr 172.21.15.83:0/2336625905 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.799+0000 7f3db2a00640 1 -- 172.21.15.83:0/6719929 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3da401a070 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.799+0000 7f586e800640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5868051630 0x7f58680d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.800+0000 7f586e800640 1 -- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58680ebe80 msgr2=0x7f58680d9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.800+0000 7f586e800640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58680ebe80 0x7f58680d9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.800+0000 7f586e800640 1 -- 172.21.15.83:0/2336625905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868052360 msgr2=0x7f58680da860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.800+0000 7f586e800640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868052360 0x7f58680da860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.800+0000 7f586e800640 1 -- 172.21.15.83:0/2336625905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58680d0a20 con 0x7f5868051630 2024-09-21T00:14:31.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.801+0000 7f586e800640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5868051630 0x7f58680d04e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f586000c3c0 tx=0x7f586000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.801+0000 7f3db2a00640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3d98078c60 0x7f3d9807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.801+0000 7f3db2a00640 1 -- 172.21.15.83:0/6719929 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3da409b480 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.801+0000 7f5866a00640 1 -- 172.21.15.83:0/2336625905 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860017070 con 0x7f5868051630 2024-09-21T00:14:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.801+0000 7f3db9e00640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3d98078c60 0x7f3d9807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.802+0000 7f5874a00640 1 -- 172.21.15.83:0/2336625905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58680dada0 con 0x7f5868051630 2024-09-21T00:14:31.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.802+0000 7f47db000640 1 -- 172.21.15.83:0/3039978828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d415f6d0 msgr2=0x7f47d40cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.802+0000 7f47db000640 1 --2- 172.21.15.83:0/3039978828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d415f6d0 0x7f47d40cf0e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f47cc005fd0 tx=0x7f47cc02aa30 comp rx=0 tx=0).stop 2024-09-21T00:14:31.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.802+0000 7f47db000640 1 -- 172.21.15.83:0/3039978828 shutdown_connections 2024-09-21T00:14:31.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.802+0000 7f47db000640 1 --2- 172.21.15.83:0/3039978828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d40cf620 0x7f47d415de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.802+0000 7f47db000640 1 --2- 172.21.15.83:0/3039978828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d415f6d0 0x7f47d40cf0e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.802+0000 7f47db000640 1 -- 172.21.15.83:0/3039978828 >> 172.21.15.83:0/3039978828 conn(0x7f47d40d41e0 msgr2=0x7f47d40d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.802+0000 7f47db000640 1 -- 172.21.15.83:0/3039978828 shutdown_connections 2024-09-21T00:14:31.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.802+0000 7f47db000640 1 -- 172.21.15.83:0/3039978828 wait complete. 2024-09-21T00:14:31.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.802+0000 7f5874a00640 1 -- 172.21.15.83:0/2336625905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58680d8d40 con 0x7f5868051630 2024-09-21T00:14:31.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.804+0000 7f3db2a00640 1 -- 172.21.15.83:0/6719929 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3da4062fa0 con 0x7f3dbc0cf6b0 2024-09-21T00:14:31.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.805+0000 7f3db9e00640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3d98078c60 0x7f3d9807b170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0cbf20 tx=0x7f3dac03e040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.804+0000 7f5874a00640 1 -- 172.21.15.83:0/2336625905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5868051a40 con 0x7f5868051630 2024-09-21T00:14:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.804+0000 7f5866a00640 1 -- 172.21.15.83:0/2336625905 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58600035f0 con 0x7f5868051630 2024-09-21T00:14:31.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.805+0000 7f5866a00640 1 -- 172.21.15.83:0/2336625905 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860017070 con 0x7f5868051630 2024-09-21T00:14:31.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.806+0000 7f47db000640 1 Processor -- start 2024-09-21T00:14:31.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.808+0000 7fd681600640 1 -- 172.21.15.83:0/1410453091 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd67000ce20 con 0x7fd68415e1c0 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.806+0000 7f47db000640 1 -- start start 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.807+0000 7f47db000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d40cf620 0x7f47d41f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.807+0000 7f47db000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d415e350 0x7f47d40c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.807+0000 7f47db000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d415f6d0 0x7f47d40ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.807+0000 7f47db000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f47d40d3390 con 0x7f47d415e350 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.807+0000 7f47db000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f47d40cfd90 con 0x7f47d415f6d0 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.807+0000 7f47db000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f47d415e760 con 0x7f47d40cf620 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.808+0000 7f47d9200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d415e350 0x7f47d40c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.808+0000 7f47d9200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d415e350 0x7f47d40c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46722/0 (socket says 172.21.15.83:46722) 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.808+0000 7f47d9200640 1 -- 172.21.15.83:0/1090454075 learned_addr learned my addr 172.21.15.83:0/1090454075 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f47d9c00640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d40cf620 0x7f47d41f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f47d9200640 1 -- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d40cf620 msgr2=0x7f47d41f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f47d9200640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d40cf620 0x7f47d41f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f47d9200640 1 -- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d415f6d0 msgr2=0x7f47d40ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f47da600640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d415f6d0 0x7f47d40ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f47d9200640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d415f6d0 0x7f47d40ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f47d9200640 1 -- 172.21.15.83:0/1090454075 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d40b3de0 con 0x7f47d415e350 2024-09-21T00:14:31.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f47d9c00640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d40cf620 0x7f47d41f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:31.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f47da600640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d415f6d0 0x7f47d40ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:31.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f47d9200640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d415e350 0x7f47d40c9e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47c000afc0 tx=0x7f47c000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.809+0000 7f5866a00640 1 -- 172.21.15.83:0/2336625905 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f586001a070 con 0x7f5868051630 2024-09-21T00:14:31.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.810+0000 7f47d1600640 1 -- 172.21.15.83:0/1090454075 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0007bb0 con 0x7f47d415e350 2024-09-21T00:14:31.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.810+0000 7f47d1600640 1 -- 172.21.15.83:0/1090454075 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47c0007e40 con 0x7f47d415e350 2024-09-21T00:14:31.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.810+0000 7f47d1600640 1 -- 172.21.15.83:0/1090454075 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c00206c0 con 0x7f47d415e350 2024-09-21T00:14:31.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.811+0000 7f47db000640 1 -- 172.21.15.83:0/1090454075 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d40cd880 con 0x7f47d415e350 2024-09-21T00:14:31.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.811+0000 7f47db000640 1 -- 172.21.15.83:0/1090454075 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d40cde40 con 0x7f47d415e350 2024-09-21T00:14:31.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.811+0000 7f5866a00640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5850078fc0 0x7f585007b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.812+0000 7f47db000640 1 -- 172.21.15.83:0/1090454075 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d40cf0e0 con 0x7f47d415e350 2024-09-21T00:14:31.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.813+0000 7f586de00640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5850078fc0 0x7f585007b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.813+0000 7f5866a00640 1 -- 172.21.15.83:0/2336625905 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f58600052e0 con 0x7f5868051630 2024-09-21T00:14:31.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.814+0000 7f5866a00640 1 -- 172.21.15.83:0/2336625905 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5860066900 con 0x7f5868051630 2024-09-21T00:14:31.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.814+0000 7f586de00640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5850078fc0 0x7f585007b4d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f586817d5c0 tx=0x7f585c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.817+0000 7f47d1600640 1 -- 172.21.15.83:0/1090454075 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f47c0020860 con 0x7f47d415e350 2024-09-21T00:14:31.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.818+0000 7f47d1600640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f47b4078bc0 0x7f47b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.819+0000 7f47d1600640 1 -- 172.21.15.83:0/1090454075 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f47c00ac900 con 0x7f47d415e350 2024-09-21T00:14:31.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.819+0000 7f47d9c00640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f47b4078bc0 0x7f47b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.823+0000 7f47d9c00640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f47b4078bc0 0x7f47b407b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f47cc035000 tx=0x7f47cc004ab0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.826+0000 7f47d1600640 1 -- 172.21.15.83:0/1090454075 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f47c0025030 con 0x7f47d415e350 2024-09-21T00:14:31.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.855+0000 7fcf35400640 1 -- 172.21.15.83:0/573517039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf30074880 msgr2=0x7fcf3006edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.855+0000 7fcf35400640 1 --2- 172.21.15.83:0/573517039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf30074880 0x7fcf3006edf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009830 tx=0x7fcf2002a530 comp rx=0 tx=0).stop 2024-09-21T00:14:31.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.855+0000 7fcf35400640 1 -- 172.21.15.83:0/573517039 shutdown_connections 2024-09-21T00:14:31.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.855+0000 7fcf35400640 1 --2- 172.21.15.83:0/573517039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf3006f330 0x7fcf3015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.855+0000 7fcf35400640 1 --2- 172.21.15.83:0/573517039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf30074880 0x7fcf3006edf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.855+0000 7fcf35400640 1 -- 172.21.15.83:0/573517039 >> 172.21.15.83:0/573517039 conn(0x7fcf300d0350 msgr2=0x7fcf300d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:31.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.855+0000 7fcf35400640 1 -- 172.21.15.83:0/573517039 shutdown_connections 2024-09-21T00:14:31.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.855+0000 7fcf35400640 1 -- 172.21.15.83:0/573517039 wait complete. 2024-09-21T00:14:31.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.859+0000 7fcf35400640 1 Processor -- start 2024-09-21T00:14:31.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.859+0000 7fcf35400640 1 -- start start 2024-09-21T00:14:31.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.862+0000 7fcf35400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf3006f330 0x7fcf30155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.862+0000 7fcf35400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf30074880 0x7fcf3015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.862+0000 7fcf35400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf300af4e0 0x7fcf300b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.862+0000 7fcf35400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3015f410 con 0x7fcf3006f330 2024-09-21T00:14:31.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.862+0000 7fcf35400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3015f290 con 0x7fcf300af4e0 2024-09-21T00:14:31.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.862+0000 7fcf35400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3015f590 con 0x7fcf30074880 2024-09-21T00:14:31.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.863+0000 7fcf2de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf30074880 0x7fcf3015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.863+0000 7fcf2de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf30074880 0x7fcf3015d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:39260/0 (socket says 172.21.15.83:39260) 2024-09-21T00:14:31.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.863+0000 7fcf2de00640 1 -- 172.21.15.83:0/2753785103 learned_addr learned my addr 172.21.15.83:0/2753785103 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:31.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.863+0000 7fcf2f200640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf300af4e0 0x7fcf300b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.864+0000 7fcf2e800640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf3006f330 0x7fcf30155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.865+0000 7fcf2de00640 1 -- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf300af4e0 msgr2=0x7fcf300b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.865+0000 7fcf2de00640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf300af4e0 0x7fcf300b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.865+0000 7fcf2de00640 1 -- 172.21.15.83:0/2753785103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf3006f330 msgr2=0x7fcf30155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:31.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.865+0000 7fcf2de00640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf3006f330 0x7fcf30155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:31.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.865+0000 7fcf2de00640 1 -- 172.21.15.83:0/2753785103 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3015e2e0 con 0x7fcf30074880 2024-09-21T00:14:31.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.865+0000 7fcf2f200640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf300af4e0 0x7fcf300b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:14:31.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.865+0000 7fcf2e800640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf3006f330 0x7fcf30155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:31.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.866+0000 7fcf2de00640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf30074880 0x7fcf3015d770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009780 tx=0x7fcf20033c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.867+0000 7fcf26a00640 1 -- 172.21.15.83:0/2753785103 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf20031d60 con 0x7fcf30074880 2024-09-21T00:14:31.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.867+0000 7fcf35400640 1 -- 172.21.15.83:0/2753785103 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf301f8c90 con 0x7fcf30074880 2024-09-21T00:14:31.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.867+0000 7fcf35400640 1 -- 172.21.15.83:0/2753785103 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf301f9250 con 0x7fcf30074880 2024-09-21T00:14:31.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.867+0000 7fcf26a00640 1 -- 172.21.15.83:0/2753785103 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf20005020 con 0x7fcf30074880 2024-09-21T00:14:31.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.867+0000 7fcf26a00640 1 -- 172.21.15.83:0/2753785103 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf20031d60 con 0x7fcf30074880 2024-09-21T00:14:31.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.869+0000 7fcf1be00640 1 -- 172.21.15.83:0/2753785103 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf04005290 con 0x7fcf30074880 2024-09-21T00:14:31.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.872+0000 7fcf26a00640 1 -- 172.21.15.83:0/2753785103 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf200051d0 con 0x7fcf30074880 2024-09-21T00:14:31.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.873+0000 7fcf26a00640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcf10078fc0 0x7fcf1007b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:31.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.874+0000 7fcf26a00640 1 -- 172.21.15.83:0/2753785103 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcf20031b60 con 0x7fcf30074880 2024-09-21T00:14:31.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.874+0000 7fcf2e800640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcf10078fc0 0x7fcf1007b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:31.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.875+0000 7fcf2e800640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcf10078fc0 0x7fcf1007b4d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf28002170 tx=0x7fcf28009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:31.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:31.878+0000 7fcf26a00640 1 -- 172.21.15.83:0/2753785103 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcf2003f030 con 0x7fcf30074880 2024-09-21T00:14:32.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.205+0000 7f899f200640 1 -- 172.21.15.83:0/939338773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8978005580 con 0x7f89980dc5a0 2024-09-21T00:14:32.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.206+0000 7f8996000640 1 -- 172.21.15.83:0/939338773 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8998006070 con 0x7f89980dc5a0 2024-09-21T00:14:32.207 INFO:teuthology.orchestra.run.smithi083.stdout:64424509449 2024-09-21T00:14:32.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.210+0000 7f899f200640 1 -- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8980078c60 msgr2=0x7f898007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.210+0000 7f899f200640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8980078c60 0x7f898007b170 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8990035000 tx=0x7f8990004730 comp rx=0 tx=0).stop 2024-09-21T00:14:32.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.210+0000 7f899f200640 1 -- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89980dc5a0 msgr2=0x7f8998175d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.210+0000 7f899f200640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89980dc5a0 0x7f8998175d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f89a006ba80 tx=0x7f89a006a0e0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.211+0000 7f899f200640 1 -- 172.21.15.83:0/939338773 shutdown_connections 2024-09-21T00:14:32.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.211+0000 7f899f200640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8980078c60 0x7f898007b170 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.211+0000 7f899f200640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89980dc5a0 0x7f8998175d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.211+0000 7f899f200640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8998009ba0 0x7f89980df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.211+0000 7f899f200640 1 --2- 172.21.15.83:0/939338773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8998005c60 0x7f89980dcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.211+0000 7f899f200640 1 -- 172.21.15.83:0/939338773 >> 172.21.15.83:0/939338773 conn(0x7f8998051420 msgr2=0x7f8998052360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:32.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.211+0000 7f899f200640 1 -- 172.21.15.83:0/939338773 shutdown_connections 2024-09-21T00:14:32.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.211+0000 7f899f200640 1 -- 172.21.15.83:0/939338773 wait complete. 2024-09-21T00:14:32.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.222+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f71b8005580 con 0x7f71e0153f70 2024-09-21T00:14:32.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.223+0000 7f71d6000640 1 -- 172.21.15.83:0/3939862333 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71e0154380 con 0x7f71e0153f70 2024-09-21T00:14:32.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.223+0000 7fa14a800640 1 -- 172.21.15.83:0/1608399544 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa120005580 con 0x7fa13c04eff0 2024-09-21T00:14:32.224 INFO:teuthology.orchestra.run.smithi083.stdout:64424509448 2024-09-21T00:14:32.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.225+0000 7fa141600640 1 -- 172.21.15.83:0/1608399544 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa13c04bea0 con 0x7fa13c04eff0 2024-09-21T00:14:32.226 INFO:teuthology.orchestra.run.smithi083.stdout:64424509447 2024-09-21T00:14:32.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.228+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f71c0078c60 msgr2=0x7f71c007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.228+0000 7f71e4e00640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f71c0078c60 0x7f71c007b170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71e01599e0 tx=0x7f71d00067d0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.228+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71e0153f70 msgr2=0x7f71e0157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.228+0000 7f71e4e00640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71e0153f70 0x7f71e0157760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71e0072d40 tx=0x7f71cc00fae0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.228+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 shutdown_connections 2024-09-21T00:14:32.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.228+0000 7f71e4e00640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f71c0078c60 0x7f71c007b170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.228+0000 7f71e4e00640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71e0157ca0 0x7f71e0155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.229+0000 7f71e4e00640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71e0153f70 0x7f71e0157760 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.229+0000 7f71e4e00640 1 --2- 172.21.15.83:0/3939862333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71e0201b00 0x7f71e0153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.229+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 >> 172.21.15.83:0/3939862333 conn(0x7f71e00b1b90 msgr2=0x7f71e0154ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:32.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.229+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 shutdown_connections 2024-09-21T00:14:32.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.229+0000 7f71e4e00640 1 -- 172.21.15.83:0/3939862333 wait complete. 2024-09-21T00:14:32.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.230+0000 7fa14a800640 1 -- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa124078d90 msgr2=0x7fa12407b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.230+0000 7fa14a800640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa124078d90 0x7fa12407b2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa130009b90 tx=0x7fa1300096a0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.230+0000 7fa14a800640 1 -- 172.21.15.83:0/1608399544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa13c04eff0 msgr2=0x7fa13c0db6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.230+0000 7fa14a800640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa13c04eff0 0x7fa13c0db6f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa144075fd0 tx=0x7fa14406b270 comp rx=0 tx=0).stop 2024-09-21T00:14:32.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.231+0000 7fa14a800640 1 -- 172.21.15.83:0/1608399544 shutdown_connections 2024-09-21T00:14:32.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.231+0000 7fa14a800640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa124078d90 0x7fa12407b2a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.231+0000 7fa14a800640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa13c04eff0 0x7fa13c0db6f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.231+0000 7fa14a800640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0da3a0 0x7fa13c04eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.231+0000 7fa14a800640 1 --2- 172.21.15.83:0/1608399544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa12c004800 0x7fa13c04b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.231+0000 7fa14a800640 1 -- 172.21.15.83:0/1608399544 >> 172.21.15.83:0/1608399544 conn(0x7fa13c03a5f0 msgr2=0x7fa13c057280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:32.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.232+0000 7fa14a800640 1 -- 172.21.15.83:0/1608399544 shutdown_connections 2024-09-21T00:14:32.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.232+0000 7fa14a800640 1 -- 172.21.15.83:0/1608399544 wait complete. 2024-09-21T00:14:32.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2024-09-21T00:14:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.249+0000 7f5874a00640 1 -- 172.21.15.83:0/2336625905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f58680dfd00 con 0x7f5868051630 2024-09-21T00:14:32.251 INFO:teuthology.orchestra.run.smithi083.stdout:55834574856 2024-09-21T00:14:32.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.250+0000 7f5866a00640 1 -- 172.21.15.83:0/2336625905 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f586006b7b0 con 0x7f5868051630 2024-09-21T00:14:32.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.253+0000 7f5874a00640 1 -- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5850078fc0 msgr2=0x7f585007b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.253+0000 7f5874a00640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5850078fc0 0x7f585007b4d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f586817d5c0 tx=0x7f585c009040 comp rx=0 tx=0).stop 2024-09-21T00:14:32.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.254+0000 7f5874a00640 1 -- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5868051630 msgr2=0x7f58680d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.254+0000 7f5874a00640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5868051630 0x7f58680d04e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f586000c3c0 tx=0x7f586000c880 comp rx=0 tx=0).stop 2024-09-21T00:14:32.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.255+0000 7f5874a00640 1 -- 172.21.15.83:0/2336625905 shutdown_connections 2024-09-21T00:14:32.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.255+0000 7f5874a00640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5850078fc0 0x7f585007b4d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.255+0000 7f5874a00640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58680ebe80 0x7f58680d9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.255+0000 7f5874a00640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868052360 0x7f58680da860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.255+0000 7f5874a00640 1 --2- 172.21.15.83:0/2336625905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5868051630 0x7f58680d04e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.255+0000 7f5874a00640 1 -- 172.21.15.83:0/2336625905 >> 172.21.15.83:0/2336625905 conn(0x7f586801d9a0 msgr2=0x7f58680e7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:32.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.255+0000 7f5874a00640 1 -- 172.21.15.83:0/2336625905 shutdown_connections 2024-09-21T00:14:32.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.255+0000 7f5874a00640 1 -- 172.21.15.83:0/2336625905 wait complete. 2024-09-21T00:14:32.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.256+0000 7f3dc0a00640 1 -- 172.21.15.83:0/6719929 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3d94005850 con 0x7f3dbc0cf6b0 2024-09-21T00:14:32.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.257+0000 7f3db2a00640 1 -- 172.21.15.83:0/6719929 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3da40679d0 con 0x7f3dbc0cf6b0 2024-09-21T00:14:32.260 INFO:teuthology.orchestra.run.smithi083.stdout:64424509449 2024-09-21T00:14:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.260+0000 7f3dc0a00640 1 -- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3d98078c60 msgr2=0x7f3d9807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.260+0000 7f3dc0a00640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3d98078c60 0x7f3d9807b170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0cbf20 tx=0x7f3dac03e040 comp rx=0 tx=0).stop 2024-09-21T00:14:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.260+0000 7f3dc0a00640 1 -- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dbc0cf6b0 msgr2=0x7f3dbc15b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.260+0000 7f3dc0a00640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dbc0cf6b0 0x7f3dbc15b300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3da400d730 tx=0x7f3da400dbf0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.261+0000 7f3dc0a00640 1 -- 172.21.15.83:0/6719929 shutdown_connections 2024-09-21T00:14:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.261+0000 7f3dc0a00640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3d98078c60 0x7f3d9807b170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.261+0000 7f3dc0a00640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc0cfac0 0x7f3dbc09d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.261+0000 7f3dc0a00640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dbc0cf6b0 0x7f3dbc15b300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.261+0000 7f3dc0a00640 1 --2- 172.21.15.83:0/6719929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc073000 0x7f3dbc0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.261+0000 7f3dc0a00640 1 -- 172.21.15.83:0/6719929 >> 172.21.15.83:0/6719929 conn(0x7f3dbc0b1b90 msgr2=0x7f3dbc160fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:32.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.261+0000 7f3dc0a00640 1 -- 172.21.15.83:0/6719929 shutdown_connections 2024-09-21T00:14:32.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.261+0000 7f3dc0a00640 1 -- 172.21.15.83:0/6719929 wait complete. 2024-09-21T00:14:32.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.262+0000 7fd68a800640 1 -- 172.21.15.83:0/1410453091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd6840c8ca0 con 0x7fd68415e1c0 2024-09-21T00:14:32.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.263+0000 7fd681600640 1 -- 172.21.15.83:0/1410453091 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd670063700 con 0x7fd68415e1c0 2024-09-21T00:14:32.264 INFO:teuthology.orchestra.run.smithi083.stdout:64424509448 2024-09-21T00:14:32.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-09-21T00:14:32.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.266+0000 7fd68a800640 1 -- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd66407d1d0 msgr2=0x7fd66407f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.266+0000 7fd68a800640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd66407d1d0 0x7fd66407f6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd67c007f20 tx=0x7fd67c009040 comp rx=0 tx=0).stop 2024-09-21T00:14:32.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.266+0000 7fd68a800640 1 -- 172.21.15.83:0/1410453091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd68415e1c0 msgr2=0x7fd68414f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.266+0000 7fd68a800640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd68415e1c0 0x7fd68414f9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd67000e6d0 tx=0x7fd67000eb90 comp rx=0 tx=0).stop 2024-09-21T00:14:32.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.267+0000 7fd68a800640 1 -- 172.21.15.83:0/1410453091 shutdown_connections 2024-09-21T00:14:32.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.267+0000 7fd68a800640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd66407d1d0 0x7fd66407f6e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.267+0000 7fd68a800640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd68415e1c0 0x7fd68414f9b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.267+0000 7fd68a800640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd684151080 0x7fd68414f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.267+0000 7fd68a800640 1 --2- 172.21.15.83:0/1410453091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd68406edf0 0x7fd6840c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.267+0000 7fd68a800640 1 -- 172.21.15.83:0/1410453091 >> 172.21.15.83:0/1410453091 conn(0x7fd6840d05c0 msgr2=0x7fd6840b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:32.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.267+0000 7fd68a800640 1 -- 172.21.15.83:0/1410453091 shutdown_connections 2024-09-21T00:14:32.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.267+0000 7fd68a800640 1 -- 172.21.15.83:0/1410453091 wait complete. 2024-09-21T00:14:32.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.268+0000 7f47db000640 1 -- 172.21.15.83:0/1090454075 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f47d40ce390 con 0x7f47d415e350 2024-09-21T00:14:32.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.268+0000 7f47d1600640 1 -- 172.21.15.83:0/1090454075 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47c0074960 con 0x7f47d415e350 2024-09-21T00:14:32.270 INFO:teuthology.orchestra.run.smithi083.stdout:64424509448 2024-09-21T00:14:32.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-09-21T00:14:32.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.271+0000 7f47db000640 1 -- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f47b4078bc0 msgr2=0x7f47b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.271+0000 7f47db000640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f47b4078bc0 0x7f47b407b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f47cc035000 tx=0x7f47cc004ab0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.271+0000 7f47db000640 1 -- 172.21.15.83:0/1090454075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d415e350 msgr2=0x7f47d40c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.271+0000 7f47db000640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d415e350 0x7f47d40c9e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47c000afc0 tx=0x7f47c000cd50 comp rx=0 tx=0).stop 2024-09-21T00:14:32.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.272+0000 7f47db000640 1 -- 172.21.15.83:0/1090454075 shutdown_connections 2024-09-21T00:14:32.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.272+0000 7f47db000640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f47b4078bc0 0x7f47b407b0d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.272+0000 7f47db000640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47d415f6d0 0x7f47d40ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.272+0000 7f47db000640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d415e350 0x7f47d40c9e60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.272+0000 7f47db000640 1 --2- 172.21.15.83:0/1090454075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47d40cf620 0x7f47d41f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.272+0000 7f47db000640 1 -- 172.21.15.83:0/1090454075 >> 172.21.15.83:0/1090454075 conn(0x7f47d40d41e0 msgr2=0x7f47d4159780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:32.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.272+0000 7f47db000640 1 -- 172.21.15.83:0/1090454075 shutdown_connections 2024-09-21T00:14:32.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.272+0000 7f47db000640 1 -- 172.21.15.83:0/1090454075 wait complete. 2024-09-21T00:14:32.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.286+0000 7fcf1be00640 1 -- 172.21.15.83:0/2753785103 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcf04005580 con 0x7fcf30074880 2024-09-21T00:14:32.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.287+0000 7fcf26a00640 1 -- 172.21.15.83:0/2753785103 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf20031770 con 0x7fcf30074880 2024-09-21T00:14:32.288 INFO:teuthology.orchestra.run.smithi083.stdout:64424509450 2024-09-21T00:14:32.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.2 2024-09-21T00:14:32.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 -- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcf10078fc0 msgr2=0x7fcf1007b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcf10078fc0 0x7fcf1007b4d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf28002170 tx=0x7fcf28009040 comp rx=0 tx=0).stop 2024-09-21T00:14:32.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 -- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf30074880 msgr2=0x7fcf3015d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:32.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf30074880 0x7fcf3015d770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009780 tx=0x7fcf20033c90 comp rx=0 tx=0).stop 2024-09-21T00:14:32.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 -- 172.21.15.83:0/2753785103 shutdown_connections 2024-09-21T00:14:32.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcf10078fc0 0x7fcf1007b4d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf300af4e0 0x7fcf300b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf30074880 0x7fcf3015d770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 --2- 172.21.15.83:0/2753785103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf3006f330 0x7fcf30155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:32.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 -- 172.21.15.83:0/2753785103 >> 172.21.15.83:0/2753785103 conn(0x7fcf300d0350 msgr2=0x7fcf300aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:32.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 -- 172.21.15.83:0/2753785103 shutdown_connections 2024-09-21T00:14:32.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:32.290+0000 7fcf1be00640 1 -- 172.21.15.83:0/2753785103 wait complete. 2024-09-21T00:14:32.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2024-09-21T00:14:32.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.5 2024-09-21T00:14:32.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.6 2024-09-21T00:14:32.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.7 2024-09-21T00:14:33.251 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T00:14:33.268 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T00:14:33.272 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T00:14:33.291 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T00:14:33.299 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T00:14:33.301 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T00:14:33.309 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T00:14:33.313 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T00:14:33.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.580+0000 7f5c20a00640 1 -- 172.21.15.83:0/1911623887 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14003f40 con 0x7f5c1c0064f0 2024-09-21T00:14:33.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.581+0000 7f5c23200640 1 -- 172.21.15.83:0/1911623887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1c0064f0 msgr2=0x7f5c1c0f28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.581+0000 7f5c23200640 1 --2- 172.21.15.83:0/1911623887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1c0064f0 0x7f5c1c0f28b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c100097e0 tx=0x7f5c1002a4d0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.581+0000 7f5c23200640 1 -- 172.21.15.83:0/1911623887 shutdown_connections 2024-09-21T00:14:33.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.581+0000 7f5c23200640 1 --2- 172.21.15.83:0/1911623887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1c0064f0 0x7f5c1c0f28b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.581+0000 7f5c23200640 1 -- 172.21.15.83:0/1911623887 >> 172.21.15.83:0/1911623887 conn(0x7f5c1c01d9a0 msgr2=0x7f5c1c039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:33.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.582+0000 7f5c23200640 1 -- 172.21.15.83:0/1911623887 shutdown_connections 2024-09-21T00:14:33.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.582+0000 7f5c23200640 1 -- 172.21.15.83:0/1911623887 wait complete. 2024-09-21T00:14:33.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.587+0000 7f5c23200640 1 Processor -- start 2024-09-21T00:14:33.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.587+0000 7f5c23200640 1 -- start start 2024-09-21T00:14:33.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.590+0000 7f5c23200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c1c0064f0 0x7f5c1c01e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.590+0000 7f5c23200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1c052360 0x7f5c1c0dbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.590+0000 7f5c23200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c1c0e71d0 0x7f5c1c0329b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.590+0000 7f5c23200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c0e3590 con 0x7f5c1c0e71d0 2024-09-21T00:14:33.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.590+0000 7f5c23200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c0e3410 con 0x7f5c1c0064f0 2024-09-21T00:14:33.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.590+0000 7f5c23200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1c0f2df0 con 0x7f5c1c052360 2024-09-21T00:14:33.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.591+0000 7f5c21400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1c052360 0x7f5c1c0dbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.591+0000 7f5c21400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1c052360 0x7f5c1c0dbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:39286/0 (socket says 172.21.15.83:39286) 2024-09-21T00:14:33.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.591+0000 7f5c21400640 1 -- 172.21.15.83:0/1590637385 learned_addr learned my addr 172.21.15.83:0/1590637385 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:33.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.592+0000 7f5c21400640 1 -- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c1c0064f0 msgr2=0x7f5c1c01e720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T00:14:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.592+0000 7f5c21400640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c1c0064f0 0x7f5c1c01e720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.592+0000 7f5c21400640 1 -- 172.21.15.83:0/1590637385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c1c0e71d0 msgr2=0x7f5c1c0329b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.592+0000 7f5c22800640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c1c0e71d0 0x7f5c1c0329b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.592+0000 7f5c21400640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c1c0e71d0 0x7f5c1c0329b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.593+0000 7f5c21400640 1 -- 172.21.15.83:0/1590637385 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c021350 con 0x7f5c1c052360 2024-09-21T00:14:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.593+0000 7f5c22800640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c1c0e71d0 0x7f5c1c0329b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.594+0000 7f5c21400640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1c052360 0x7f5c1c0dbb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5c2407acc0 tx=0x7f5c2406a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.594+0000 7f5c1a000640 1 -- 172.21.15.83:0/1590637385 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c240753c0 con 0x7f5c1c052360 2024-09-21T00:14:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.594+0000 7f5c1a000640 1 -- 172.21.15.83:0/1590637385 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c24076290 con 0x7f5c1c052360 2024-09-21T00:14:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.594+0000 7f5c1a000640 1 -- 172.21.15.83:0/1590637385 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24076760 con 0x7f5c1c052360 2024-09-21T00:14:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.595+0000 7f5c23200640 1 -- 172.21.15.83:0/1590637385 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c021630 con 0x7f5c1c052360 2024-09-21T00:14:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.595+0000 7f5c23200640 1 -- 172.21.15.83:0/1590637385 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c021bf0 con 0x7f5c1c052360 2024-09-21T00:14:33.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.597+0000 7f5c0f400640 1 -- 172.21.15.83:0/1590637385 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf8005290 con 0x7f5c1c052360 2024-09-21T00:14:33.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.599+0000 7f5c1a000640 1 -- 172.21.15.83:0/1590637385 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c24093400 con 0x7f5c1c052360 2024-09-21T00:14:33.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.600+0000 7f5c1a000640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5c04078b90 0x7f5c0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.601+0000 7f5c21e00640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5c04078b90 0x7f5c0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.602+0000 7f5c1a000640 1 -- 172.21.15.83:0/1590637385 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5c241144e0 con 0x7f5c1c052360 2024-09-21T00:14:33.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.602+0000 7f5c21e00640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5c04078b90 0x7f5c0407b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5c140040b0 tx=0x7f5c140039a0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.608+0000 7f5c1a000640 1 -- 172.21.15.83:0/1590637385 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5c2408f030 con 0x7f5c1c052360 2024-09-21T00:14:33.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.651+0000 7f66c1a00640 1 -- 172.21.15.83:0/444687960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b40e7850 msgr2=0x7f66b40e3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.651+0000 7f66c1a00640 1 --2- 172.21.15.83:0/444687960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b40e7850 0x7f66b40e3140 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f66b00098e0 tx=0x7f66b002a4b0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.651+0000 7f66c1a00640 1 -- 172.21.15.83:0/444687960 shutdown_connections 2024-09-21T00:14:33.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.651+0000 7f66c1a00640 1 --2- 172.21.15.83:0/444687960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b4007670 0x7f66b40379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.651+0000 7f66c1a00640 1 --2- 172.21.15.83:0/444687960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b40e7850 0x7f66b40e3140 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.651+0000 7f66c1a00640 1 -- 172.21.15.83:0/444687960 >> 172.21.15.83:0/444687960 conn(0x7f66b400e240 msgr2=0x7f66b400e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:33.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.652+0000 7f66c1a00640 1 -- 172.21.15.83:0/444687960 shutdown_connections 2024-09-21T00:14:33.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.652+0000 7f66c1a00640 1 -- 172.21.15.83:0/444687960 wait complete. 2024-09-21T00:14:33.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.656+0000 7f66c1a00640 1 Processor -- start 2024-09-21T00:14:33.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.657+0000 7f66c1a00640 1 -- start start 2024-09-21T00:14:33.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.660+0000 7f66c1a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b40375b0 0x7f66b40d9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.660+0000 7f66c1a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40e7850 0x7f66b404fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.660+0000 7f66c1a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b4050080 0x7f66b400a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.660+0000 7f66c1a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f66b4056b40 con 0x7f66b40375b0 2024-09-21T00:14:33.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.660+0000 7f66c1a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f66b40569c0 con 0x7f66b40e7850 2024-09-21T00:14:33.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.660+0000 7f66c1a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f66b4056cc0 con 0x7f66b4050080 2024-09-21T00:14:33.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.661+0000 7f66c1000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b4050080 0x7f66b400a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.662+0000 7f66bb400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40e7850 0x7f66b404fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.662+0000 7f66bb400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40e7850 0x7f66b404fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:41790/0 (socket says 172.21.15.83:41790) 2024-09-21T00:14:33.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.662+0000 7f66bb400640 1 -- 172.21.15.83:0/3679879746 learned_addr learned my addr 172.21.15.83:0/3679879746 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:33.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.662+0000 7f66bbe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b40375b0 0x7f66b40d9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.662+0000 7f66bb400640 1 -- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b4050080 msgr2=0x7f66b400a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.662+0000 7f66bb400640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b4050080 0x7f66b400a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.663+0000 7f66bb400640 1 -- 172.21.15.83:0/3679879746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b40375b0 msgr2=0x7f66b40d9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.663+0000 7f66bb400640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b40375b0 0x7f66b40d9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.663+0000 7f66bb400640 1 -- 172.21.15.83:0/3679879746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b4050b30 con 0x7f66b40e7850 2024-09-21T00:14:33.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.663+0000 7f66bbe00640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b40375b0 0x7f66b40d9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:33.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.664+0000 7f66bb400640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40e7850 0x7f66b404fb40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f66bc06c0e0 tx=0x7f66bc06a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.664+0000 7f66afe00640 1 -- 172.21.15.83:0/3679879746 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc0753c0 con 0x7f66b40e7850 2024-09-21T00:14:33.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.664+0000 7f66afe00640 1 -- 172.21.15.83:0/3679879746 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66bc076270 con 0x7f66b40e7850 2024-09-21T00:14:33.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.665+0000 7f66afe00640 1 -- 172.21.15.83:0/3679879746 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc0753c0 con 0x7f66b40e7850 2024-09-21T00:14:33.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.665+0000 7f1efaa00640 1 -- 172.21.15.83:0/3578585652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1edc005160 msgr2=0x7f1edc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.665+0000 7f1efaa00640 1 --2- 172.21.15.83:0/3578585652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1edc005160 0x7f1edc00b9c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1ef406ba80 tx=0x7f1edc005830 comp rx=0 tx=0).stop 2024-09-21T00:14:33.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.665+0000 7f66c1a00640 1 -- 172.21.15.83:0/3679879746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b4050850 con 0x7f66b40e7850 2024-09-21T00:14:33.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.665+0000 7f66c1a00640 1 -- 172.21.15.83:0/3679879746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b400c930 con 0x7f66b40e7850 2024-09-21T00:14:33.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.665+0000 7f1efaa00640 1 -- 172.21.15.83:0/3578585652 shutdown_connections 2024-09-21T00:14:33.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.665+0000 7f1efaa00640 1 --2- 172.21.15.83:0/3578585652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1edc005160 0x7f1edc00b9c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.665+0000 7f1efaa00640 1 -- 172.21.15.83:0/3578585652 >> 172.21.15.83:0/3578585652 conn(0x7f1eec03a5e0 msgr2=0x7f1eec03a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:33.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.665+0000 7f1efaa00640 1 -- 172.21.15.83:0/3578585652 shutdown_connections 2024-09-21T00:14:33.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.665+0000 7f1efaa00640 1 -- 172.21.15.83:0/3578585652 wait complete. 2024-09-21T00:14:33.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.667+0000 7f3fc0000640 1 -- 172.21.15.83:0/1577863952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fb806cde0 msgr2=0x7f3fb806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.667+0000 7f3fc0000640 1 --2- 172.21.15.83:0/1577863952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fb806cde0 0x7f3fb806d1f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3fb808d140 tx=0x7f3fb002a980 comp rx=0 tx=0).stop 2024-09-21T00:14:33.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.668+0000 7f3fc0000640 1 -- 172.21.15.83:0/1577863952 shutdown_connections 2024-09-21T00:14:33.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.668+0000 7f3fc0000640 1 --2- 172.21.15.83:0/1577863952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fb806cde0 0x7f3fb806d1f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.668+0000 7f3fc0000640 1 --2- 172.21.15.83:0/1577863952 >> v2:172.21.15.142:3300/0 conn(0x7f3fb815e740 0x7f3fb80ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.668+0000 7f3fc0000640 1 -- 172.21.15.83:0/1577863952 >> 172.21.15.83:0/1577863952 conn(0x7f3fb80d4290 msgr2=0x7f3fb80d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:33.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.668+0000 7f3fc0000640 1 -- 172.21.15.83:0/1577863952 shutdown_connections 2024-09-21T00:14:33.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.669+0000 7f1efaa00640 1 Processor -- start 2024-09-21T00:14:33.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.669+0000 7f66afe00640 1 -- 172.21.15.83:0/3679879746 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66bc076460 con 0x7f66b40e7850 2024-09-21T00:14:33.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.670+0000 7f1efaa00640 1 -- start start 2024-09-21T00:14:33.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.671+0000 7f66afe00640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f669c078dc0 0x7f669c07b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.671+0000 7f66c1a00640 1 -- 172.21.15.83:0/3679879746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6698005290 con 0x7f66b40e7850 2024-09-21T00:14:33.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.671+0000 7f66afe00640 1 -- 172.21.15.83:0/3679879746 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f66bc1158f0 con 0x7f66b40e7850 2024-09-21T00:14:33.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.669+0000 7f3fc0000640 1 -- 172.21.15.83:0/1577863952 wait complete. 2024-09-21T00:14:33.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.673+0000 7f3fc0000640 1 Processor -- start 2024-09-21T00:14:33.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.672+0000 7f1efaa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1edc005160 0x7f1eec17e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.673+0000 7f1efaa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eec04ddc0 0x7f1eec04e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.673+0000 7f1efaa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec0e07d0 0x7f1eec0e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.673+0000 7f1efaa00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec053f40 con 0x7f1edc005160 2024-09-21T00:14:33.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.673+0000 7f1efaa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec053dc0 con 0x7f1eec04ddc0 2024-09-21T00:14:33.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.673+0000 7f1efaa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1eec0540c0 con 0x7f1eec0e07d0 2024-09-21T00:14:33.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.673+0000 7f3fc0000640 1 -- start start 2024-09-21T00:14:33.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.673+0000 7f66bbe00640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f669c078dc0 0x7f669c07b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.674+0000 7f1ef3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1edc005160 0x7f1eec17e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.674+0000 7f1ef8a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec0e07d0 0x7f1eec0e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.674+0000 7f1ef3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1edc005160 0x7f1eec17e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37108/0 (socket says 172.21.15.83:37108) 2024-09-21T00:14:33.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.674+0000 7f1ef3e00640 1 -- 172.21.15.83:0/2806200438 learned_addr learned my addr 172.21.15.83:0/2806200438 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:33.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.674+0000 7f66bbe00640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f669c078dc0 0x7f669c07b2d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f66b0034000 tx=0x7f66b0004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.675+0000 7f1ef3400640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eec04ddc0 0x7f1eec04e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.675+0000 7f1ef3e00640 1 -- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec0e07d0 msgr2=0x7f1eec0e0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.675+0000 7f1ef3e00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec0e07d0 0x7f1eec0e0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.675+0000 7f1ef3e00640 1 -- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eec04ddc0 msgr2=0x7f1eec04e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.675+0000 7f1ef3e00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eec04ddc0 0x7f1eec04e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f3fc0000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fb806cde0 0x7f3fb815cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f1ef3e00640 1 -- 172.21.15.83:0/2806200438 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eec17e610 con 0x7f1edc005160 2024-09-21T00:14:33.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f1ef8a00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec0e07d0 0x7f1eec0e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:33.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f3fc0000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fb80d2410 0x7f3fb81e8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f3fc0000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fb815e740 0x7f3fb81e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f3fc0000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb806d8b0 con 0x7f3fb806cde0 2024-09-21T00:14:33.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f3fc0000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb806d730 con 0x7f3fb815e740 2024-09-21T00:14:33.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f3fc0000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb806da30 con 0x7f3fb80d2410 2024-09-21T00:14:33.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f3fbd600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fb806cde0 0x7f3fb815cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f3fbd600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fb806cde0 0x7f3fb815cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37114/0 (socket says 172.21.15.83:37114) 2024-09-21T00:14:33.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f3fbd600640 1 -- 172.21.15.83:0/2737687796 learned_addr learned my addr 172.21.15.83:0/2737687796 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:33.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f3fbcc00640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fb80d2410 0x7f3fb81e8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.676+0000 7f1ef3400640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eec04ddc0 0x7f1eec04e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:33.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.677+0000 7f3fbe000640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fb815e740 0x7f3fb81e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.677+0000 7f3fbd600640 1 -- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fb80d2410 msgr2=0x7f3fb81e8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.677+0000 7f3fbd600640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fb80d2410 0x7f3fb81e8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.677+0000 7f1ef3e00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1edc005160 0x7f1eec17e0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800fa90 tx=0x7f1ee800ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.677+0000 7f3fbd600640 1 -- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fb815e740 msgr2=0x7f3fb81e92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.677+0000 7f3fbd600640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fb815e740 0x7f3fb81e92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.677+0000 7f3fbd600640 1 -- 172.21.15.83:0/2737687796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb815d470 con 0x7f3fb806cde0 2024-09-21T00:14:33.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.678+0000 7f1ee3e00640 1 -- 172.21.15.83:0/2806200438 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee800dca0 con 0x7f1edc005160 2024-09-21T00:14:33.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.678+0000 7f1ee3e00640 1 -- 172.21.15.83:0/2806200438 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ee800de40 con 0x7f1edc005160 2024-09-21T00:14:33.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.678+0000 7f1ee3e00640 1 -- 172.21.15.83:0/2806200438 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8005280 con 0x7f1edc005160 2024-09-21T00:14:33.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.677+0000 7f3fbe000640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fb815e740 0x7f3fb81e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:33.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.677+0000 7f3fbcc00640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fb80d2410 0x7f3fb81e8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:33.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.678+0000 7f1efaa00640 1 -- 172.21.15.83:0/2806200438 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eec04e710 con 0x7f1edc005160 2024-09-21T00:14:33.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.678+0000 7f1efaa00640 1 -- 172.21.15.83:0/2806200438 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eec0d1ad0 con 0x7f1edc005160 2024-09-21T00:14:33.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.680+0000 7f66afe00640 1 -- 172.21.15.83:0/3679879746 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f66bc09a030 con 0x7f66b40e7850 2024-09-21T00:14:33.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.678+0000 7f3fbd600640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fb806cde0 0x7f3fb815cb40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00e790 tx=0x7f3fac00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.681+0000 7f3fb5600640 1 -- 172.21.15.83:0/2737687796 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac00eea0 con 0x7f3fb806cde0 2024-09-21T00:14:33.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.681+0000 7f3fb5600640 1 -- 172.21.15.83:0/2737687796 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fac00cdb0 con 0x7f3fb806cde0 2024-09-21T00:14:33.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.681+0000 7f3fb5600640 1 -- 172.21.15.83:0/2737687796 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac00eea0 con 0x7f3fb806cde0 2024-09-21T00:14:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.682+0000 7f1efaa00640 1 -- 172.21.15.83:0/2806200438 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eec006c00 con 0x7f1edc005160 2024-09-21T00:14:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.683+0000 7f1ee3e00640 1 -- 172.21.15.83:0/2806200438 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ee800c030 con 0x7f1edc005160 2024-09-21T00:14:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.682+0000 7f3fc0000640 1 -- 172.21.15.83:0/2737687796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb81e77f0 con 0x7f3fb806cde0 2024-09-21T00:14:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.682+0000 7f3fc0000640 1 -- 172.21.15.83:0/2737687796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb81e7db0 con 0x7f3fb806cde0 2024-09-21T00:14:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.685+0000 7f3fc0000640 1 -- 172.21.15.83:0/2737687796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb806df00 con 0x7f3fb806cde0 2024-09-21T00:14:33.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.687+0000 7f1ee3e00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1ed8078be0 0x7f1ed807b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.688+0000 7f1ee3e00640 1 -- 172.21.15.83:0/2806200438 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1ee809b850 con 0x7f1edc005160 2024-09-21T00:14:33.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.688+0000 7f1ef3400640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1ed8078be0 0x7f1ed807b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.689+0000 7f1ef3400640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1ed8078be0 0x7f1ed807b0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0e70f0 tx=0x7f1ee4006ba0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.694+0000 7f1ee3e00640 1 -- 172.21.15.83:0/2806200438 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1eec04e710 con 0x7f1edc005160 2024-09-21T00:14:33.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.701+0000 7f3fb5600640 1 -- 172.21.15.83:0/2737687796 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3fac01f020 con 0x7f3fb806cde0 2024-09-21T00:14:33.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.703+0000 7f3fb5600640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3f98078d90 0x7f3f9807b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.703+0000 7f3fb5600640 1 -- 172.21.15.83:0/2737687796 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3fac09bac0 con 0x7f3fb806cde0 2024-09-21T00:14:33.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.708+0000 7f3fb5600640 1 -- 172.21.15.83:0/2737687796 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3fac026070 con 0x7f3fb806cde0 2024-09-21T00:14:33.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.709+0000 7f3fbcc00640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3f98078d90 0x7f3f9807b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.714+0000 7f3fbcc00640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3f98078d90 0x7f3f9807b2a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80cdd30 tx=0x7f3fa4008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.740+0000 7f8e21400640 1 -- 172.21.15.83:0/1014902157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14054190 msgr2=0x7f8e14007550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.740+0000 7f8e21400640 1 --2- 172.21.15.83:0/1014902157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14054190 0x7f8e14007550 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8e14011a10 tx=0x7f8e1002a5c0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.740+0000 7f8e21400640 1 -- 172.21.15.83:0/1014902157 shutdown_connections 2024-09-21T00:14:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.740+0000 7f8e21400640 1 --2- 172.21.15.83:0/1014902157 >> v2:172.21.15.83:3300/0 conn(0x7f8e140e3200 0x7f8e14053150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.740+0000 7f8e21400640 1 --2- 172.21.15.83:0/1014902157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14054190 0x7f8e14007550 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.740+0000 7f8e21400640 1 -- 172.21.15.83:0/1014902157 >> 172.21.15.83:0/1014902157 conn(0x7f8e1403a680 msgr2=0x7f8e1403aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.740+0000 7f8e21400640 1 -- 172.21.15.83:0/1014902157 shutdown_connections 2024-09-21T00:14:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.740+0000 7f8e21400640 1 -- 172.21.15.83:0/1014902157 wait complete. 2024-09-21T00:14:33.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.743+0000 7ff900e00640 1 -- 172.21.15.83:0/3536935132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8fc15f6d0 msgr2=0x7ff8fc15e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.743+0000 7ff900e00640 1 --2- 172.21.15.83:0/3536935132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8fc15f6d0 0x7ff8fc15e3d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc06ed00 tx=0x7ff8ec02a560 comp rx=0 tx=0).stop 2024-09-21T00:14:33.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.744+0000 7f8e21400640 1 Processor -- start 2024-09-21T00:14:33.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.744+0000 7ff900e00640 1 -- 172.21.15.83:0/3536935132 shutdown_connections 2024-09-21T00:14:33.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.745+0000 7ff900e00640 1 --2- 172.21.15.83:0/3536935132 >> v2:172.21.15.142:3300/0 conn(0x7ff8fc0d2290 0x7ff8fc0d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.745+0000 7ff900e00640 1 --2- 172.21.15.83:0/3536935132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8fc15f6d0 0x7ff8fc15e3d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.745+0000 7ff900e00640 1 -- 172.21.15.83:0/3536935132 >> 172.21.15.83:0/3536935132 conn(0x7ff8fc0d41e0 msgr2=0x7ff8fc0d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:33.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.744+0000 7f8e21400640 1 -- start start 2024-09-21T00:14:33.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.745+0000 7ff900e00640 1 -- 172.21.15.83:0/3536935132 shutdown_connections 2024-09-21T00:14:33.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.745+0000 7ff900e00640 1 -- 172.21.15.83:0/3536935132 wait complete. 2024-09-21T00:14:33.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.747+0000 7f8e21400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e14053690 0x7f8e140e3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.748+0000 7f8e21400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14054190 0x7f8e140d5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.748+0000 7f8e21400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e140e3200 0x7f8e1402fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.748+0000 7f8e21400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8e140e7510 con 0x7f8e14053690 2024-09-21T00:14:33.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.748+0000 7f8e1b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14054190 0x7f8e140d5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.748+0000 7f8e1b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14054190 0x7f8e140d5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:41832/0 (socket says 172.21.15.83:41832) 2024-09-21T00:14:33.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.748+0000 7f8e1b400640 1 -- 172.21.15.83:0/1627673821 learned_addr learned my addr 172.21.15.83:0/1627673821 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:33.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.749+0000 7ff900e00640 1 Processor -- start 2024-09-21T00:14:33.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.749+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8e14053ea0 con 0x7f8e14054190 2024-09-21T00:14:33.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.749+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8e140e7690 con 0x7f8e140e3200 2024-09-21T00:14:33.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.749+0000 7ff900e00640 1 -- start start 2024-09-21T00:14:33.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.750+0000 7f8e20a00640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e140e3200 0x7f8e1402fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.749+0000 7f8e1be00640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e14053690 0x7f8e140e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.750+0000 7f8e1b400640 1 -- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e140e3200 msgr2=0x7f8e1402fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.751+0000 7f8e1b400640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e140e3200 0x7f8e1402fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.751+0000 7f8e1b400640 1 -- 172.21.15.83:0/1627673821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e14053690 msgr2=0x7f8e140e3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.751+0000 7f8e1b400640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e14053690 0x7f8e140e3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.751+0000 7f8e1b400640 1 -- 172.21.15.83:0/1627673821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e140e4140 con 0x7f8e14054190 2024-09-21T00:14:33.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.751+0000 7f8e1be00640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e14053690 0x7f8e140e3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:33.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.752+0000 7f8e20a00640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e140e3200 0x7f8e1402fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:33.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.752+0000 7f8e1b400640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14054190 0x7f8e140d5ee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009fd0 tx=0x7f8e0800ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.752+0000 7ff900e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0cef00 0x7ff8fc1f9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.753+0000 7ff900e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8fc0d2290 0x7ff8fc1494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.753+0000 7ff900e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8fc15f6d0 0x7ff8fc0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7ff900e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc0d2be0 con 0x7ff8fc15f6d0 2024-09-21T00:14:33.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7ff900e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc06dd10 con 0x7ff8fc0d2290 2024-09-21T00:14:33.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7ff900e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc0d2d60 con 0x7ff8fc0cef00 2024-09-21T00:14:33.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.753+0000 7ff8fb400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0cef00 0x7ff8fc1f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7ff8fb400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0cef00 0x7ff8fc1f9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:39346/0 (socket says 172.21.15.83:39346) 2024-09-21T00:14:33.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7ff8fb400640 1 -- 172.21.15.83:0/1569759903 learned_addr learned my addr 172.21.15.83:0/1569759903 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:33.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.753+0000 7f8e0fe00640 1 -- 172.21.15.83:0/1627673821 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800ccc0 con 0x7f8e14054190 2024-09-21T00:14:33.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.753+0000 7f8e0fe00640 1 -- 172.21.15.83:0/1627673821 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e0800ee70 con 0x7f8e14054190 2024-09-21T00:14:33.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.753+0000 7f8e0fe00640 1 -- 172.21.15.83:0/1627673821 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800ce60 con 0x7f8e14054190 2024-09-21T00:14:33.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e140e4420 con 0x7f8e14054190 2024-09-21T00:14:33.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e140e6bf0 con 0x7f8e14054190 2024-09-21T00:14:33.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7ff8fb400640 1 -- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8fc0d2290 msgr2=0x7ff8fc1494b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T00:14:33.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7ff8fb400640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8fc0d2290 0x7ff8fc1494b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7ff8fb400640 1 -- 172.21.15.83:0/1569759903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8fc15f6d0 msgr2=0x7ff8fc0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7ff8fb400640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8fc15f6d0 0x7ff8fc0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.754+0000 7ff8fb400640 1 -- 172.21.15.83:0/1569759903 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc1f98d0 con 0x7ff8fc0cef00 2024-09-21T00:14:33.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.755+0000 7ff8fb400640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0cef00 0x7ff8fc1f9390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec000c00 tx=0x7ff8ec003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.756+0000 7ff8f3400640 1 -- 172.21.15.83:0/1569759903 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec03e030 con 0x7ff8fc0cef00 2024-09-21T00:14:33.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.756+0000 7ff8f3400640 1 -- 172.21.15.83:0/1569759903 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8ec0047a0 con 0x7ff8fc0cef00 2024-09-21T00:14:33.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.756+0000 7ff8f3400640 1 -- 172.21.15.83:0/1569759903 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec035040 con 0x7ff8fc0cef00 2024-09-21T00:14:33.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.756+0000 7ff900e00640 1 -- 172.21.15.83:0/1569759903 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc0cebd0 con 0x7ff8fc0cef00 2024-09-21T00:14:33.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.757+0000 7ff900e00640 1 -- 172.21.15.83:0/1569759903 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc0ccd90 con 0x7ff8fc0cef00 2024-09-21T00:14:33.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.758+0000 7ff900e00640 1 -- 172.21.15.83:0/1569759903 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc0d3240 con 0x7ff8fc0cef00 2024-09-21T00:14:33.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.761+0000 7f8e0fe00640 1 -- 172.21.15.83:0/1627673821 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e08005260 con 0x7f8e14054190 2024-09-21T00:14:33.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.762+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e140e7bb0 con 0x7f8e14054190 2024-09-21T00:14:33.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.762+0000 7ff8f3400640 1 -- 172.21.15.83:0/1569759903 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8ec041030 con 0x7ff8fc0cef00 2024-09-21T00:14:33.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.763+0000 7f8e0fe00640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8dfc078c60 0x7f8dfc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.763+0000 7f8e0fe00640 1 -- 172.21.15.83:0/1627673821 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8e0809ba10 con 0x7f8e14054190 2024-09-21T00:14:33.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.764+0000 7ff8f3400640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8dc078c60 0x7ff8dc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.764+0000 7ff8f3400640 1 -- 172.21.15.83:0/1569759903 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff8ec0bb940 con 0x7ff8fc0cef00 2024-09-21T00:14:33.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.764+0000 7ff8faa00640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8dc078c60 0x7ff8dc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.764+0000 7f8e1be00640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8dfc078c60 0x7f8dfc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.765+0000 7ff8faa00640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8dc078c60 0x7ff8dc07b170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0cc710 tx=0x7ff8e80079b0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.766+0000 7f8e1be00640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8dfc078c60 0x7f8dfc07b170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8e10032000 tx=0x7f8e10004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.767+0000 7ff8f3400640 1 -- 172.21.15.83:0/1569759903 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff8fc1f98d0 con 0x7ff8fc0cef00 2024-09-21T00:14:33.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.770+0000 7f8e0fe00640 1 -- 172.21.15.83:0/1627673821 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8e08063af0 con 0x7f8e14054190 2024-09-21T00:14:33.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.799+0000 7f5e3fe00640 1 -- 172.21.15.83:0/2683933320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e24004800 msgr2=0x7f5e24004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.799+0000 7f5e3fe00640 1 --2- 172.21.15.83:0/2683933320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e24004800 0x7f5e24004c10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009870 tx=0x7f5e24005830 comp rx=0 tx=0).stop 2024-09-21T00:14:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.799+0000 7f5e3f400640 1 -- 172.21.15.83:0/2683933320 reap_dead start 2024-09-21T00:14:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.799+0000 7f5e3fe00640 1 -- 172.21.15.83:0/2683933320 shutdown_connections 2024-09-21T00:14:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.799+0000 7f5e3fe00640 1 -- 172.21.15.83:0/2683933320 >> 172.21.15.83:0/2683933320 conn(0x7f5e400d41e0 msgr2=0x7f5e400d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.800+0000 7f5e3fe00640 1 -- 172.21.15.83:0/2683933320 shutdown_connections 2024-09-21T00:14:33.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.800+0000 7f5e3fe00640 1 -- 172.21.15.83:0/2683933320 wait complete. 2024-09-21T00:14:33.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.804+0000 7f5e3fe00640 1 Processor -- start 2024-09-21T00:14:33.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.804+0000 7f5e3fe00640 1 -- start start 2024-09-21T00:14:33.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.807+0000 7f5e3fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e401627c0 0x7f5e40154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.807+0000 7f5e3fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e401f9eb0 0x7f5e401556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.807+0000 7f5e3fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e40155c10 0x7f5e401fca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.807+0000 7f5e3fe00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40167530 con 0x7f5e401627c0 2024-09-21T00:14:33.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.807+0000 7f5e3fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5e401673b0 con 0x7f5e40155c10 2024-09-21T00:14:33.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.807+0000 7f5e3fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5e401676b0 con 0x7f5e401f9eb0 2024-09-21T00:14:33.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.807+0000 7f5e3f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e40155c10 0x7f5e401fca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.808+0000 7f5e3f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e40155c10 0x7f5e401fca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:41862/0 (socket says 172.21.15.83:41862) 2024-09-21T00:14:33.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.808+0000 7f5e3f400640 1 -- 172.21.15.83:0/4083793844 learned_addr learned my addr 172.21.15.83:0/4083793844 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:33.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.808+0000 7f5e3f400640 1 -- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e401f9eb0 msgr2=0x7f5e401556d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T00:14:33.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.808+0000 7f5e3e000640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e401f9eb0 0x7f5e401556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.808+0000 7f5e3f400640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e401f9eb0 0x7f5e401556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.808+0000 7f5e3f400640 1 -- 172.21.15.83:0/4083793844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e401627c0 msgr2=0x7f5e40154b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T00:14:33.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.809+0000 7fa415000640 1 -- 172.21.15.83:0/2141688879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa41006e500 msgr2=0x7fa4100cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.809+0000 7fa415000640 1 --2- 172.21.15.83:0/2141688879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa41006e500 0x7fa4100cef00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa400005fd0 tx=0x7fa40002a8a0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.808+0000 7f5e3ea00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e401627c0 0x7f5e40154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.809+0000 7f5e3f400640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e401627c0 0x7f5e40154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.809+0000 7f5e3f400640 1 -- 172.21.15.83:0/4083793844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e40155050 con 0x7f5e40155c10 2024-09-21T00:14:33.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.809+0000 7f5e3ea00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e401627c0 0x7f5e40154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:33.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.809+0000 7f5e3f400640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e40155c10 0x7f5e401fca20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5e400d0b60 tx=0x7f5e3800ccd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.810+0000 7f5e36a00640 1 -- 172.21.15.83:0/4083793844 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38017070 con 0x7f5e40155c10 2024-09-21T00:14:33.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.810+0000 7f5e36a00640 1 -- 172.21.15.83:0/4083793844 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e3800ab10 con 0x7f5e40155c10 2024-09-21T00:14:33.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.810+0000 7f5e36a00640 1 -- 172.21.15.83:0/4083793844 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00c260 con 0x7f5e40155c10 2024-09-21T00:14:33.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.810+0000 7f5e3fe00640 1 -- 172.21.15.83:0/4083793844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e40156020 con 0x7f5e40155c10 2024-09-21T00:14:33.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.811+0000 7f5e3fe00640 1 -- 172.21.15.83:0/4083793844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e400b4240 con 0x7f5e40155c10 2024-09-21T00:14:33.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.812+0000 7fa415000640 1 -- 172.21.15.83:0/2141688879 shutdown_connections 2024-09-21T00:14:33.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.812+0000 7fa415000640 1 --2- 172.21.15.83:0/2141688879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa41006e500 0x7fa4100cef00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.812+0000 7fa415000640 1 --2- 172.21.15.83:0/2141688879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa410156a50 0x7fa410074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.812+0000 7fa415000640 1 -- 172.21.15.83:0/2141688879 >> 172.21.15.83:0/2141688879 conn(0x7fa4100b1b90 msgr2=0x7fa4100b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:33.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.812+0000 7fa415000640 1 -- 172.21.15.83:0/2141688879 shutdown_connections 2024-09-21T00:14:33.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.813+0000 7f5e3fe00640 1 -- 172.21.15.83:0/4083793844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4015e3d0 con 0x7f5e40155c10 2024-09-21T00:14:33.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.813+0000 7fa415000640 1 -- 172.21.15.83:0/2141688879 wait complete. 2024-09-21T00:14:33.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.817+0000 7f5e36a00640 1 -- 172.21.15.83:0/4083793844 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e38012400 con 0x7f5e40155c10 2024-09-21T00:14:33.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.817+0000 7fa415000640 1 Processor -- start 2024-09-21T00:14:33.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.818+0000 7f5e36a00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5e20078b90 0x7f5e2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.818+0000 7f5e36a00640 1 -- 172.21.15.83:0/4083793844 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5e3809a670 con 0x7f5e40155c10 2024-09-21T00:14:33.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.817+0000 7fa415000640 1 -- start start 2024-09-21T00:14:33.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.819+0000 7f5e3ea00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5e20078b90 0x7f5e2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.820+0000 7fa415000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa410074b60 0x7fa410159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.820+0000 7fa415000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa410156a50 0x7fa4101fa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.820+0000 7fa415000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4101fa7f0 0x7fa4101fc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.820+0000 7fa415000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa4100cf7d0 con 0x7fa410156a50 2024-09-21T00:14:33.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.820+0000 7f5e3ea00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5e20078b90 0x7f5e2007b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c003670 tx=0x7f5e2c006990 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.820+0000 7fa415000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa4100cf650 con 0x7fa410074b60 2024-09-21T00:14:33.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.820+0000 7fa415000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa4100cf950 con 0x7fa4101fa7f0 2024-09-21T00:14:33.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.820+0000 7fa40de00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa410074b60 0x7fa410159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.821+0000 7fa40de00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa410074b60 0x7fa410159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:41876/0 (socket says 172.21.15.83:41876) 2024-09-21T00:14:33.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.821+0000 7fa40de00640 1 -- 172.21.15.83:0/4133224414 learned_addr learned my addr 172.21.15.83:0/4133224414 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:33.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.821+0000 7fa40d400640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa410156a50 0x7fa4101fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.821+0000 7fa40e800640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4101fa7f0 0x7fa4101fc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.822+0000 7fa40d400640 1 -- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4101fa7f0 msgr2=0x7fa4101fc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.822+0000 7fa40d400640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4101fa7f0 0x7fa4101fc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.822+0000 7fa40d400640 1 -- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa410074b60 msgr2=0x7fa410159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.822+0000 7fa40d400640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa410074b60 0x7fa410159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:33.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.822+0000 7fa40d400640 1 -- 172.21.15.83:0/4133224414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa410073c10 con 0x7fa410156a50 2024-09-21T00:14:33.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.823+0000 7fa40d400640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa410156a50 0x7fa4101fa2b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800c390 tx=0x7fa3f800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.823+0000 7fa406000640 1 -- 172.21.15.83:0/4133224414 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8011790 con 0x7fa410156a50 2024-09-21T00:14:33.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.823+0000 7fa406000640 1 -- 172.21.15.83:0/4133224414 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3f8017070 con 0x7fa410156a50 2024-09-21T00:14:33.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.823+0000 7f5e36a00640 1 -- 172.21.15.83:0/4083793844 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5e40156020 con 0x7f5e40155c10 2024-09-21T00:14:33.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.825+0000 7fa406000640 1 -- 172.21.15.83:0/4133224414 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8011cc0 con 0x7fa410156a50 2024-09-21T00:14:33.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.825+0000 7fa415000640 1 -- 172.21.15.83:0/4133224414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4100b4620 con 0x7fa410156a50 2024-09-21T00:14:33.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.825+0000 7fa415000640 1 -- 172.21.15.83:0/4133224414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4100b4be0 con 0x7fa410156a50 2024-09-21T00:14:33.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.828+0000 7fa415000640 1 -- 172.21.15.83:0/4133224414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4100b4390 con 0x7fa410156a50 2024-09-21T00:14:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.834+0000 7fa406000640 1 -- 172.21.15.83:0/4133224414 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3f801c460 con 0x7fa410156a50 2024-09-21T00:14:33.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.836+0000 7fa406000640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa3ec078be0 0x7fa3ec07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:33.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.836+0000 7fa406000640 1 -- 172.21.15.83:0/4133224414 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa3f8011e60 con 0x7fa410156a50 2024-09-21T00:14:33.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.836+0000 7fa40de00640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa3ec078be0 0x7fa3ec07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:33.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.837+0000 7fa40de00640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa3ec078be0 0x7fa3ec07b0f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa4080058c0 tx=0x7fa40800b410 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:33.840+0000 7fa406000640 1 -- 172.21.15.83:0/4133224414 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa3f80638e0 con 0x7fa410156a50 2024-09-21T00:14:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.042+0000 7f5c0f400640 1 -- 172.21.15.83:0/1590637385 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5bf8005850 con 0x7f5c1c052360 2024-09-21T00:14:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.043+0000 7f5c1a000640 1 -- 172.21.15.83:0/1590637385 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5c240e2860 con 0x7f5c1c052360 2024-09-21T00:14:34.045 INFO:teuthology.orchestra.run.smithi083.stdout:64424509450 2024-09-21T00:14:34.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.047+0000 7f5c0f400640 1 -- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5c04078b90 msgr2=0x7f5c0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.048+0000 7f5c0f400640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5c04078b90 0x7f5c0407b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5c140040b0 tx=0x7f5c140039a0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.048+0000 7f5c0f400640 1 -- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1c052360 msgr2=0x7f5c1c0dbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.048+0000 7f5c0f400640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1c052360 0x7f5c1c0dbb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5c2407acc0 tx=0x7f5c2406a0e0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.048+0000 7f5c0f400640 1 -- 172.21.15.83:0/1590637385 shutdown_connections 2024-09-21T00:14:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.048+0000 7f5c0f400640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5c04078b90 0x7f5c0407b0a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.049+0000 7f5c0f400640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c1c0e71d0 0x7f5c1c0329b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.049+0000 7f5c0f400640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1c052360 0x7f5c1c0dbb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.049+0000 7f5c0f400640 1 --2- 172.21.15.83:0/1590637385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c1c0064f0 0x7f5c1c01e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.049+0000 7f5c0f400640 1 -- 172.21.15.83:0/1590637385 >> 172.21.15.83:0/1590637385 conn(0x7f5c1c01d9a0 msgr2=0x7f5c1c0e69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:34.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.049+0000 7f5c0f400640 1 -- 172.21.15.83:0/1590637385 shutdown_connections 2024-09-21T00:14:34.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.050+0000 7f5c0f400640 1 -- 172.21.15.83:0/1590637385 wait complete. 2024-09-21T00:14:34.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2024-09-21T00:14:34.091 DEBUG:teuthology.parallel:result is None 2024-09-21T00:14:34.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.108+0000 7f1efaa00640 1 -- 172.21.15.83:0/2806200438 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1eec17a520 con 0x7f1edc005160 2024-09-21T00:14:34.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.109+0000 7f1ee3e00640 1 -- 172.21.15.83:0/2806200438 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1eec17a520 con 0x7f1edc005160 2024-09-21T00:14:34.110 INFO:teuthology.orchestra.run.smithi083.stdout:64424509448 2024-09-21T00:14:34.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.111+0000 7f1efaa00640 1 -- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1ed8078be0 msgr2=0x7f1ed807b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.111+0000 7f1efaa00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1ed8078be0 0x7f1ed807b0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0e70f0 tx=0x7f1ee4006ba0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.111+0000 7f1efaa00640 1 -- 172.21.15.83:0/2806200438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1edc005160 msgr2=0x7f1eec17e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.111+0000 7f1efaa00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1edc005160 0x7f1eec17e0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800fa90 tx=0x7f1ee800ff50 comp rx=0 tx=0).stop 2024-09-21T00:14:34.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.112+0000 7f1efaa00640 1 -- 172.21.15.83:0/2806200438 shutdown_connections 2024-09-21T00:14:34.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.112+0000 7f1efaa00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1ed8078be0 0x7f1ed807b0f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.112+0000 7f1efaa00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec0e07d0 0x7f1eec0e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.112+0000 7f1efaa00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eec04ddc0 0x7f1eec04e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.112+0000 7f1efaa00640 1 --2- 172.21.15.83:0/2806200438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1edc005160 0x7f1eec17e0d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.112+0000 7f1efaa00640 1 -- 172.21.15.83:0/2806200438 >> 172.21.15.83:0/2806200438 conn(0x7f1eec03a5e0 msgr2=0x7f1eec037bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.112+0000 7f1efaa00640 1 -- 172.21.15.83:0/2806200438 shutdown_connections 2024-09-21T00:14:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.112+0000 7f1efaa00640 1 -- 172.21.15.83:0/2806200438 wait complete. 2024-09-21T00:14:34.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.118+0000 7f66c1a00640 1 -- 172.21.15.83:0/3679879746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6698005850 con 0x7f66b40e7850 2024-09-21T00:14:34.120 INFO:teuthology.orchestra.run.smithi083.stdout:64424509450 2024-09-21T00:14:34.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.119+0000 7f66afe00640 1 -- 172.21.15.83:0/3679879746 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f66bc08f030 con 0x7f66b40e7850 2024-09-21T00:14:34.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.123+0000 7f66c1a00640 1 -- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f669c078dc0 msgr2=0x7f669c07b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.123+0000 7f66c1a00640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f669c078dc0 0x7f669c07b2d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f66b0034000 tx=0x7f66b0004730 comp rx=0 tx=0).stop 2024-09-21T00:14:34.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.124+0000 7f66c1a00640 1 -- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40e7850 msgr2=0x7f66b404fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.124+0000 7f66c1a00640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40e7850 0x7f66b404fb40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f66bc06c0e0 tx=0x7f66bc06a0e0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.124+0000 7f66c1a00640 1 -- 172.21.15.83:0/3679879746 shutdown_connections 2024-09-21T00:14:34.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.124+0000 7f66c1a00640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f669c078dc0 0x7f669c07b2d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.124+0000 7f66c1a00640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b4050080 0x7f66b400a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.124+0000 7f66c1a00640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40e7850 0x7f66b404fb40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.124+0000 7f66c1a00640 1 --2- 172.21.15.83:0/3679879746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b40375b0 0x7f66b40d9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.124+0000 7f66c1a00640 1 -- 172.21.15.83:0/3679879746 >> 172.21.15.83:0/3679879746 conn(0x7f66b400e240 msgr2=0x7f66b40e0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:34.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.125+0000 7f66c1a00640 1 -- 172.21.15.83:0/3679879746 shutdown_connections 2024-09-21T00:14:34.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.125+0000 7f66c1a00640 1 -- 172.21.15.83:0/3679879746 wait complete. 2024-09-21T00:14:34.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-09-21T00:14:34.137 DEBUG:teuthology.parallel:result is None 2024-09-21T00:14:34.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.146+0000 7f3fc0000640 1 -- 172.21.15.83:0/2737687796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3fb80b95a0 con 0x7f3fb806cde0 2024-09-21T00:14:34.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.147+0000 7f3fb5600640 1 -- 172.21.15.83:0/2737687796 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3fac063c30 con 0x7f3fb806cde0 2024-09-21T00:14:34.148 INFO:teuthology.orchestra.run.smithi083.stdout:64424509449 2024-09-21T00:14:34.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 -- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3f98078d90 msgr2=0x7f3f9807b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3f98078d90 0x7f3f9807b2a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80cdd30 tx=0x7f3fa4008040 comp rx=0 tx=0).stop 2024-09-21T00:14:34.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 -- 172.21.15.83:0/2737687796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fb806cde0 msgr2=0x7f3fb815cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fb806cde0 0x7f3fb815cb40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00e790 tx=0x7f3fac00ec50 comp rx=0 tx=0).stop 2024-09-21T00:14:34.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 -- 172.21.15.83:0/2737687796 shutdown_connections 2024-09-21T00:14:34.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3f98078d90 0x7f3f9807b2a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fb815e740 0x7f3fb81e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fb80d2410 0x7f3fb81e8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 --2- 172.21.15.83:0/2737687796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fb806cde0 0x7f3fb815cb40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 -- 172.21.15.83:0/2737687796 >> 172.21.15.83:0/2737687796 conn(0x7f3fb80d4290 msgr2=0x7f3fb80c9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:34.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 -- 172.21.15.83:0/2737687796 shutdown_connections 2024-09-21T00:14:34.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.151+0000 7f3fc0000640 1 -- 172.21.15.83:0/2737687796 wait complete. 2024-09-21T00:14:34.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2024-09-21T00:14:34.166 DEBUG:teuthology.parallel:result is None 2024-09-21T00:14:34.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.182+0000 7ff900e00640 1 -- 172.21.15.83:0/1569759903 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff8fc0d4840 con 0x7ff8fc0cef00 2024-09-21T00:14:34.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.182+0000 7ff8f3400640 1 -- 172.21.15.83:0/1569759903 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8fc1f98d0 con 0x7ff8fc0cef00 2024-09-21T00:14:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:55834574858 2024-09-21T00:14:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.185+0000 7ff900e00640 1 -- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8dc078c60 msgr2=0x7ff8dc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.185+0000 7ff900e00640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8dc078c60 0x7ff8dc07b170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0cc710 tx=0x7ff8e80079b0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.185+0000 7ff900e00640 1 -- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0cef00 msgr2=0x7ff8fc1f9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.185+0000 7ff900e00640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0cef00 0x7ff8fc1f9390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec000c00 tx=0x7ff8ec003b90 comp rx=0 tx=0).stop 2024-09-21T00:14:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.186+0000 7ff900e00640 1 -- 172.21.15.83:0/1569759903 shutdown_connections 2024-09-21T00:14:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.186+0000 7ff900e00640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8dc078c60 0x7ff8dc07b170 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.186+0000 7ff900e00640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8fc15f6d0 0x7ff8fc0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.186+0000 7ff900e00640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8fc0d2290 0x7ff8fc1494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.186+0000 7ff900e00640 1 --2- 172.21.15.83:0/1569759903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8fc0cef00 0x7ff8fc1f9390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.186+0000 7ff900e00640 1 -- 172.21.15.83:0/1569759903 >> 172.21.15.83:0/1569759903 conn(0x7ff8fc0d41e0 msgr2=0x7ff8fc0b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.186+0000 7ff900e00640 1 -- 172.21.15.83:0/1569759903 shutdown_connections 2024-09-21T00:14:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.186+0000 7ff900e00640 1 -- 172.21.15.83:0/1569759903 wait complete. 2024-09-21T00:14:34.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-21T00:14:34.188 DEBUG:teuthology.parallel:result is None 2024-09-21T00:14:34.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.202+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8e1403e480 con 0x7f8e14054190 2024-09-21T00:14:34.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.203+0000 7f8e0fe00640 1 -- 172.21.15.83:0/1627673821 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e080633f0 con 0x7f8e14054190 2024-09-21T00:14:34.204 INFO:teuthology.orchestra.run.smithi083.stdout:64424509449 2024-09-21T00:14:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8dfc078c60 msgr2=0x7f8dfc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8dfc078c60 0x7f8dfc07b170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8e10032000 tx=0x7f8e10004730 comp rx=0 tx=0).stop 2024-09-21T00:14:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14054190 msgr2=0x7f8e140d5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14054190 0x7f8e140d5ee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009fd0 tx=0x7f8e0800ec20 comp rx=0 tx=0).stop 2024-09-21T00:14:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 shutdown_connections 2024-09-21T00:14:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8dfc078c60 0x7f8dfc07b170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e140e3200 0x7f8e1402fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14054190 0x7f8e140d5ee0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 --2- 172.21.15.83:0/1627673821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e14053690 0x7f8e140e3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 >> 172.21.15.83:0/1627673821 conn(0x7f8e1403a680 msgr2=0x7f8e14057f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:34.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.205+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 shutdown_connections 2024-09-21T00:14:34.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.206+0000 7f8e21400640 1 -- 172.21.15.83:0/1627673821 wait complete. 2024-09-21T00:14:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.209+0000 7f5e3fe00640 1 -- 172.21.15.83:0/4083793844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5e4015c7f0 con 0x7f5e40155c10 2024-09-21T00:14:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.210+0000 7f5e36a00640 1 -- 172.21.15.83:0/4083793844 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e38062110 con 0x7f5e40155c10 2024-09-21T00:14:34.211 INFO:teuthology.orchestra.run.smithi083.stdout:64424509451 2024-09-21T00:14:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.212+0000 7f5e3fe00640 1 -- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5e20078b90 msgr2=0x7f5e2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.212+0000 7f5e3fe00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5e20078b90 0x7f5e2007b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c003670 tx=0x7f5e2c006990 comp rx=0 tx=0).stop 2024-09-21T00:14:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.212+0000 7f5e3fe00640 1 -- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e40155c10 msgr2=0x7f5e401fca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.212+0000 7f5e3fe00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e40155c10 0x7f5e401fca20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5e400d0b60 tx=0x7f5e3800ccd0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.212+0000 7f5e3fe00640 1 -- 172.21.15.83:0/4083793844 shutdown_connections 2024-09-21T00:14:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.212+0000 7f5e3fe00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5e20078b90 0x7f5e2007b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.212+0000 7f5e3fe00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e40155c10 0x7f5e401fca20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.212+0000 7f5e3fe00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e401f9eb0 0x7f5e401556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.212+0000 7f5e3fe00640 1 --2- 172.21.15.83:0/4083793844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e401627c0 0x7f5e40154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.213+0000 7f5e3fe00640 1 -- 172.21.15.83:0/4083793844 >> 172.21.15.83:0/4083793844 conn(0x7f5e400d41e0 msgr2=0x7f5e4015cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.213+0000 7f5e3fe00640 1 -- 172.21.15.83:0/4083793844 shutdown_connections 2024-09-21T00:14:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.213+0000 7f5e3fe00640 1 -- 172.21.15.83:0/4083793844 wait complete. 2024-09-21T00:14:34.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-09-21T00:14:34.222 DEBUG:teuthology.parallel:result is None 2024-09-21T00:14:34.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-09-21T00:14:34.233 DEBUG:teuthology.parallel:result is None 2024-09-21T00:14:34.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.7 2024-09-21T00:14:34.237 DEBUG:teuthology.parallel:result is None 2024-09-21T00:14:34.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.245+0000 7fa415000640 1 -- 172.21.15.83:0/4133224414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa4100cef00 con 0x7fa410156a50 2024-09-21T00:14:34.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.246+0000 7fa406000640 1 -- 172.21.15.83:0/4133224414 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa3f8067cc0 con 0x7fa410156a50 2024-09-21T00:14:34.247 INFO:teuthology.orchestra.run.smithi083.stdout:64424509449 2024-09-21T00:14:34.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 -- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa3ec078be0 msgr2=0x7fa3ec07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa3ec078be0 0x7fa3ec07b0f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa4080058c0 tx=0x7fa40800b410 comp rx=0 tx=0).stop 2024-09-21T00:14:34.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 -- 172.21.15.83:0/4133224414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa410156a50 msgr2=0x7fa4101fa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa410156a50 0x7fa4101fa2b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800c390 tx=0x7fa3f800c850 comp rx=0 tx=0).stop 2024-09-21T00:14:34.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 -- 172.21.15.83:0/4133224414 shutdown_connections 2024-09-21T00:14:34.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa3ec078be0 0x7fa3ec07b0f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4101fa7f0 0x7fa4101fc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa410156a50 0x7fa4101fa2b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 --2- 172.21.15.83:0/4133224414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa410074b60 0x7fa410159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 -- 172.21.15.83:0/4133224414 >> 172.21.15.83:0/4133224414 conn(0x7fa4100b1b90 msgr2=0x7fa4100cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:34.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 -- 172.21.15.83:0/4133224414 shutdown_connections 2024-09-21T00:14:34.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.248+0000 7fa415000640 1 -- 172.21.15.83:0/4133224414 wait complete. 2024-09-21T00:14:34.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-09-21T00:14:34.270 DEBUG:teuthology.parallel:result is None 2024-09-21T00:14:34.270 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T00:14:34.270 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:14:34.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.528+0000 7fc279800640 1 -- 172.21.15.83:0/1175361159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2740b6250 msgr2=0x7fc2740b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.528+0000 7fc279800640 1 --2- 172.21.15.83:0/1175361159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2740b6250 0x7fc2740b6660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc274074a40 tx=0x7fc26c02aac0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.529+0000 7fc279800640 1 -- 172.21.15.83:0/1175361159 shutdown_connections 2024-09-21T00:14:34.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.529+0000 7fc279800640 1 --2- 172.21.15.83:0/1175361159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2740b6250 0x7fc2740b6660 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.529+0000 7fc279800640 1 --2- 172.21.15.83:0/1175361159 >> v2:172.21.15.142:3300/0 conn(0x7fc27415cb10 0x7fc27415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.529+0000 7fc279800640 1 -- 172.21.15.83:0/1175361159 >> 172.21.15.83:0/1175361159 conn(0x7fc2740d2350 msgr2=0x7fc2740d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:34.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.529+0000 7fc279800640 1 -- 172.21.15.83:0/1175361159 shutdown_connections 2024-09-21T00:14:34.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.529+0000 7fc279800640 1 -- 172.21.15.83:0/1175361159 wait complete. 2024-09-21T00:14:34.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.531+0000 7fc279800640 1 Processor -- start 2024-09-21T00:14:34.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.531+0000 7fc279800640 1 -- start start 2024-09-21T00:14:34.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.532+0000 7fc279800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2740b6250 0x7fc274158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:34.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.532+0000 7fc279800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2740d12e0 0x7fc2740cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:34.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.532+0000 7fc279800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc27415cb10 0x7fc274156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:34.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.532+0000 7fc279800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740b6f30 con 0x7fc27415cb10 2024-09-21T00:14:34.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.532+0000 7fc279800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740b6db0 con 0x7fc2740d12e0 2024-09-21T00:14:34.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.532+0000 7fc279800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc2740b70b0 con 0x7fc2740b6250 2024-09-21T00:14:34.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc273400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc27415cb10 0x7fc274156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:34.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc273400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc27415cb10 0x7fc274156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37228/0 (socket says 172.21.15.83:37228) 2024-09-21T00:14:34.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc273400640 1 -- 172.21.15.83:0/1568762659 learned_addr learned my addr 172.21.15.83:0/1568762659 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:34.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc272000640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2740d12e0 0x7fc2740cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:34.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc272a00640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2740b6250 0x7fc274158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:34.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc273400640 1 -- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2740b6250 msgr2=0x7fc274158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc273400640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2740b6250 0x7fc274158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc273400640 1 -- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2740d12e0 msgr2=0x7fc2740cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc273400640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2740d12e0 0x7fc2740cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc273400640 1 -- 172.21.15.83:0/1568762659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2741500f0 con 0x7fc27415cb10 2024-09-21T00:14:34.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.533+0000 7fc273400640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc27415cb10 0x7fc274156270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009d60 tx=0x7fc26c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:34.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.534+0000 7fc26aa00640 1 -- 172.21.15.83:0/1568762659 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c044070 con 0x7fc27415cb10 2024-09-21T00:14:34.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.534+0000 7fc26aa00640 1 -- 172.21.15.83:0/1568762659 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc26c004250 con 0x7fc27415cb10 2024-09-21T00:14:34.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.534+0000 7fc26aa00640 1 -- 172.21.15.83:0/1568762659 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c004680 con 0x7fc27415cb10 2024-09-21T00:14:34.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.534+0000 7fc279800640 1 -- 172.21.15.83:0/1568762659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2740c7530 con 0x7fc27415cb10 2024-09-21T00:14:34.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.534+0000 7fc279800640 1 -- 172.21.15.83:0/1568762659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2741599f0 con 0x7fc27415cb10 2024-09-21T00:14:34.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.535+0000 7fc279800640 1 -- 172.21.15.83:0/1568762659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2740b6660 con 0x7fc27415cb10 2024-09-21T00:14:34.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.536+0000 7fc26aa00640 1 -- 172.21.15.83:0/1568762659 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc26c036400 con 0x7fc27415cb10 2024-09-21T00:14:34.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.537+0000 7fc26aa00640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc254078b90 0x7fc25407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:34.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.538+0000 7fc26aa00640 1 -- 172.21.15.83:0/1568762659 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc26c0bb6f0 con 0x7fc27415cb10 2024-09-21T00:14:34.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.538+0000 7fc272a00640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc254078b90 0x7fc25407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:34.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.539+0000 7fc272a00640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc254078b90 0x7fc25407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc264005fd0 tx=0x7fc26400b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:34.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.542+0000 7fc26aa00640 1 -- 172.21.15.83:0/1568762659 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc26c032030 con 0x7fc27415cb10 2024-09-21T00:14:34.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.725+0000 7fc279800640 1 -- 172.21.15.83:0/1568762659 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2740b56b0 con 0x7fc254078b90 2024-09-21T00:14:34.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.732+0000 7fc26aa00640 1 -- 172.21.15.83:0/1568762659 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7fc2740b56b0 con 0x7fc254078b90 2024-09-21T00:14:34.737 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:34.738 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:14:34.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.736+0000 7fc279800640 1 -- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc254078b90 msgr2=0x7fc25407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.736+0000 7fc279800640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc254078b90 0x7fc25407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc264005fd0 tx=0x7fc26400b2e0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.736+0000 7fc279800640 1 -- 172.21.15.83:0/1568762659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc27415cb10 msgr2=0x7fc274156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:34.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.736+0000 7fc279800640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc27415cb10 0x7fc274156270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009d60 tx=0x7fc26c003f10 comp rx=0 tx=0).stop 2024-09-21T00:14:34.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.736+0000 7fc279800640 1 -- 172.21.15.83:0/1568762659 shutdown_connections 2024-09-21T00:14:34.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.736+0000 7fc279800640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc254078b90 0x7fc25407b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.736+0000 7fc279800640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc27415cb10 0x7fc274156270 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.736+0000 7fc279800640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2740d12e0 0x7fc2740cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.736+0000 7fc279800640 1 --2- 172.21.15.83:0/1568762659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2740b6250 0x7fc274158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:34.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.737+0000 7fc279800640 1 -- 172.21.15.83:0/1568762659 >> 172.21.15.83:0/1568762659 conn(0x7fc2740d2350 msgr2=0x7fc274070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:34.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.737+0000 7fc279800640 1 -- 172.21.15.83:0/1568762659 shutdown_connections 2024-09-21T00:14:34.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:34.737+0000 7fc279800640 1 -- 172.21.15.83:0/1568762659 wait complete. 2024-09-21T00:14:34.759 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-21T00:14:32.855451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219652,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755068,"statfs":{"total":773094113280,"available":772869189632,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003596"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979446+0000","last_change":"2024-09-21T00:14:08.955433+0000","last_active":"2024-09-21T00:14:14.979446+0000","last_peered":"2024-09-21T00:14:14.979446+0000","last_clean":"2024-09-21T00:14:14.979446+0000","last_became_active":"2024-09-21T00:14:08.955066+0000","last_became_peered":"2024-09-21T00:14:08.955066+0000","last_unstale":"2024-09-21T00:14:14.979446+0000","last_undegraded":"2024-09-21T00:14:14.979446+0000","last_fullsized":"2024-09-21T00:14:14.979446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:28.367381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967544+0000","last_change":"2024-09-21T00:14:09.966683+0000","last_active":"2024-09-21T00:14:15.967544+0000","last_peered":"2024-09-21T00:14:15.967544+0000","last_clean":"2024-09-21T00:14:15.967544+0000","last_became_active":"2024-09-21T00:14:09.966351+0000","last_became_peered":"2024-09-21T00:14:09.966351+0000","last_unstale":"2024-09-21T00:14:15.967544+0000","last_undegraded":"2024-09-21T00:14:15.967544+0000","last_fullsized":"2024-09-21T00:14:15.967544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:51.673086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977041+0000","last_change":"2024-09-21T00:14:14.002579+0000","last_active":"2024-09-21T00:14:14.977041+0000","last_peered":"2024-09-21T00:14:14.977041+0000","last_clean":"2024-09-21T00:14:14.977041+0000","last_became_active":"2024-09-21T00:14:13.998346+0000","last_became_peered":"2024-09-21T00:14:13.998346+0000","last_unstale":"2024-09-21T00:14:14.977041+0000","last_undegraded":"2024-09-21T00:14:14.977041+0000","last_fullsized":"2024-09-21T00:14:14.977041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:05.886343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967750+0000","last_change":"2024-09-21T00:14:08.969417+0000","last_active":"2024-09-21T00:14:15.967750+0000","last_peered":"2024-09-21T00:14:15.967750+0000","last_clean":"2024-09-21T00:14:15.967750+0000","last_became_active":"2024-09-21T00:14:08.969077+0000","last_became_peered":"2024-09-21T00:14:08.969077+0000","last_unstale":"2024-09-21T00:14:15.967750+0000","last_undegraded":"2024-09-21T00:14:15.967750+0000","last_fullsized":"2024-09-21T00:14:15.967750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:01.181700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967587+0000","last_change":"2024-09-21T00:14:09.975248+0000","last_active":"2024-09-21T00:14:15.967587+0000","last_peered":"2024-09-21T00:14:15.967587+0000","last_clean":"2024-09-21T00:14:15.967587+0000","last_became_active":"2024-09-21T00:14:09.974959+0000","last_became_peered":"2024-09-21T00:14:09.974959+0000","last_unstale":"2024-09-21T00:14:15.967587+0000","last_undegraded":"2024-09-21T00:14:15.967587+0000","last_fullsized":"2024-09-21T00:14:15.967587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:43.775786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973627+0000","last_change":"2024-09-21T00:14:14.001939+0000","last_active":"2024-09-21T00:14:14.973627+0000","last_peered":"2024-09-21T00:14:14.973627+0000","last_clean":"2024-09-21T00:14:14.973627+0000","last_became_active":"2024-09-21T00:14:14.001348+0000","last_became_peered":"2024-09-21T00:14:14.001348+0000","last_unstale":"2024-09-21T00:14:14.973627+0000","last_undegraded":"2024-09-21T00:14:14.973627+0000","last_fullsized":"2024-09-21T00:14:14.973627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:02.627970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123227+0000","last_change":"2024-09-21T00:14:08.964352+0000","last_active":"2024-09-21T00:14:16.123227+0000","last_peered":"2024-09-21T00:14:16.123227+0000","last_clean":"2024-09-21T00:14:16.123227+0000","last_became_active":"2024-09-21T00:14:08.958414+0000","last_became_peered":"2024-09-21T00:14:08.958414+0000","last_unstale":"2024-09-21T00:14:16.123227+0000","last_undegraded":"2024-09-21T00:14:16.123227+0000","last_fullsized":"2024-09-21T00:14:16.123227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:51.700187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123442+0000","last_change":"2024-09-21T00:14:09.962666+0000","last_active":"2024-09-21T00:14:16.123442+0000","last_peered":"2024-09-21T00:14:16.123442+0000","last_clean":"2024-09-21T00:14:16.123442+0000","last_became_active":"2024-09-21T00:14:09.961909+0000","last_became_peered":"2024-09-21T00:14:09.961909+0000","last_unstale":"2024-09-21T00:14:16.123442+0000","last_undegraded":"2024-09-21T00:14:16.123442+0000","last_fullsized":"2024-09-21T00:14:16.123442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:13.058730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974353+0000","last_change":"2024-09-21T00:14:14.009588+0000","last_active":"2024-09-21T00:14:14.974353+0000","last_peered":"2024-09-21T00:14:14.974353+0000","last_clean":"2024-09-21T00:14:14.974353+0000","last_became_active":"2024-09-21T00:14:14.008994+0000","last_became_peered":"2024-09-21T00:14:14.008994+0000","last_unstale":"2024-09-21T00:14:14.974353+0000","last_undegraded":"2024-09-21T00:14:14.974353+0000","last_fullsized":"2024-09-21T00:14:14.974353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:50.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122959+0000","last_change":"2024-09-21T00:14:08.962061+0000","last_active":"2024-09-21T00:14:16.122959+0000","last_peered":"2024-09-21T00:14:16.122959+0000","last_clean":"2024-09-21T00:14:16.122959+0000","last_became_active":"2024-09-21T00:14:08.961712+0000","last_became_peered":"2024-09-21T00:14:08.961712+0000","last_unstale":"2024-09-21T00:14:16.122959+0000","last_undegraded":"2024-09-21T00:14:16.122959+0000","last_fullsized":"2024-09-21T00:14:16.122959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:05:03.896547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500923+0000","last_change":"2024-09-21T00:14:09.957015+0000","last_active":"2024-09-21T00:14:15.500923+0000","last_peered":"2024-09-21T00:14:15.500923+0000","last_clean":"2024-09-21T00:14:15.500923+0000","last_became_active":"2024-09-21T00:14:09.956388+0000","last_became_peered":"2024-09-21T00:14:09.956388+0000","last_unstale":"2024-09-21T00:14:15.500923+0000","last_undegraded":"2024-09-21T00:14:15.500923+0000","last_fullsized":"2024-09-21T00:14:15.500923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:26.738282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973647+0000","last_change":"2024-09-21T00:14:14.004999+0000","last_active":"2024-09-21T00:14:14.973647+0000","last_peered":"2024-09-21T00:14:14.973647+0000","last_clean":"2024-09-21T00:14:14.973647+0000","last_became_active":"2024-09-21T00:14:14.003986+0000","last_became_peered":"2024-09-21T00:14:14.003986+0000","last_unstale":"2024-09-21T00:14:14.973647+0000","last_undegraded":"2024-09-21T00:14:14.973647+0000","last_fullsized":"2024-09-21T00:14:14.973647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:44.919521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500238+0000","last_change":"2024-09-21T00:14:09.955745+0000","last_active":"2024-09-21T00:14:15.500238+0000","last_peered":"2024-09-21T00:14:15.500238+0000","last_clean":"2024-09-21T00:14:15.500238+0000","last_became_active":"2024-09-21T00:14:09.954866+0000","last_became_peered":"2024-09-21T00:14:09.954866+0000","last_unstale":"2024-09-21T00:14:15.500238+0000","last_undegraded":"2024-09-21T00:14:15.500238+0000","last_fullsized":"2024-09-21T00:14:15.500238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:55.173826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500524+0000","last_change":"2024-09-21T00:14:08.962655+0000","last_active":"2024-09-21T00:14:15.500524+0000","last_peered":"2024-09-21T00:14:15.500524+0000","last_clean":"2024-09-21T00:14:15.500524+0000","last_became_active":"2024-09-21T00:14:08.962352+0000","last_became_peered":"2024-09-21T00:14:08.962352+0000","last_unstale":"2024-09-21T00:14:15.500524+0000","last_undegraded":"2024-09-21T00:14:15.500524+0000","last_fullsized":"2024-09-21T00:14:15.500524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:27.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500879+0000","last_change":"2024-09-21T00:14:14.006261+0000","last_active":"2024-09-21T00:14:15.500879+0000","last_peered":"2024-09-21T00:14:15.500879+0000","last_clean":"2024-09-21T00:14:15.500879+0000","last_became_active":"2024-09-21T00:14:14.003285+0000","last_became_peered":"2024-09-21T00:14:14.003285+0000","last_unstale":"2024-09-21T00:14:15.500879+0000","last_undegraded":"2024-09-21T00:14:15.500879+0000","last_fullsized":"2024-09-21T00:14:15.500879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:26.610299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977966+0000","last_change":"2024-09-21T00:14:09.955950+0000","last_active":"2024-09-21T00:14:14.977966+0000","last_peered":"2024-09-21T00:14:14.977966+0000","last_clean":"2024-09-21T00:14:14.977966+0000","last_became_active":"2024-09-21T00:14:09.953875+0000","last_became_peered":"2024-09-21T00:14:09.953875+0000","last_unstale":"2024-09-21T00:14:14.977966+0000","last_undegraded":"2024-09-21T00:14:14.977966+0000","last_fullsized":"2024-09-21T00:14:14.977966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123258+0000","last_change":"2024-09-21T00:14:08.969348+0000","last_active":"2024-09-21T00:14:16.123258+0000","last_peered":"2024-09-21T00:14:16.123258+0000","last_clean":"2024-09-21T00:14:16.123258+0000","last_became_active":"2024-09-21T00:14:08.969018+0000","last_became_peered":"2024-09-21T00:14:08.969018+0000","last_unstale":"2024-09-21T00:14:16.123258+0000","last_undegraded":"2024-09-21T00:14:16.123258+0000","last_fullsized":"2024-09-21T00:14:16.123258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:28.286333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122670+0000","last_change":"2024-09-21T00:14:13.994464+0000","last_active":"2024-09-21T00:14:16.122670+0000","last_peered":"2024-09-21T00:14:16.122670+0000","last_clean":"2024-09-21T00:14:16.122670+0000","last_became_active":"2024-09-21T00:14:13.993997+0000","last_became_peered":"2024-09-21T00:14:13.993997+0000","last_unstale":"2024-09-21T00:14:16.122670+0000","last_undegraded":"2024-09-21T00:14:16.122670+0000","last_fullsized":"2024-09-21T00:14:16.122670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:59.204344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977267+0000","last_change":"2024-09-21T00:14:09.944109+0000","last_active":"2024-09-21T00:14:14.977267+0000","last_peered":"2024-09-21T00:14:14.977267+0000","last_clean":"2024-09-21T00:14:14.977267+0000","last_became_active":"2024-09-21T00:14:09.943696+0000","last_became_peered":"2024-09-21T00:14:09.943696+0000","last_unstale":"2024-09-21T00:14:14.977267+0000","last_undegraded":"2024-09-21T00:14:14.977267+0000","last_fullsized":"2024-09-21T00:14:14.977267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:11.037361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978186+0000","last_change":"2024-09-21T00:14:08.952283+0000","last_active":"2024-09-21T00:14:14.978186+0000","last_peered":"2024-09-21T00:14:14.978186+0000","last_clean":"2024-09-21T00:14:14.978186+0000","last_became_active":"2024-09-21T00:14:08.951509+0000","last_became_peered":"2024-09-21T00:14:08.951509+0000","last_unstale":"2024-09-21T00:14:14.978186+0000","last_undegraded":"2024-09-21T00:14:14.978186+0000","last_fullsized":"2024-09-21T00:14:14.978186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:05.121425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979265+0000","last_change":"2024-09-21T00:14:14.009693+0000","last_active":"2024-09-21T00:14:14.979265+0000","last_peered":"2024-09-21T00:14:14.979265+0000","last_clean":"2024-09-21T00:14:14.979265+0000","last_became_active":"2024-09-21T00:14:14.009212+0000","last_became_peered":"2024-09-21T00:14:14.009212+0000","last_unstale":"2024-09-21T00:14:14.979265+0000","last_undegraded":"2024-09-21T00:14:14.979265+0000","last_fullsized":"2024-09-21T00:14:14.979265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:46.075015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500105+0000","last_change":"2024-09-21T00:14:09.952055+0000","last_active":"2024-09-21T00:14:15.500105+0000","last_peered":"2024-09-21T00:14:15.500105+0000","last_clean":"2024-09-21T00:14:15.500105+0000","last_became_active":"2024-09-21T00:14:09.951745+0000","last_became_peered":"2024-09-21T00:14:09.951745+0000","last_unstale":"2024-09-21T00:14:15.500105+0000","last_undegraded":"2024-09-21T00:14:15.500105+0000","last_fullsized":"2024-09-21T00:14:15.500105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:35.198862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.121996+0000","last_change":"2024-09-21T00:14:08.953140+0000","last_active":"2024-09-21T00:14:16.121996+0000","last_peered":"2024-09-21T00:14:16.121996+0000","last_clean":"2024-09-21T00:14:16.121996+0000","last_became_active":"2024-09-21T00:14:08.950002+0000","last_became_peered":"2024-09-21T00:14:08.950002+0000","last_unstale":"2024-09-21T00:14:16.121996+0000","last_undegraded":"2024-09-21T00:14:16.121996+0000","last_fullsized":"2024-09-21T00:14:16.121996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:05.121425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974140+0000","last_change":"2024-09-21T00:14:14.006167+0000","last_active":"2024-09-21T00:14:14.974140+0000","last_peered":"2024-09-21T00:14:14.974140+0000","last_clean":"2024-09-21T00:14:14.974140+0000","last_became_active":"2024-09-21T00:14:14.005001+0000","last_became_peered":"2024-09-21T00:14:14.005001+0000","last_unstale":"2024-09-21T00:14:14.974140+0000","last_undegraded":"2024-09-21T00:14:14.974140+0000","last_fullsized":"2024-09-21T00:14:14.974140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:57:27.249041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979047+0000","last_change":"2024-09-21T00:14:09.952929+0000","last_active":"2024-09-21T00:14:14.979047+0000","last_peered":"2024-09-21T00:14:14.979047+0000","last_clean":"2024-09-21T00:14:14.979047+0000","last_became_active":"2024-09-21T00:14:09.952574+0000","last_became_peered":"2024-09-21T00:14:09.952574+0000","last_unstale":"2024-09-21T00:14:14.979047+0000","last_undegraded":"2024-09-21T00:14:14.979047+0000","last_fullsized":"2024-09-21T00:14:14.979047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:02:57.284191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501092+0000","last_change":"2024-09-21T00:14:08.965568+0000","last_active":"2024-09-21T00:14:15.501092+0000","last_peered":"2024-09-21T00:14:15.501092+0000","last_clean":"2024-09-21T00:14:15.501092+0000","last_became_active":"2024-09-21T00:14:08.965239+0000","last_became_peered":"2024-09-21T00:14:08.965239+0000","last_unstale":"2024-09-21T00:14:15.501092+0000","last_undegraded":"2024-09-21T00:14:15.501092+0000","last_fullsized":"2024-09-21T00:14:15.501092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:00.848504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973649+0000","last_change":"2024-09-21T00:14:13.996979+0000","last_active":"2024-09-21T00:14:14.973649+0000","last_peered":"2024-09-21T00:14:14.973649+0000","last_clean":"2024-09-21T00:14:14.973649+0000","last_became_active":"2024-09-21T00:14:13.996457+0000","last_became_peered":"2024-09-21T00:14:13.996457+0000","last_unstale":"2024-09-21T00:14:14.973649+0000","last_undegraded":"2024-09-21T00:14:14.973649+0000","last_fullsized":"2024-09-21T00:14:14.973649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:14.192155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979358+0000","last_change":"2024-09-21T00:14:09.968623+0000","last_active":"2024-09-21T00:14:14.979358+0000","last_peered":"2024-09-21T00:14:14.979358+0000","last_clean":"2024-09-21T00:14:14.979358+0000","last_became_active":"2024-09-21T00:14:09.968243+0000","last_became_peered":"2024-09-21T00:14:09.968243+0000","last_unstale":"2024-09-21T00:14:14.979358+0000","last_undegraded":"2024-09-21T00:14:14.979358+0000","last_fullsized":"2024-09-21T00:14:14.979358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:54:02.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979198+0000","last_change":"2024-09-21T00:14:08.956965+0000","last_active":"2024-09-21T00:14:14.979198+0000","last_peered":"2024-09-21T00:14:14.979198+0000","last_clean":"2024-09-21T00:14:14.979198+0000","last_became_active":"2024-09-21T00:14:08.956594+0000","last_became_peered":"2024-09-21T00:14:08.956594+0000","last_unstale":"2024-09-21T00:14:14.979198+0000","last_undegraded":"2024-09-21T00:14:14.979198+0000","last_fullsized":"2024-09-21T00:14:14.979198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:51.700187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977217+0000","last_change":"2024-09-21T00:14:13.998452+0000","last_active":"2024-09-21T00:14:14.977217+0000","last_peered":"2024-09-21T00:14:14.977217+0000","last_clean":"2024-09-21T00:14:14.977217+0000","last_became_active":"2024-09-21T00:14:13.997896+0000","last_became_peered":"2024-09-21T00:14:13.997896+0000","last_unstale":"2024-09-21T00:14:14.977217+0000","last_undegraded":"2024-09-21T00:14:14.977217+0000","last_fullsized":"2024-09-21T00:14:14.977217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:06.050664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123575+0000","last_change":"2024-09-21T00:14:09.960305+0000","last_active":"2024-09-21T00:14:16.123575+0000","last_peered":"2024-09-21T00:14:16.123575+0000","last_clean":"2024-09-21T00:14:16.123575+0000","last_became_active":"2024-09-21T00:14:09.959991+0000","last_became_peered":"2024-09-21T00:14:09.959991+0000","last_unstale":"2024-09-21T00:14:16.123575+0000","last_undegraded":"2024-09-21T00:14:16.123575+0000","last_fullsized":"2024-09-21T00:14:16.123575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:01.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501177+0000","last_change":"2024-09-21T00:14:08.961047+0000","last_active":"2024-09-21T00:14:15.501177+0000","last_peered":"2024-09-21T00:14:15.501177+0000","last_clean":"2024-09-21T00:14:15.501177+0000","last_became_active":"2024-09-21T00:14:08.960716+0000","last_became_peered":"2024-09-21T00:14:08.960716+0000","last_unstale":"2024-09-21T00:14:15.501177+0000","last_undegraded":"2024-09-21T00:14:15.501177+0000","last_fullsized":"2024-09-21T00:14:15.501177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:06.314729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123221+0000","last_change":"2024-09-21T00:14:14.001333+0000","last_active":"2024-09-21T00:14:16.123221+0000","last_peered":"2024-09-21T00:14:16.123221+0000","last_clean":"2024-09-21T00:14:16.123221+0000","last_became_active":"2024-09-21T00:14:14.000838+0000","last_became_peered":"2024-09-21T00:14:14.000838+0000","last_unstale":"2024-09-21T00:14:16.123221+0000","last_undegraded":"2024-09-21T00:14:16.123221+0000","last_fullsized":"2024-09-21T00:14:16.123221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:04.996254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973835+0000","last_change":"2024-09-21T00:14:09.960278+0000","last_active":"2024-09-21T00:14:14.973835+0000","last_peered":"2024-09-21T00:14:14.973835+0000","last_clean":"2024-09-21T00:14:14.973835+0000","last_became_active":"2024-09-21T00:14:09.959949+0000","last_became_peered":"2024-09-21T00:14:09.959949+0000","last_unstale":"2024-09-21T00:14:14.973835+0000","last_undegraded":"2024-09-21T00:14:14.973835+0000","last_fullsized":"2024-09-21T00:14:14.973835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:09.105489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966906+0000","last_change":"2024-09-21T00:14:08.967871+0000","last_active":"2024-09-21T00:14:15.966906+0000","last_peered":"2024-09-21T00:14:15.966906+0000","last_clean":"2024-09-21T00:14:15.966906+0000","last_became_active":"2024-09-21T00:14:08.966840+0000","last_became_peered":"2024-09-21T00:14:08.966840+0000","last_unstale":"2024-09-21T00:14:15.966906+0000","last_undegraded":"2024-09-21T00:14:15.966906+0000","last_fullsized":"2024-09-21T00:14:15.966906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:12:50.931090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123068+0000","last_change":"2024-09-21T00:14:14.004129+0000","last_active":"2024-09-21T00:14:16.123068+0000","last_peered":"2024-09-21T00:14:16.123068+0000","last_clean":"2024-09-21T00:14:16.123068+0000","last_became_active":"2024-09-21T00:14:14.003631+0000","last_became_peered":"2024-09-21T00:14:14.003631+0000","last_unstale":"2024-09-21T00:14:16.123068+0000","last_undegraded":"2024-09-21T00:14:16.123068+0000","last_fullsized":"2024-09-21T00:14:16.123068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:31.535375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122448+0000","last_change":"2024-09-21T00:14:09.974665+0000","last_active":"2024-09-21T00:14:16.122448+0000","last_peered":"2024-09-21T00:14:16.122448+0000","last_clean":"2024-09-21T00:14:16.122448+0000","last_became_active":"2024-09-21T00:14:09.964253+0000","last_became_peered":"2024-09-21T00:14:09.964253+0000","last_unstale":"2024-09-21T00:14:16.122448+0000","last_undegraded":"2024-09-21T00:14:16.122448+0000","last_fullsized":"2024-09-21T00:14:16.122448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:40.707880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500462+0000","last_change":"2024-09-21T00:14:08.961331+0000","last_active":"2024-09-21T00:14:15.500462+0000","last_peered":"2024-09-21T00:14:15.500462+0000","last_clean":"2024-09-21T00:14:15.500462+0000","last_became_active":"2024-09-21T00:14:08.961064+0000","last_became_peered":"2024-09-21T00:14:08.961064+0000","last_unstale":"2024-09-21T00:14:15.500462+0000","last_undegraded":"2024-09-21T00:14:15.500462+0000","last_fullsized":"2024-09-21T00:14:15.500462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:09.528188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123408+0000","last_change":"2024-09-21T00:14:14.001325+0000","last_active":"2024-09-21T00:14:16.123408+0000","last_peered":"2024-09-21T00:14:16.123408+0000","last_clean":"2024-09-21T00:14:16.123408+0000","last_became_active":"2024-09-21T00:14:14.000838+0000","last_became_peered":"2024-09-21T00:14:14.000838+0000","last_unstale":"2024-09-21T00:14:16.123408+0000","last_undegraded":"2024-09-21T00:14:16.123408+0000","last_fullsized":"2024-09-21T00:14:16.123408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:14.306042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966733+0000","last_change":"2024-09-21T00:14:09.958391+0000","last_active":"2024-09-21T00:14:15.966733+0000","last_peered":"2024-09-21T00:14:15.966733+0000","last_clean":"2024-09-21T00:14:15.966733+0000","last_became_active":"2024-09-21T00:14:09.957844+0000","last_became_peered":"2024-09-21T00:14:09.957844+0000","last_unstale":"2024-09-21T00:14:15.966733+0000","last_undegraded":"2024-09-21T00:14:15.966733+0000","last_fullsized":"2024-09-21T00:14:15.966733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:30.770474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977238+0000","last_change":"2024-09-21T00:14:08.968128+0000","last_active":"2024-09-21T00:14:14.977238+0000","last_peered":"2024-09-21T00:14:14.977238+0000","last_clean":"2024-09-21T00:14:14.977238+0000","last_became_active":"2024-09-21T00:14:08.967257+0000","last_became_peered":"2024-09-21T00:14:08.967257+0000","last_unstale":"2024-09-21T00:14:14.977238+0000","last_undegraded":"2024-09-21T00:14:14.977238+0000","last_fullsized":"2024-09-21T00:14:14.977238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:03.075394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123840+0000","last_change":"2024-09-21T00:14:14.005119+0000","last_active":"2024-09-21T00:14:16.123840+0000","last_peered":"2024-09-21T00:14:16.123840+0000","last_clean":"2024-09-21T00:14:16.123840+0000","last_became_active":"2024-09-21T00:14:14.003742+0000","last_became_peered":"2024-09-21T00:14:14.003742+0000","last_unstale":"2024-09-21T00:14:16.123840+0000","last_undegraded":"2024-09-21T00:14:16.123840+0000","last_fullsized":"2024-09-21T00:14:16.123840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:06.050664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122838+0000","last_change":"2024-09-21T00:14:09.969231+0000","last_active":"2024-09-21T00:14:16.122838+0000","last_peered":"2024-09-21T00:14:16.122838+0000","last_clean":"2024-09-21T00:14:16.122838+0000","last_became_active":"2024-09-21T00:14:09.968567+0000","last_became_peered":"2024-09-21T00:14:09.968567+0000","last_unstale":"2024-09-21T00:14:16.122838+0000","last_undegraded":"2024-09-21T00:14:16.122838+0000","last_fullsized":"2024-09-21T00:14:16.122838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.302969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500274+0000","last_change":"2024-09-21T00:14:08.966891+0000","last_active":"2024-09-21T00:14:15.500274+0000","last_peered":"2024-09-21T00:14:15.500274+0000","last_clean":"2024-09-21T00:14:15.500274+0000","last_became_active":"2024-09-21T00:14:08.966521+0000","last_became_peered":"2024-09-21T00:14:08.966521+0000","last_unstale":"2024-09-21T00:14:15.500274+0000","last_undegraded":"2024-09-21T00:14:15.500274+0000","last_fullsized":"2024-09-21T00:14:15.500274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:17.687314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967312+0000","last_change":"2024-09-21T00:14:14.004905+0000","last_active":"2024-09-21T00:14:15.967312+0000","last_peered":"2024-09-21T00:14:15.967312+0000","last_clean":"2024-09-21T00:14:15.967312+0000","last_became_active":"2024-09-21T00:14:14.002340+0000","last_became_peered":"2024-09-21T00:14:14.002340+0000","last_unstale":"2024-09-21T00:14:15.967312+0000","last_undegraded":"2024-09-21T00:14:15.967312+0000","last_fullsized":"2024-09-21T00:14:15.967312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:46.951215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977585+0000","last_change":"2024-09-21T00:14:09.944543+0000","last_active":"2024-09-21T00:14:14.977585+0000","last_peered":"2024-09-21T00:14:14.977585+0000","last_clean":"2024-09-21T00:14:14.977585+0000","last_became_active":"2024-09-21T00:14:09.944211+0000","last_became_peered":"2024-09-21T00:14:09.944211+0000","last_unstale":"2024-09-21T00:14:14.977585+0000","last_undegraded":"2024-09-21T00:14:14.977585+0000","last_fullsized":"2024-09-21T00:14:14.977585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:26.273280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500607+0000","last_change":"2024-09-21T00:14:08.963265+0000","last_active":"2024-09-21T00:14:15.500607+0000","last_peered":"2024-09-21T00:14:15.500607+0000","last_clean":"2024-09-21T00:14:15.500607+0000","last_became_active":"2024-09-21T00:14:08.961984+0000","last_became_peered":"2024-09-21T00:14:08.961984+0000","last_unstale":"2024-09-21T00:14:15.500607+0000","last_undegraded":"2024-09-21T00:14:15.500607+0000","last_fullsized":"2024-09-21T00:14:15.500607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:23.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122745+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:14:16.122745+0000","last_peered":"2024-09-21T00:14:16.122745+0000","last_clean":"2024-09-21T00:14:16.122745+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:14:16.122745+0000","last_undegraded":"2024-09-21T00:14:16.122745+0000","last_fullsized":"2024-09-21T00:14:16.122745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501135+0000","last_change":"2024-09-21T00:14:13.987888+0000","last_active":"2024-09-21T00:14:15.501135+0000","last_peered":"2024-09-21T00:14:15.501135+0000","last_clean":"2024-09-21T00:14:15.501135+0000","last_became_active":"2024-09-21T00:14:13.987371+0000","last_became_peered":"2024-09-21T00:14:13.987371+0000","last_unstale":"2024-09-21T00:14:15.501135+0000","last_undegraded":"2024-09-21T00:14:15.501135+0000","last_fullsized":"2024-09-21T00:14:15.501135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:13.662595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500986+0000","last_change":"2024-09-21T00:14:09.976122+0000","last_active":"2024-09-21T00:14:15.500986+0000","last_peered":"2024-09-21T00:14:15.500986+0000","last_clean":"2024-09-21T00:14:15.500986+0000","last_became_active":"2024-09-21T00:14:09.975763+0000","last_became_peered":"2024-09-21T00:14:09.975763+0000","last_unstale":"2024-09-21T00:14:15.500986+0000","last_undegraded":"2024-09-21T00:14:15.500986+0000","last_fullsized":"2024-09-21T00:14:15.500986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:58.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123695+0000","last_change":"2024-09-21T00:14:08.965532+0000","last_active":"2024-09-21T00:14:16.123695+0000","last_peered":"2024-09-21T00:14:16.123695+0000","last_clean":"2024-09-21T00:14:16.123695+0000","last_became_active":"2024-09-21T00:14:08.965203+0000","last_became_peered":"2024-09-21T00:14:08.965203+0000","last_unstale":"2024-09-21T00:14:16.123695+0000","last_undegraded":"2024-09-21T00:14:16.123695+0000","last_fullsized":"2024-09-21T00:14:16.123695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:43:28.609507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973635+0000","last_change":"2024-09-21T00:14:14.010029+0000","last_active":"2024-09-21T00:14:14.973635+0000","last_peered":"2024-09-21T00:14:14.973635+0000","last_clean":"2024-09-21T00:14:14.973635+0000","last_became_active":"2024-09-21T00:14:14.009543+0000","last_became_peered":"2024-09-21T00:14:14.009543+0000","last_unstale":"2024-09-21T00:14:14.973635+0000","last_undegraded":"2024-09-21T00:14:14.973635+0000","last_fullsized":"2024-09-21T00:14:14.973635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:44.738397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122862+0000","last_change":"2024-09-21T00:14:09.956902+0000","last_active":"2024-09-21T00:14:16.122862+0000","last_peered":"2024-09-21T00:14:16.122862+0000","last_clean":"2024-09-21T00:14:16.122862+0000","last_became_active":"2024-09-21T00:14:09.956598+0000","last_became_peered":"2024-09-21T00:14:09.956598+0000","last_unstale":"2024-09-21T00:14:16.122862+0000","last_undegraded":"2024-09-21T00:14:16.122862+0000","last_fullsized":"2024-09-21T00:14:16.122862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:33.085847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967274+0000","last_change":"2024-09-21T00:14:08.960165+0000","last_active":"2024-09-21T00:14:15.967274+0000","last_peered":"2024-09-21T00:14:15.967274+0000","last_clean":"2024-09-21T00:14:15.967274+0000","last_became_active":"2024-09-21T00:14:08.959384+0000","last_became_peered":"2024-09-21T00:14:08.959384+0000","last_unstale":"2024-09-21T00:14:15.967274+0000","last_undegraded":"2024-09-21T00:14:15.967274+0000","last_fullsized":"2024-09-21T00:14:15.967274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:45.898250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967161+0000","last_change":"2024-09-21T00:14:13.991452+0000","last_active":"2024-09-21T00:14:15.967161+0000","last_peered":"2024-09-21T00:14:15.967161+0000","last_clean":"2024-09-21T00:14:15.967161+0000","last_became_active":"2024-09-21T00:14:13.991104+0000","last_became_peered":"2024-09-21T00:14:13.991104+0000","last_unstale":"2024-09-21T00:14:15.967161+0000","last_undegraded":"2024-09-21T00:14:15.967161+0000","last_fullsized":"2024-09-21T00:14:15.967161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:13.243815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123422+0000","last_change":"2024-09-21T00:14:09.965731+0000","last_active":"2024-09-21T00:14:16.123422+0000","last_peered":"2024-09-21T00:14:16.123422+0000","last_clean":"2024-09-21T00:14:16.123422+0000","last_became_active":"2024-09-21T00:14:09.965441+0000","last_became_peered":"2024-09-21T00:14:09.965441+0000","last_unstale":"2024-09-21T00:14:16.123422+0000","last_undegraded":"2024-09-21T00:14:16.123422+0000","last_fullsized":"2024-09-21T00:14:16.123422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:30.235970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979154+0000","last_change":"2024-09-21T00:14:08.956670+0000","last_active":"2024-09-21T00:14:14.979154+0000","last_peered":"2024-09-21T00:14:14.979154+0000","last_clean":"2024-09-21T00:14:14.979154+0000","last_became_active":"2024-09-21T00:14:08.955944+0000","last_became_peered":"2024-09-21T00:14:08.955944+0000","last_unstale":"2024-09-21T00:14:14.979154+0000","last_undegraded":"2024-09-21T00:14:14.979154+0000","last_fullsized":"2024-09-21T00:14:14.979154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:27.091939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500018+0000","last_change":"2024-09-21T00:14:13.993587+0000","last_active":"2024-09-21T00:14:15.500018+0000","last_peered":"2024-09-21T00:14:15.500018+0000","last_clean":"2024-09-21T00:14:15.500018+0000","last_became_active":"2024-09-21T00:14:13.993154+0000","last_became_peered":"2024-09-21T00:14:13.993154+0000","last_unstale":"2024-09-21T00:14:15.500018+0000","last_undegraded":"2024-09-21T00:14:15.500018+0000","last_fullsized":"2024-09-21T00:14:15.500018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:10.903336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974186+0000","last_change":"2024-09-21T00:14:09.956980+0000","last_active":"2024-09-21T00:14:14.974186+0000","last_peered":"2024-09-21T00:14:14.974186+0000","last_clean":"2024-09-21T00:14:14.974186+0000","last_became_active":"2024-09-21T00:14:09.956663+0000","last_became_peered":"2024-09-21T00:14:09.956663+0000","last_unstale":"2024-09-21T00:14:14.974186+0000","last_undegraded":"2024-09-21T00:14:14.974186+0000","last_fullsized":"2024-09-21T00:14:14.974186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.535510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123436+0000","last_change":"2024-09-21T00:14:08.962950+0000","last_active":"2024-09-21T00:14:16.123436+0000","last_peered":"2024-09-21T00:14:16.123436+0000","last_clean":"2024-09-21T00:14:16.123436+0000","last_became_active":"2024-09-21T00:14:08.962106+0000","last_became_peered":"2024-09-21T00:14:08.962106+0000","last_unstale":"2024-09-21T00:14:16.123436+0000","last_undegraded":"2024-09-21T00:14:16.123436+0000","last_fullsized":"2024-09-21T00:14:16.123436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:28.367381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123232+0000","last_change":"2024-09-21T00:14:13.998520+0000","last_active":"2024-09-21T00:14:16.123232+0000","last_peered":"2024-09-21T00:14:16.123232+0000","last_clean":"2024-09-21T00:14:16.123232+0000","last_became_active":"2024-09-21T00:14:13.998102+0000","last_became_peered":"2024-09-21T00:14:13.998102+0000","last_unstale":"2024-09-21T00:14:16.123232+0000","last_undegraded":"2024-09-21T00:14:16.123232+0000","last_fullsized":"2024-09-21T00:14:16.123232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:35.968823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500013+0000","last_change":"2024-09-21T00:14:09.971253+0000","last_active":"2024-09-21T00:14:15.500013+0000","last_peered":"2024-09-21T00:14:15.500013+0000","last_clean":"2024-09-21T00:14:15.500013+0000","last_became_active":"2024-09-21T00:14:09.966337+0000","last_became_peered":"2024-09-21T00:14:09.966337+0000","last_unstale":"2024-09-21T00:14:15.500013+0000","last_undegraded":"2024-09-21T00:14:15.500013+0000","last_fullsized":"2024-09-21T00:14:15.500013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:30.235970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977345+0000","last_change":"2024-09-21T00:14:08.956648+0000","last_active":"2024-09-21T00:14:14.977345+0000","last_peered":"2024-09-21T00:14:14.977345+0000","last_clean":"2024-09-21T00:14:14.977345+0000","last_became_active":"2024-09-21T00:14:08.956242+0000","last_became_peered":"2024-09-21T00:14:08.956242+0000","last_unstale":"2024-09-21T00:14:14.977345+0000","last_undegraded":"2024-09-21T00:14:14.977345+0000","last_fullsized":"2024-09-21T00:14:14.977345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:51:44.198197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967515+0000","last_change":"2024-09-21T00:14:14.010023+0000","last_active":"2024-09-21T00:14:15.967515+0000","last_peered":"2024-09-21T00:14:15.967515+0000","last_clean":"2024-09-21T00:14:15.967515+0000","last_became_active":"2024-09-21T00:14:14.009295+0000","last_became_peered":"2024-09-21T00:14:14.009295+0000","last_unstale":"2024-09-21T00:14:15.967515+0000","last_undegraded":"2024-09-21T00:14:15.967515+0000","last_fullsized":"2024-09-21T00:14:15.967515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:45.380314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122633+0000","last_change":"2024-09-21T00:14:09.958927+0000","last_active":"2024-09-21T00:14:16.122633+0000","last_peered":"2024-09-21T00:14:16.122633+0000","last_clean":"2024-09-21T00:14:16.122633+0000","last_became_active":"2024-09-21T00:14:09.958618+0000","last_became_peered":"2024-09-21T00:14:09.958618+0000","last_unstale":"2024-09-21T00:14:16.122633+0000","last_undegraded":"2024-09-21T00:14:16.122633+0000","last_fullsized":"2024-09-21T00:14:16.122633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122261+0000","last_change":"2024-09-21T00:14:08.962483+0000","last_active":"2024-09-21T00:14:16.122261+0000","last_peered":"2024-09-21T00:14:16.122261+0000","last_clean":"2024-09-21T00:14:16.122261+0000","last_became_active":"2024-09-21T00:14:08.961970+0000","last_became_peered":"2024-09-21T00:14:08.961970+0000","last_unstale":"2024-09-21T00:14:16.122261+0000","last_undegraded":"2024-09-21T00:14:16.122261+0000","last_fullsized":"2024-09-21T00:14:16.122261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:27.091939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967654+0000","last_change":"2024-09-21T00:14:13.994820+0000","last_active":"2024-09-21T00:14:15.967654+0000","last_peered":"2024-09-21T00:14:15.967654+0000","last_clean":"2024-09-21T00:14:15.967654+0000","last_became_active":"2024-09-21T00:14:13.994201+0000","last_became_peered":"2024-09-21T00:14:13.994201+0000","last_unstale":"2024-09-21T00:14:15.967654+0000","last_undegraded":"2024-09-21T00:14:15.967654+0000","last_fullsized":"2024-09-21T00:14:15.967654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.660541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500240+0000","last_change":"2024-09-21T00:14:09.954424+0000","last_active":"2024-09-21T00:14:15.500240+0000","last_peered":"2024-09-21T00:14:15.500240+0000","last_clean":"2024-09-21T00:14:15.500240+0000","last_became_active":"2024-09-21T00:14:09.953451+0000","last_became_peered":"2024-09-21T00:14:09.953451+0000","last_unstale":"2024-09-21T00:14:15.500240+0000","last_undegraded":"2024-09-21T00:14:15.500240+0000","last_fullsized":"2024-09-21T00:14:15.500240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:02.131667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500383+0000","last_change":"2024-09-21T00:14:08.955470+0000","last_active":"2024-09-21T00:14:15.500383+0000","last_peered":"2024-09-21T00:14:15.500383+0000","last_clean":"2024-09-21T00:14:15.500383+0000","last_became_active":"2024-09-21T00:14:08.952599+0000","last_became_peered":"2024-09-21T00:14:08.952599+0000","last_unstale":"2024-09-21T00:14:15.500383+0000","last_undegraded":"2024-09-21T00:14:15.500383+0000","last_fullsized":"2024-09-21T00:14:15.500383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:16.644911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123459+0000","last_change":"2024-09-21T00:14:14.004819+0000","last_active":"2024-09-21T00:14:16.123459+0000","last_peered":"2024-09-21T00:14:16.123459+0000","last_clean":"2024-09-21T00:14:16.123459+0000","last_became_active":"2024-09-21T00:14:14.003284+0000","last_became_peered":"2024-09-21T00:14:14.003284+0000","last_unstale":"2024-09-21T00:14:16.123459+0000","last_undegraded":"2024-09-21T00:14:16.123459+0000","last_fullsized":"2024-09-21T00:14:16.123459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:56:35.976927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123069+0000","last_change":"2024-09-21T00:14:09.966769+0000","last_active":"2024-09-21T00:14:16.123069+0000","last_peered":"2024-09-21T00:14:16.123069+0000","last_clean":"2024-09-21T00:14:16.123069+0000","last_became_active":"2024-09-21T00:14:09.966448+0000","last_became_peered":"2024-09-21T00:14:09.966448+0000","last_unstale":"2024-09-21T00:14:16.123069+0000","last_undegraded":"2024-09-21T00:14:16.123069+0000","last_fullsized":"2024-09-21T00:14:16.123069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978213+0000","last_change":"2024-09-21T00:14:08.967528+0000","last_active":"2024-09-21T00:14:14.978213+0000","last_peered":"2024-09-21T00:14:14.978213+0000","last_clean":"2024-09-21T00:14:14.978213+0000","last_became_active":"2024-09-21T00:14:08.966897+0000","last_became_peered":"2024-09-21T00:14:08.966897+0000","last_unstale":"2024-09-21T00:14:14.978213+0000","last_undegraded":"2024-09-21T00:14:14.978213+0000","last_fullsized":"2024-09-21T00:14:14.978213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:51:44.198197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501045+0000","last_change":"2024-09-21T00:14:13.989994+0000","last_active":"2024-09-21T00:14:15.501045+0000","last_peered":"2024-09-21T00:14:15.501045+0000","last_clean":"2024-09-21T00:14:15.501045+0000","last_became_active":"2024-09-21T00:14:13.989524+0000","last_became_peered":"2024-09-21T00:14:13.989524+0000","last_unstale":"2024-09-21T00:14:15.501045+0000","last_undegraded":"2024-09-21T00:14:15.501045+0000","last_fullsized":"2024-09-21T00:14:15.501045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:45.169356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123101+0000","last_change":"2024-09-21T00:14:09.955385+0000","last_active":"2024-09-21T00:14:16.123101+0000","last_peered":"2024-09-21T00:14:16.123101+0000","last_clean":"2024-09-21T00:14:16.123101+0000","last_became_active":"2024-09-21T00:14:09.955031+0000","last_became_peered":"2024-09-21T00:14:09.955031+0000","last_unstale":"2024-09-21T00:14:16.123101+0000","last_undegraded":"2024-09-21T00:14:16.123101+0000","last_fullsized":"2024-09-21T00:14:16.123101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:27.504857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:22.928007+0000","last_change":"2024-09-21T00:14:08.950520+0000","last_active":"2024-09-21T00:14:22.928007+0000","last_peered":"2024-09-21T00:14:22.928007+0000","last_clean":"2024-09-21T00:14:22.928007+0000","last_became_active":"2024-09-21T00:14:08.950052+0000","last_became_peered":"2024-09-21T00:14:08.950052+0000","last_unstale":"2024-09-21T00:14:22.928007+0000","last_undegraded":"2024-09-21T00:14:22.928007+0000","last_fullsized":"2024-09-21T00:14:22.928007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:03.572976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977762+0000","last_change":"2024-09-21T00:14:13.991051+0000","last_active":"2024-09-21T00:14:14.977762+0000","last_peered":"2024-09-21T00:14:14.977762+0000","last_clean":"2024-09-21T00:14:14.977762+0000","last_became_active":"2024-09-21T00:14:13.990544+0000","last_became_peered":"2024-09-21T00:14:13.990544+0000","last_unstale":"2024-09-21T00:14:14.977762+0000","last_undegraded":"2024-09-21T00:14:14.977762+0000","last_fullsized":"2024-09-21T00:14:14.977762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:21.835935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500587+0000","last_change":"2024-09-21T00:14:09.967875+0000","last_active":"2024-09-21T00:14:15.500587+0000","last_peered":"2024-09-21T00:14:15.500587+0000","last_clean":"2024-09-21T00:14:15.500587+0000","last_became_active":"2024-09-21T00:14:09.966515+0000","last_became_peered":"2024-09-21T00:14:09.966515+0000","last_unstale":"2024-09-21T00:14:15.500587+0000","last_undegraded":"2024-09-21T00:14:15.500587+0000","last_fullsized":"2024-09-21T00:14:15.500587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:18:31.266375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978569+0000","last_change":"2024-09-21T00:14:08.963443+0000","last_active":"2024-09-21T00:14:14.978569+0000","last_peered":"2024-09-21T00:14:14.978569+0000","last_clean":"2024-09-21T00:14:14.978569+0000","last_became_active":"2024-09-21T00:14:08.963001+0000","last_became_peered":"2024-09-21T00:14:08.963001+0000","last_unstale":"2024-09-21T00:14:14.978569+0000","last_undegraded":"2024-09-21T00:14:14.978569+0000","last_fullsized":"2024-09-21T00:14:14.978569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:38.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974431+0000","last_change":"2024-09-21T00:14:14.004423+0000","last_active":"2024-09-21T00:14:14.974431+0000","last_peered":"2024-09-21T00:14:14.974431+0000","last_clean":"2024-09-21T00:14:14.974431+0000","last_became_active":"2024-09-21T00:14:14.003993+0000","last_became_peered":"2024-09-21T00:14:14.003993+0000","last_unstale":"2024-09-21T00:14:14.974431+0000","last_undegraded":"2024-09-21T00:14:14.974431+0000","last_fullsized":"2024-09-21T00:14:14.974431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:07:20.224751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967722+0000","last_change":"2024-09-21T00:14:09.971797+0000","last_active":"2024-09-21T00:14:15.967722+0000","last_peered":"2024-09-21T00:14:15.967722+0000","last_clean":"2024-09-21T00:14:15.967722+0000","last_became_active":"2024-09-21T00:14:09.971424+0000","last_became_peered":"2024-09-21T00:14:09.971424+0000","last_unstale":"2024-09-21T00:14:15.967722+0000","last_undegraded":"2024-09-21T00:14:15.967722+0000","last_fullsized":"2024-09-21T00:14:15.967722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:26.244909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122745+0000","last_change":"2024-09-21T00:14:08.946131+0000","last_active":"2024-09-21T00:14:16.122745+0000","last_peered":"2024-09-21T00:14:16.122745+0000","last_clean":"2024-09-21T00:14:16.122745+0000","last_became_active":"2024-09-21T00:14:08.945798+0000","last_became_peered":"2024-09-21T00:14:08.945798+0000","last_unstale":"2024-09-21T00:14:16.122745+0000","last_undegraded":"2024-09-21T00:14:16.122745+0000","last_fullsized":"2024-09-21T00:14:16.122745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:19.481209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.976886+0000","last_change":"2024-09-21T00:14:14.009826+0000","last_active":"2024-09-21T00:14:14.976886+0000","last_peered":"2024-09-21T00:14:14.976886+0000","last_clean":"2024-09-21T00:14:14.976886+0000","last_became_active":"2024-09-21T00:14:14.009239+0000","last_became_peered":"2024-09-21T00:14:14.009239+0000","last_unstale":"2024-09-21T00:14:14.976886+0000","last_undegraded":"2024-09-21T00:14:14.976886+0000","last_fullsized":"2024-09-21T00:14:14.976886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:11.352568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974080+0000","last_change":"2024-09-21T00:14:09.961500+0000","last_active":"2024-09-21T00:14:14.974080+0000","last_peered":"2024-09-21T00:14:14.974080+0000","last_clean":"2024-09-21T00:14:14.974080+0000","last_became_active":"2024-09-21T00:14:09.960752+0000","last_became_peered":"2024-09-21T00:14:09.960752+0000","last_unstale":"2024-09-21T00:14:14.974080+0000","last_undegraded":"2024-09-21T00:14:14.974080+0000","last_fullsized":"2024-09-21T00:14:14.974080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123962+0000","last_change":"2024-09-21T00:14:08.951923+0000","last_active":"2024-09-21T00:14:16.123962+0000","last_peered":"2024-09-21T00:14:16.123962+0000","last_clean":"2024-09-21T00:14:16.123962+0000","last_became_active":"2024-09-21T00:14:08.947804+0000","last_became_peered":"2024-09-21T00:14:08.947804+0000","last_unstale":"2024-09-21T00:14:16.123962+0000","last_undegraded":"2024-09-21T00:14:16.123962+0000","last_fullsized":"2024-09-21T00:14:16.123962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:28.286333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977974+0000","last_change":"2024-09-21T00:14:13.997051+0000","last_active":"2024-09-21T00:14:14.977974+0000","last_peered":"2024-09-21T00:14:14.977974+0000","last_clean":"2024-09-21T00:14:14.977974+0000","last_became_active":"2024-09-21T00:14:13.996692+0000","last_became_peered":"2024-09-21T00:14:13.996692+0000","last_unstale":"2024-09-21T00:14:14.977974+0000","last_undegraded":"2024-09-21T00:14:14.977974+0000","last_fullsized":"2024-09-21T00:14:14.977974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:37.116365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979061+0000","last_change":"2024-09-21T00:14:13.993380+0000","last_active":"2024-09-21T00:14:14.979061+0000","last_peered":"2024-09-21T00:14:14.979061+0000","last_clean":"2024-09-21T00:14:14.979061+0000","last_became_active":"2024-09-21T00:14:13.992819+0000","last_became_peered":"2024-09-21T00:14:13.992819+0000","last_unstale":"2024-09-21T00:14:14.979061+0000","last_undegraded":"2024-09-21T00:14:14.979061+0000","last_fullsized":"2024-09-21T00:14:14.979061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.855429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978052+0000","last_change":"2024-09-21T00:14:09.962777+0000","last_active":"2024-09-21T00:14:14.978052+0000","last_peered":"2024-09-21T00:14:14.978052+0000","last_clean":"2024-09-21T00:14:14.978052+0000","last_became_active":"2024-09-21T00:14:09.962489+0000","last_became_peered":"2024-09-21T00:14:09.962489+0000","last_unstale":"2024-09-21T00:14:14.978052+0000","last_undegraded":"2024-09-21T00:14:14.978052+0000","last_fullsized":"2024-09-21T00:14:14.978052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:21.354918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500237+0000","last_change":"2024-09-21T00:14:08.955114+0000","last_active":"2024-09-21T00:14:15.500237+0000","last_peered":"2024-09-21T00:14:15.500237+0000","last_clean":"2024-09-21T00:14:15.500237+0000","last_became_active":"2024-09-21T00:14:08.954028+0000","last_became_peered":"2024-09-21T00:14:08.954028+0000","last_unstale":"2024-09-21T00:14:15.500237+0000","last_undegraded":"2024-09-21T00:14:15.500237+0000","last_fullsized":"2024-09-21T00:14:15.500237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:19.481209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500943+0000","last_change":"2024-09-21T00:14:13.993411+0000","last_active":"2024-09-21T00:14:15.500943+0000","last_peered":"2024-09-21T00:14:15.500943+0000","last_clean":"2024-09-21T00:14:15.500943+0000","last_became_active":"2024-09-21T00:14:13.992997+0000","last_became_peered":"2024-09-21T00:14:13.992997+0000","last_unstale":"2024-09-21T00:14:15.500943+0000","last_undegraded":"2024-09-21T00:14:15.500943+0000","last_fullsized":"2024-09-21T00:14:15.500943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:22.418960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967109+0000","last_change":"2024-09-21T00:14:09.962686+0000","last_active":"2024-09-21T00:14:15.967109+0000","last_peered":"2024-09-21T00:14:15.967109+0000","last_clean":"2024-09-21T00:14:15.967109+0000","last_became_active":"2024-09-21T00:14:09.961140+0000","last_became_peered":"2024-09-21T00:14:09.961140+0000","last_unstale":"2024-09-21T00:14:15.967109+0000","last_undegraded":"2024-09-21T00:14:15.967109+0000","last_fullsized":"2024-09-21T00:14:15.967109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:30.146682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122851+0000","last_change":"2024-09-21T00:14:08.961705+0000","last_active":"2024-09-21T00:14:16.122851+0000","last_peered":"2024-09-21T00:14:16.122851+0000","last_clean":"2024-09-21T00:14:16.122851+0000","last_became_active":"2024-09-21T00:14:08.961362+0000","last_became_peered":"2024-09-21T00:14:08.961362+0000","last_unstale":"2024-09-21T00:14:16.122851+0000","last_undegraded":"2024-09-21T00:14:16.122851+0000","last_fullsized":"2024-09-21T00:14:16.122851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:17.677016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500354+0000","last_change":"2024-09-21T00:14:08.967458+0000","last_active":"2024-09-21T00:14:15.500354+0000","last_peered":"2024-09-21T00:14:15.500354+0000","last_clean":"2024-09-21T00:14:15.500354+0000","last_became_active":"2024-09-21T00:14:08.966663+0000","last_became_peered":"2024-09-21T00:14:08.966663+0000","last_unstale":"2024-09-21T00:14:15.500354+0000","last_undegraded":"2024-09-21T00:14:15.500354+0000","last_fullsized":"2024-09-21T00:14:15.500354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:12.051409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978414+0000","last_change":"2024-09-21T00:14:09.955928+0000","last_active":"2024-09-21T00:14:14.978414+0000","last_peered":"2024-09-21T00:14:14.978414+0000","last_clean":"2024-09-21T00:14:14.978414+0000","last_became_active":"2024-09-21T00:14:09.955523+0000","last_became_peered":"2024-09-21T00:14:09.955523+0000","last_unstale":"2024-09-21T00:14:14.978414+0000","last_undegraded":"2024-09-21T00:14:14.978414+0000","last_fullsized":"2024-09-21T00:14:14.978414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:16.513288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978979+0000","last_change":"2024-09-21T00:14:14.003528+0000","last_active":"2024-09-21T00:14:14.978979+0000","last_peered":"2024-09-21T00:14:14.978979+0000","last_clean":"2024-09-21T00:14:14.978979+0000","last_became_active":"2024-09-21T00:14:14.002941+0000","last_became_peered":"2024-09-21T00:14:14.002941+0000","last_unstale":"2024-09-21T00:14:14.978979+0000","last_undegraded":"2024-09-21T00:14:14.978979+0000","last_fullsized":"2024-09-21T00:14:14.978979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:21.996124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967341+0000","last_change":"2024-09-21T00:14:08.968392+0000","last_active":"2024-09-21T00:14:15.967341+0000","last_peered":"2024-09-21T00:14:15.967341+0000","last_clean":"2024-09-21T00:14:15.967341+0000","last_became_active":"2024-09-21T00:14:08.967708+0000","last_became_peered":"2024-09-21T00:14:08.967708+0000","last_unstale":"2024-09-21T00:14:15.967341+0000","last_undegraded":"2024-09-21T00:14:15.967341+0000","last_fullsized":"2024-09-21T00:14:15.967341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:36.352016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123057+0000","last_change":"2024-09-21T00:14:09.961926+0000","last_active":"2024-09-21T00:14:16.123057+0000","last_peered":"2024-09-21T00:14:16.123057+0000","last_clean":"2024-09-21T00:14:16.123057+0000","last_became_active":"2024-09-21T00:14:09.961227+0000","last_became_peered":"2024-09-21T00:14:09.961227+0000","last_unstale":"2024-09-21T00:14:16.123057+0000","last_undegraded":"2024-09-21T00:14:16.123057+0000","last_fullsized":"2024-09-21T00:14:16.123057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978238+0000","last_change":"2024-09-21T00:14:14.013035+0000","last_active":"2024-09-21T00:14:14.978238+0000","last_peered":"2024-09-21T00:14:14.978238+0000","last_clean":"2024-09-21T00:14:14.978238+0000","last_became_active":"2024-09-21T00:14:14.011549+0000","last_became_peered":"2024-09-21T00:14:14.011549+0000","last_unstale":"2024-09-21T00:14:14.978238+0000","last_undegraded":"2024-09-21T00:14:14.978238+0000","last_fullsized":"2024-09-21T00:14:14.978238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:20.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973538+0000","last_change":"2024-09-21T00:14:09.960154+0000","last_active":"2024-09-21T00:14:14.973538+0000","last_peered":"2024-09-21T00:14:14.973538+0000","last_clean":"2024-09-21T00:14:14.973538+0000","last_became_active":"2024-09-21T00:14:09.959838+0000","last_became_peered":"2024-09-21T00:14:09.959838+0000","last_unstale":"2024-09-21T00:14:14.973538+0000","last_undegraded":"2024-09-21T00:14:14.973538+0000","last_fullsized":"2024-09-21T00:14:14.973538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977119+0000","last_change":"2024-09-21T00:14:09.961472+0000","last_active":"2024-09-21T00:14:14.977119+0000","last_peered":"2024-09-21T00:14:14.977119+0000","last_clean":"2024-09-21T00:14:14.977119+0000","last_became_active":"2024-09-21T00:14:09.961159+0000","last_became_peered":"2024-09-21T00:14:09.961159+0000","last_unstale":"2024-09-21T00:14:14.977119+0000","last_undegraded":"2024-09-21T00:14:14.977119+0000","last_fullsized":"2024-09-21T00:14:14.977119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:18.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500115+0000","last_change":"2024-09-21T00:14:09.960102+0000","last_active":"2024-09-21T00:14:15.500115+0000","last_peered":"2024-09-21T00:14:15.500115+0000","last_clean":"2024-09-21T00:14:15.500115+0000","last_became_active":"2024-09-21T00:14:09.959770+0000","last_became_peered":"2024-09-21T00:14:09.959770+0000","last_unstale":"2024-09-21T00:14:15.500115+0000","last_undegraded":"2024-09-21T00:14:15.500115+0000","last_fullsized":"2024-09-21T00:14:15.500115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:48:17.648660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967160+0000","last_change":"2024-09-21T00:14:09.967922+0000","last_active":"2024-09-21T00:14:15.967160+0000","last_peered":"2024-09-21T00:14:15.967160+0000","last_clean":"2024-09-21T00:14:15.967160+0000","last_became_active":"2024-09-21T00:14:09.964230+0000","last_became_peered":"2024-09-21T00:14:09.964230+0000","last_unstale":"2024-09-21T00:14:15.967160+0000","last_undegraded":"2024-09-21T00:14:15.967160+0000","last_fullsized":"2024-09-21T00:14:15.967160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:12.855251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123529+0000","last_change":"2024-09-21T00:14:09.971876+0000","last_active":"2024-09-21T00:14:16.123529+0000","last_peered":"2024-09-21T00:14:16.123529+0000","last_clean":"2024-09-21T00:14:16.123529+0000","last_became_active":"2024-09-21T00:14:09.968741+0000","last_became_peered":"2024-09-21T00:14:09.968741+0000","last_unstale":"2024-09-21T00:14:16.123529+0000","last_undegraded":"2024-09-21T00:14:16.123529+0000","last_fullsized":"2024-09-21T00:14:16.123529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:16.513288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123468+0000","last_change":"2024-09-21T00:14:09.957134+0000","last_active":"2024-09-21T00:14:16.123468+0000","last_peered":"2024-09-21T00:14:16.123468+0000","last_clean":"2024-09-21T00:14:16.123468+0000","last_became_active":"2024-09-21T00:14:09.956848+0000","last_became_peered":"2024-09-21T00:14:09.956848+0000","last_unstale":"2024-09-21T00:14:16.123468+0000","last_undegraded":"2024-09-21T00:14:16.123468+0000","last_fullsized":"2024-09-21T00:14:16.123468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:42.044497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973970+0000","last_change":"2024-09-21T00:14:09.969393+0000","last_active":"2024-09-21T00:14:14.973970+0000","last_peered":"2024-09-21T00:14:14.973970+0000","last_clean":"2024-09-21T00:14:14.973970+0000","last_became_active":"2024-09-21T00:14:09.967322+0000","last_became_peered":"2024-09-21T00:14:09.967322+0000","last_unstale":"2024-09-21T00:14:14.973970+0000","last_undegraded":"2024-09-21T00:14:14.973970+0000","last_fullsized":"2024-09-21T00:14:14.973970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:13.058730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967420+0000","last_change":"2024-09-21T00:14:09.975534+0000","last_active":"2024-09-21T00:14:15.967420+0000","last_peered":"2024-09-21T00:14:15.967420+0000","last_clean":"2024-09-21T00:14:15.967420+0000","last_became_active":"2024-09-21T00:14:09.975223+0000","last_became_peered":"2024-09-21T00:14:09.975223+0000","last_unstale":"2024-09-21T00:14:15.967420+0000","last_undegraded":"2024-09-21T00:14:15.967420+0000","last_fullsized":"2024-09-21T00:14:15.967420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:34.284952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500162+0000","last_change":"2024-09-21T00:14:09.955799+0000","last_active":"2024-09-21T00:14:15.500162+0000","last_peered":"2024-09-21T00:14:15.500162+0000","last_clean":"2024-09-21T00:14:15.500162+0000","last_became_active":"2024-09-21T00:14:09.955490+0000","last_became_peered":"2024-09-21T00:14:09.955490+0000","last_unstale":"2024-09-21T00:14:15.500162+0000","last_undegraded":"2024-09-21T00:14:15.500162+0000","last_fullsized":"2024-09-21T00:14:15.500162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:17.805417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966906+0000","last_change":"2024-09-21T00:14:09.967087+0000","last_active":"2024-09-21T00:14:15.966906+0000","last_peered":"2024-09-21T00:14:15.966906+0000","last_clean":"2024-09-21T00:14:15.966906+0000","last_became_active":"2024-09-21T00:14:09.966758+0000","last_became_peered":"2024-09-21T00:14:09.966758+0000","last_unstale":"2024-09-21T00:14:15.966906+0000","last_undegraded":"2024-09-21T00:14:15.966906+0000","last_fullsized":"2024-09-21T00:14:15.966906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:56.369574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122953+0000","last_change":"2024-09-21T00:14:09.959275+0000","last_active":"2024-09-21T00:14:16.122953+0000","last_peered":"2024-09-21T00:14:16.122953+0000","last_clean":"2024-09-21T00:14:16.122953+0000","last_became_active":"2024-09-21T00:14:09.956637+0000","last_became_peered":"2024-09-21T00:14:09.956637+0000","last_unstale":"2024-09-21T00:14:16.122953+0000","last_undegraded":"2024-09-21T00:14:16.122953+0000","last_fullsized":"2024-09-21T00:14:16.122953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:18.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978300+0000","last_change":"2024-09-21T00:14:09.966758+0000","last_active":"2024-09-21T00:14:14.978300+0000","last_peered":"2024-09-21T00:14:14.978300+0000","last_clean":"2024-09-21T00:14:14.978300+0000","last_became_active":"2024-09-21T00:14:09.966435+0000","last_became_peered":"2024-09-21T00:14:09.966435+0000","last_unstale":"2024-09-21T00:14:14.978300+0000","last_undegraded":"2024-09-21T00:14:14.978300+0000","last_fullsized":"2024-09-21T00:14:14.978300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:14.814291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122756+0000","last_change":"2024-09-21T00:14:09.970050+0000","last_active":"2024-09-21T00:14:16.122756+0000","last_peered":"2024-09-21T00:14:16.122756+0000","last_clean":"2024-09-21T00:14:16.122756+0000","last_became_active":"2024-09-21T00:14:09.969400+0000","last_became_peered":"2024-09-21T00:14:09.969400+0000","last_unstale":"2024-09-21T00:14:16.122756+0000","last_undegraded":"2024-09-21T00:14:16.122756+0000","last_fullsized":"2024-09-21T00:14:16.122756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:10.275524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501120+0000","last_change":"2024-09-21T00:14:09.967005+0000","last_active":"2024-09-21T00:14:15.501120+0000","last_peered":"2024-09-21T00:14:15.501120+0000","last_clean":"2024-09-21T00:14:15.501120+0000","last_became_active":"2024-09-21T00:14:09.966713+0000","last_became_peered":"2024-09-21T00:14:09.966713+0000","last_unstale":"2024-09-21T00:14:15.501120+0000","last_undegraded":"2024-09-21T00:14:15.501120+0000","last_fullsized":"2024-09-21T00:14:15.501120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:46.902750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978761+0000","last_change":"2024-09-21T00:14:09.963493+0000","last_active":"2024-09-21T00:14:14.978761+0000","last_peered":"2024-09-21T00:14:14.978761+0000","last_clean":"2024-09-21T00:14:14.978761+0000","last_became_active":"2024-09-21T00:14:09.963165+0000","last_became_peered":"2024-09-21T00:14:09.963165+0000","last_unstale":"2024-09-21T00:14:14.978761+0000","last_undegraded":"2024-09-21T00:14:14.978761+0000","last_fullsized":"2024-09-21T00:14:14.978761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501052+0000","last_change":"2024-09-21T00:14:09.958838+0000","last_active":"2024-09-21T00:14:15.501052+0000","last_peered":"2024-09-21T00:14:15.501052+0000","last_clean":"2024-09-21T00:14:15.501052+0000","last_became_active":"2024-09-21T00:14:09.958571+0000","last_became_peered":"2024-09-21T00:14:09.958571+0000","last_unstale":"2024-09-21T00:14:15.501052+0000","last_undegraded":"2024-09-21T00:14:15.501052+0000","last_fullsized":"2024-09-21T00:14:15.501052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:25.477700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500012+0000","last_change":"2024-09-21T00:14:09.966624+0000","last_active":"2024-09-21T00:14:15.500012+0000","last_peered":"2024-09-21T00:14:15.500012+0000","last_clean":"2024-09-21T00:14:15.500012+0000","last_became_active":"2024-09-21T00:14:09.966263+0000","last_became_peered":"2024-09-21T00:14:09.966263+0000","last_unstale":"2024-09-21T00:14:15.500012+0000","last_undegraded":"2024-09-21T00:14:15.500012+0000","last_fullsized":"2024-09-21T00:14:15.500012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:34.688163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966562+0000","last_change":"2024-09-21T00:14:09.968374+0000","last_active":"2024-09-21T00:14:15.966562+0000","last_peered":"2024-09-21T00:14:15.966562+0000","last_clean":"2024-09-21T00:14:15.966562+0000","last_became_active":"2024-09-21T00:14:09.966302+0000","last_became_peered":"2024-09-21T00:14:09.966302+0000","last_unstale":"2024-09-21T00:14:15.966562+0000","last_undegraded":"2024-09-21T00:14:15.966562+0000","last_fullsized":"2024-09-21T00:14:15.966562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:02.471950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122938+0000","last_change":"2024-09-21T00:14:09.957691+0000","last_active":"2024-09-21T00:14:16.122938+0000","last_peered":"2024-09-21T00:14:16.122938+0000","last_clean":"2024-09-21T00:14:16.122938+0000","last_became_active":"2024-09-21T00:14:09.957412+0000","last_became_peered":"2024-09-21T00:14:09.957412+0000","last_unstale":"2024-09-21T00:14:16.122938+0000","last_undegraded":"2024-09-21T00:14:16.122938+0000","last_fullsized":"2024-09-21T00:14:16.122938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.535510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123180+0000","last_change":"2024-09-21T00:14:09.975745+0000","last_active":"2024-09-21T00:14:16.123180+0000","last_peered":"2024-09-21T00:14:16.123180+0000","last_clean":"2024-09-21T00:14:16.123180+0000","last_became_active":"2024-09-21T00:14:09.975384+0000","last_became_peered":"2024-09-21T00:14:09.975384+0000","last_unstale":"2024-09-21T00:14:16.123180+0000","last_undegraded":"2024-09-21T00:14:16.123180+0000","last_fullsized":"2024-09-21T00:14:16.123180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:07.322051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123056+0000","last_change":"2024-09-21T00:14:09.969705+0000","last_active":"2024-09-21T00:14:16.123056+0000","last_peered":"2024-09-21T00:14:16.123056+0000","last_clean":"2024-09-21T00:14:16.123056+0000","last_became_active":"2024-09-21T00:14:09.969022+0000","last_became_peered":"2024-09-21T00:14:09.969022+0000","last_unstale":"2024-09-21T00:14:16.123056+0000","last_undegraded":"2024-09-21T00:14:16.123056+0000","last_fullsized":"2024-09-21T00:14:16.123056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:00.965737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123003+0000","last_change":"2024-09-21T00:14:09.967788+0000","last_active":"2024-09-21T00:14:16.123003+0000","last_peered":"2024-09-21T00:14:16.123003+0000","last_clean":"2024-09-21T00:14:16.123003+0000","last_became_active":"2024-09-21T00:14:09.967437+0000","last_became_peered":"2024-09-21T00:14:09.967437+0000","last_unstale":"2024-09-21T00:14:16.123003+0000","last_undegraded":"2024-09-21T00:14:16.123003+0000","last_fullsized":"2024-09-21T00:14:16.123003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:10.161637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122640+0000","last_change":"2024-09-21T00:14:09.964594+0000","last_active":"2024-09-21T00:14:16.122640+0000","last_peered":"2024-09-21T00:14:16.122640+0000","last_clean":"2024-09-21T00:14:16.122640+0000","last_became_active":"2024-09-21T00:14:09.964239+0000","last_became_peered":"2024-09-21T00:14:09.964239+0000","last_unstale":"2024-09-21T00:14:16.122640+0000","last_undegraded":"2024-09-21T00:14:16.122640+0000","last_fullsized":"2024-09-21T00:14:16.122640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:17.805417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123967+0000","last_change":"2024-09-21T00:14:09.970898+0000","last_active":"2024-09-21T00:14:16.123967+0000","last_peered":"2024-09-21T00:14:16.123967+0000","last_clean":"2024-09-21T00:14:16.123967+0000","last_became_active":"2024-09-21T00:14:09.970587+0000","last_became_peered":"2024-09-21T00:14:09.970587+0000","last_unstale":"2024-09-21T00:14:16.123967+0000","last_undegraded":"2024-09-21T00:14:16.123967+0000","last_fullsized":"2024-09-21T00:14:16.123967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966562+0000","last_change":"2024-09-21T00:14:09.967642+0000","last_active":"2024-09-21T00:14:15.966562+0000","last_peered":"2024-09-21T00:14:15.966562+0000","last_clean":"2024-09-21T00:14:15.966562+0000","last_became_active":"2024-09-21T00:14:09.967322+0000","last_became_peered":"2024-09-21T00:14:09.967322+0000","last_unstale":"2024-09-21T00:14:15.966562+0000","last_undegraded":"2024-09-21T00:14:15.966562+0000","last_fullsized":"2024-09-21T00:14:15.966562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:40.005906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122249+0000","last_change":"2024-09-21T00:14:09.953742+0000","last_active":"2024-09-21T00:14:16.122249+0000","last_peered":"2024-09-21T00:14:16.122249+0000","last_clean":"2024-09-21T00:14:16.122249+0000","last_became_active":"2024-09-21T00:14:09.953446+0000","last_became_peered":"2024-09-21T00:14:09.953446+0000","last_unstale":"2024-09-21T00:14:16.122249+0000","last_undegraded":"2024-09-21T00:14:16.122249+0000","last_fullsized":"2024-09-21T00:14:16.122249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:02:57.284191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973747+0000","last_change":"2024-09-21T00:14:09.955667+0000","last_active":"2024-09-21T00:14:14.973747+0000","last_peered":"2024-09-21T00:14:14.973747+0000","last_clean":"2024-09-21T00:14:14.973747+0000","last_became_active":"2024-09-21T00:14:09.955303+0000","last_became_peered":"2024-09-21T00:14:09.955303+0000","last_unstale":"2024-09-21T00:14:14.973747+0000","last_undegraded":"2024-09-21T00:14:14.973747+0000","last_fullsized":"2024-09-21T00:14:14.973747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122650+0000","last_change":"2024-09-21T00:14:09.964455+0000","last_active":"2024-09-21T00:14:16.122650+0000","last_peered":"2024-09-21T00:14:16.122650+0000","last_clean":"2024-09-21T00:14:16.122650+0000","last_became_active":"2024-09-21T00:14:09.964121+0000","last_became_peered":"2024-09-21T00:14:09.964121+0000","last_unstale":"2024-09-21T00:14:16.122650+0000","last_undegraded":"2024-09-21T00:14:16.122650+0000","last_fullsized":"2024-09-21T00:14:16.122650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:02.020147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973720+0000","last_change":"2024-09-21T00:14:09.944636+0000","last_active":"2024-09-21T00:14:14.973720+0000","last_peered":"2024-09-21T00:14:14.973720+0000","last_clean":"2024-09-21T00:14:14.973720+0000","last_became_active":"2024-09-21T00:14:09.944026+0000","last_became_peered":"2024-09-21T00:14:09.944026+0000","last_unstale":"2024-09-21T00:14:14.973720+0000","last_undegraded":"2024-09-21T00:14:14.973720+0000","last_fullsized":"2024-09-21T00:14:14.973720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.302969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967108+0000","last_change":"2024-09-21T00:14:09.969613+0000","last_active":"2024-09-21T00:14:15.967108+0000","last_peered":"2024-09-21T00:14:15.967108+0000","last_clean":"2024-09-21T00:14:15.967108+0000","last_became_active":"2024-09-21T00:14:09.969262+0000","last_became_peered":"2024-09-21T00:14:09.969262+0000","last_unstale":"2024-09-21T00:14:15.967108+0000","last_undegraded":"2024-09-21T00:14:15.967108+0000","last_fullsized":"2024-09-21T00:14:15.967108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:39.405316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967234+0000","last_change":"2024-09-21T00:14:09.960527+0000","last_active":"2024-09-21T00:14:15.967234+0000","last_peered":"2024-09-21T00:14:15.967234+0000","last_clean":"2024-09-21T00:14:15.967234+0000","last_became_active":"2024-09-21T00:14:09.960225+0000","last_became_peered":"2024-09-21T00:14:09.960225+0000","last_unstale":"2024-09-21T00:14:15.967234+0000","last_undegraded":"2024-09-21T00:14:15.967234+0000","last_fullsized":"2024-09-21T00:14:15.967234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:48.961824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123379+0000","last_change":"2024-09-21T00:14:09.977233+0000","last_active":"2024-09-21T00:14:16.123379+0000","last_peered":"2024-09-21T00:14:16.123379+0000","last_clean":"2024-09-21T00:14:16.123379+0000","last_became_active":"2024-09-21T00:14:09.968098+0000","last_became_peered":"2024-09-21T00:14:09.968098+0000","last_unstale":"2024-09-21T00:14:16.123379+0000","last_undegraded":"2024-09-21T00:14:16.123379+0000","last_fullsized":"2024-09-21T00:14:16.123379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:56:31.946410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:14:34.764 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:14:35.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.019+0000 7f359a800640 1 -- 172.21.15.83:0/2721393552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f359406e500 msgr2=0x7f35940cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.019+0000 7f359a800640 1 --2- 172.21.15.83:0/2721393552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f359406e500 0x7f35940cc020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f358c005fd0 tx=0x7f358c02a8b0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.019+0000 7f359a800640 1 -- 172.21.15.83:0/2721393552 shutdown_connections 2024-09-21T00:14:35.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.019+0000 7f359a800640 1 --2- 172.21.15.83:0/2721393552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f359406e500 0x7f35940cc020 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.019+0000 7f359a800640 1 --2- 172.21.15.83:0/2721393552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3594074cb0 0x7f3594073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.019+0000 7f359a800640 1 -- 172.21.15.83:0/2721393552 >> 172.21.15.83:0/2721393552 conn(0x7f35940cca40 msgr2=0x7f35940cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:35.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.019+0000 7f359a800640 1 -- 172.21.15.83:0/2721393552 shutdown_connections 2024-09-21T00:14:35.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.019+0000 7f359a800640 1 -- 172.21.15.83:0/2721393552 wait complete. 2024-09-21T00:14:35.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.022+0000 7f359a800640 1 Processor -- start 2024-09-21T00:14:35.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.022+0000 7f359a800640 1 -- start start 2024-09-21T00:14:35.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.023+0000 7f359a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3594074cb0 0x7f35941f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.023+0000 7f359a800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35940cbc10 0x7f3594158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.023+0000 7f359a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35940a0d80 0x7f35940a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.023+0000 7f359a800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f359406f360 con 0x7f35940cbc10 2024-09-21T00:14:35.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.023+0000 7f359a800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f359406f1e0 con 0x7f3594074cb0 2024-09-21T00:14:35.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.023+0000 7f359a800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f359406f4e0 con 0x7f35940a0d80 2024-09-21T00:14:35.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.023+0000 7f3592a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35940cbc10 0x7f3594158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f3592a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35940cbc10 0x7f3594158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37246/0 (socket says 172.21.15.83:37246) 2024-09-21T00:14:35.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f3592a00640 1 -- 172.21.15.83:0/2506618662 learned_addr learned my addr 172.21.15.83:0/2506618662 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:35.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f3593400640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3594074cb0 0x7f35941f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f3593e00640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35940a0d80 0x7f35940a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f3592a00640 1 -- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35940a0d80 msgr2=0x7f35940a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f3592a00640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35940a0d80 0x7f35940a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f3592a00640 1 -- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3594074cb0 msgr2=0x7f35941f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f3592a00640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3594074cb0 0x7f35941f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f3592a00640 1 -- 172.21.15.83:0/2506618662 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35941f5420 con 0x7f35940cbc10 2024-09-21T00:14:35.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f3592a00640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35940cbc10 0x7f3594158cd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f358000c3c0 tx=0x7f358000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:35.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.024+0000 7f358b400640 1 -- 172.21.15.83:0/2506618662 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580017070 con 0x7f35940cbc10 2024-09-21T00:14:35.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.025+0000 7f358b400640 1 -- 172.21.15.83:0/2506618662 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35800035f0 con 0x7f35940cbc10 2024-09-21T00:14:35.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.025+0000 7f359a800640 1 -- 172.21.15.83:0/2506618662 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35940cddb0 con 0x7f35940cbc10 2024-09-21T00:14:35.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.025+0000 7f358b400640 1 -- 172.21.15.83:0/2506618662 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580003a80 con 0x7f35940cbc10 2024-09-21T00:14:35.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.025+0000 7f359a800640 1 -- 172.21.15.83:0/2506618662 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3594157b40 con 0x7f35940cbc10 2024-09-21T00:14:35.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.026+0000 7f359a800640 1 -- 172.21.15.83:0/2506618662 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359406a780 con 0x7f35940cbc10 2024-09-21T00:14:35.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.027+0000 7f358b400640 1 -- 172.21.15.83:0/2506618662 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f358001a070 con 0x7f35940cbc10 2024-09-21T00:14:35.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.028+0000 7f358b400640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3574078b90 0x7f357407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.028+0000 7f358b400640 1 -- 172.21.15.83:0/2506618662 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f358009a320 con 0x7f35940cbc10 2024-09-21T00:14:35.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.028+0000 7f3593400640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3574078b90 0x7f357407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.029+0000 7f3593400640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3574078b90 0x7f357407b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f359415a730 tx=0x7f358400b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.033+0000 7f358b400640 1 -- 172.21.15.83:0/2506618662 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f359406a780 con 0x7f35940cbc10 2024-09-21T00:14:35.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.218+0000 7f359a800640 1 -- 172.21.15.83:0/2506618662 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f359406fa00 con 0x7f3574078b90 2024-09-21T00:14:35.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.224+0000 7f358b400640 1 -- 172.21.15.83:0/2506618662 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f359406fa00 con 0x7f3574078b90 2024-09-21T00:14:35.229 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:35.231 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:14:35.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 -- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3574078b90 msgr2=0x7f357407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3574078b90 0x7f357407b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f359415a730 tx=0x7f358400b2e0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 -- 172.21.15.83:0/2506618662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35940cbc10 msgr2=0x7f3594158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35940cbc10 0x7f3594158cd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f358000c3c0 tx=0x7f358000c880 comp rx=0 tx=0).stop 2024-09-21T00:14:35.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 -- 172.21.15.83:0/2506618662 shutdown_connections 2024-09-21T00:14:35.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3574078b90 0x7f357407b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35940a0d80 0x7f35940a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35940cbc10 0x7f3594158cd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 --2- 172.21.15.83:0/2506618662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3594074cb0 0x7f35941f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 -- 172.21.15.83:0/2506618662 >> 172.21.15.83:0/2506618662 conn(0x7f35940cca40 msgr2=0x7f35940b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:35.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 -- 172.21.15.83:0/2506618662 shutdown_connections 2024-09-21T00:14:35.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.229+0000 7f359a800640 1 -- 172.21.15.83:0/2506618662 wait complete. 2024-09-21T00:14:35.255 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-21T00:14:34.856331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219652,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755068,"statfs":{"total":773094113280,"available":772869189632,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004034"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979446+0000","last_change":"2024-09-21T00:14:08.955433+0000","last_active":"2024-09-21T00:14:14.979446+0000","last_peered":"2024-09-21T00:14:14.979446+0000","last_clean":"2024-09-21T00:14:14.979446+0000","last_became_active":"2024-09-21T00:14:08.955066+0000","last_became_peered":"2024-09-21T00:14:08.955066+0000","last_unstale":"2024-09-21T00:14:14.979446+0000","last_undegraded":"2024-09-21T00:14:14.979446+0000","last_fullsized":"2024-09-21T00:14:14.979446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:28.367381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967544+0000","last_change":"2024-09-21T00:14:09.966683+0000","last_active":"2024-09-21T00:14:15.967544+0000","last_peered":"2024-09-21T00:14:15.967544+0000","last_clean":"2024-09-21T00:14:15.967544+0000","last_became_active":"2024-09-21T00:14:09.966351+0000","last_became_peered":"2024-09-21T00:14:09.966351+0000","last_unstale":"2024-09-21T00:14:15.967544+0000","last_undegraded":"2024-09-21T00:14:15.967544+0000","last_fullsized":"2024-09-21T00:14:15.967544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:51.673086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977041+0000","last_change":"2024-09-21T00:14:14.002579+0000","last_active":"2024-09-21T00:14:14.977041+0000","last_peered":"2024-09-21T00:14:14.977041+0000","last_clean":"2024-09-21T00:14:14.977041+0000","last_became_active":"2024-09-21T00:14:13.998346+0000","last_became_peered":"2024-09-21T00:14:13.998346+0000","last_unstale":"2024-09-21T00:14:14.977041+0000","last_undegraded":"2024-09-21T00:14:14.977041+0000","last_fullsized":"2024-09-21T00:14:14.977041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:05.886343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967750+0000","last_change":"2024-09-21T00:14:08.969417+0000","last_active":"2024-09-21T00:14:15.967750+0000","last_peered":"2024-09-21T00:14:15.967750+0000","last_clean":"2024-09-21T00:14:15.967750+0000","last_became_active":"2024-09-21T00:14:08.969077+0000","last_became_peered":"2024-09-21T00:14:08.969077+0000","last_unstale":"2024-09-21T00:14:15.967750+0000","last_undegraded":"2024-09-21T00:14:15.967750+0000","last_fullsized":"2024-09-21T00:14:15.967750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:01.181700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967587+0000","last_change":"2024-09-21T00:14:09.975248+0000","last_active":"2024-09-21T00:14:15.967587+0000","last_peered":"2024-09-21T00:14:15.967587+0000","last_clean":"2024-09-21T00:14:15.967587+0000","last_became_active":"2024-09-21T00:14:09.974959+0000","last_became_peered":"2024-09-21T00:14:09.974959+0000","last_unstale":"2024-09-21T00:14:15.967587+0000","last_undegraded":"2024-09-21T00:14:15.967587+0000","last_fullsized":"2024-09-21T00:14:15.967587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:43.775786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973627+0000","last_change":"2024-09-21T00:14:14.001939+0000","last_active":"2024-09-21T00:14:14.973627+0000","last_peered":"2024-09-21T00:14:14.973627+0000","last_clean":"2024-09-21T00:14:14.973627+0000","last_became_active":"2024-09-21T00:14:14.001348+0000","last_became_peered":"2024-09-21T00:14:14.001348+0000","last_unstale":"2024-09-21T00:14:14.973627+0000","last_undegraded":"2024-09-21T00:14:14.973627+0000","last_fullsized":"2024-09-21T00:14:14.973627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:02.627970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123227+0000","last_change":"2024-09-21T00:14:08.964352+0000","last_active":"2024-09-21T00:14:16.123227+0000","last_peered":"2024-09-21T00:14:16.123227+0000","last_clean":"2024-09-21T00:14:16.123227+0000","last_became_active":"2024-09-21T00:14:08.958414+0000","last_became_peered":"2024-09-21T00:14:08.958414+0000","last_unstale":"2024-09-21T00:14:16.123227+0000","last_undegraded":"2024-09-21T00:14:16.123227+0000","last_fullsized":"2024-09-21T00:14:16.123227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:51.700187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123442+0000","last_change":"2024-09-21T00:14:09.962666+0000","last_active":"2024-09-21T00:14:16.123442+0000","last_peered":"2024-09-21T00:14:16.123442+0000","last_clean":"2024-09-21T00:14:16.123442+0000","last_became_active":"2024-09-21T00:14:09.961909+0000","last_became_peered":"2024-09-21T00:14:09.961909+0000","last_unstale":"2024-09-21T00:14:16.123442+0000","last_undegraded":"2024-09-21T00:14:16.123442+0000","last_fullsized":"2024-09-21T00:14:16.123442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:13.058730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974353+0000","last_change":"2024-09-21T00:14:14.009588+0000","last_active":"2024-09-21T00:14:14.974353+0000","last_peered":"2024-09-21T00:14:14.974353+0000","last_clean":"2024-09-21T00:14:14.974353+0000","last_became_active":"2024-09-21T00:14:14.008994+0000","last_became_peered":"2024-09-21T00:14:14.008994+0000","last_unstale":"2024-09-21T00:14:14.974353+0000","last_undegraded":"2024-09-21T00:14:14.974353+0000","last_fullsized":"2024-09-21T00:14:14.974353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:50.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122959+0000","last_change":"2024-09-21T00:14:08.962061+0000","last_active":"2024-09-21T00:14:16.122959+0000","last_peered":"2024-09-21T00:14:16.122959+0000","last_clean":"2024-09-21T00:14:16.122959+0000","last_became_active":"2024-09-21T00:14:08.961712+0000","last_became_peered":"2024-09-21T00:14:08.961712+0000","last_unstale":"2024-09-21T00:14:16.122959+0000","last_undegraded":"2024-09-21T00:14:16.122959+0000","last_fullsized":"2024-09-21T00:14:16.122959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:05:03.896547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500923+0000","last_change":"2024-09-21T00:14:09.957015+0000","last_active":"2024-09-21T00:14:15.500923+0000","last_peered":"2024-09-21T00:14:15.500923+0000","last_clean":"2024-09-21T00:14:15.500923+0000","last_became_active":"2024-09-21T00:14:09.956388+0000","last_became_peered":"2024-09-21T00:14:09.956388+0000","last_unstale":"2024-09-21T00:14:15.500923+0000","last_undegraded":"2024-09-21T00:14:15.500923+0000","last_fullsized":"2024-09-21T00:14:15.500923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:26.738282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973647+0000","last_change":"2024-09-21T00:14:14.004999+0000","last_active":"2024-09-21T00:14:14.973647+0000","last_peered":"2024-09-21T00:14:14.973647+0000","last_clean":"2024-09-21T00:14:14.973647+0000","last_became_active":"2024-09-21T00:14:14.003986+0000","last_became_peered":"2024-09-21T00:14:14.003986+0000","last_unstale":"2024-09-21T00:14:14.973647+0000","last_undegraded":"2024-09-21T00:14:14.973647+0000","last_fullsized":"2024-09-21T00:14:14.973647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:44.919521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500238+0000","last_change":"2024-09-21T00:14:09.955745+0000","last_active":"2024-09-21T00:14:15.500238+0000","last_peered":"2024-09-21T00:14:15.500238+0000","last_clean":"2024-09-21T00:14:15.500238+0000","last_became_active":"2024-09-21T00:14:09.954866+0000","last_became_peered":"2024-09-21T00:14:09.954866+0000","last_unstale":"2024-09-21T00:14:15.500238+0000","last_undegraded":"2024-09-21T00:14:15.500238+0000","last_fullsized":"2024-09-21T00:14:15.500238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:55.173826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500524+0000","last_change":"2024-09-21T00:14:08.962655+0000","last_active":"2024-09-21T00:14:15.500524+0000","last_peered":"2024-09-21T00:14:15.500524+0000","last_clean":"2024-09-21T00:14:15.500524+0000","last_became_active":"2024-09-21T00:14:08.962352+0000","last_became_peered":"2024-09-21T00:14:08.962352+0000","last_unstale":"2024-09-21T00:14:15.500524+0000","last_undegraded":"2024-09-21T00:14:15.500524+0000","last_fullsized":"2024-09-21T00:14:15.500524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:27.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500879+0000","last_change":"2024-09-21T00:14:14.006261+0000","last_active":"2024-09-21T00:14:15.500879+0000","last_peered":"2024-09-21T00:14:15.500879+0000","last_clean":"2024-09-21T00:14:15.500879+0000","last_became_active":"2024-09-21T00:14:14.003285+0000","last_became_peered":"2024-09-21T00:14:14.003285+0000","last_unstale":"2024-09-21T00:14:15.500879+0000","last_undegraded":"2024-09-21T00:14:15.500879+0000","last_fullsized":"2024-09-21T00:14:15.500879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:26.610299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977966+0000","last_change":"2024-09-21T00:14:09.955950+0000","last_active":"2024-09-21T00:14:14.977966+0000","last_peered":"2024-09-21T00:14:14.977966+0000","last_clean":"2024-09-21T00:14:14.977966+0000","last_became_active":"2024-09-21T00:14:09.953875+0000","last_became_peered":"2024-09-21T00:14:09.953875+0000","last_unstale":"2024-09-21T00:14:14.977966+0000","last_undegraded":"2024-09-21T00:14:14.977966+0000","last_fullsized":"2024-09-21T00:14:14.977966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123258+0000","last_change":"2024-09-21T00:14:08.969348+0000","last_active":"2024-09-21T00:14:16.123258+0000","last_peered":"2024-09-21T00:14:16.123258+0000","last_clean":"2024-09-21T00:14:16.123258+0000","last_became_active":"2024-09-21T00:14:08.969018+0000","last_became_peered":"2024-09-21T00:14:08.969018+0000","last_unstale":"2024-09-21T00:14:16.123258+0000","last_undegraded":"2024-09-21T00:14:16.123258+0000","last_fullsized":"2024-09-21T00:14:16.123258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:28.286333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122670+0000","last_change":"2024-09-21T00:14:13.994464+0000","last_active":"2024-09-21T00:14:16.122670+0000","last_peered":"2024-09-21T00:14:16.122670+0000","last_clean":"2024-09-21T00:14:16.122670+0000","last_became_active":"2024-09-21T00:14:13.993997+0000","last_became_peered":"2024-09-21T00:14:13.993997+0000","last_unstale":"2024-09-21T00:14:16.122670+0000","last_undegraded":"2024-09-21T00:14:16.122670+0000","last_fullsized":"2024-09-21T00:14:16.122670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:59.204344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977267+0000","last_change":"2024-09-21T00:14:09.944109+0000","last_active":"2024-09-21T00:14:14.977267+0000","last_peered":"2024-09-21T00:14:14.977267+0000","last_clean":"2024-09-21T00:14:14.977267+0000","last_became_active":"2024-09-21T00:14:09.943696+0000","last_became_peered":"2024-09-21T00:14:09.943696+0000","last_unstale":"2024-09-21T00:14:14.977267+0000","last_undegraded":"2024-09-21T00:14:14.977267+0000","last_fullsized":"2024-09-21T00:14:14.977267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:11.037361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978186+0000","last_change":"2024-09-21T00:14:08.952283+0000","last_active":"2024-09-21T00:14:14.978186+0000","last_peered":"2024-09-21T00:14:14.978186+0000","last_clean":"2024-09-21T00:14:14.978186+0000","last_became_active":"2024-09-21T00:14:08.951509+0000","last_became_peered":"2024-09-21T00:14:08.951509+0000","last_unstale":"2024-09-21T00:14:14.978186+0000","last_undegraded":"2024-09-21T00:14:14.978186+0000","last_fullsized":"2024-09-21T00:14:14.978186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:05.121425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979265+0000","last_change":"2024-09-21T00:14:14.009693+0000","last_active":"2024-09-21T00:14:14.979265+0000","last_peered":"2024-09-21T00:14:14.979265+0000","last_clean":"2024-09-21T00:14:14.979265+0000","last_became_active":"2024-09-21T00:14:14.009212+0000","last_became_peered":"2024-09-21T00:14:14.009212+0000","last_unstale":"2024-09-21T00:14:14.979265+0000","last_undegraded":"2024-09-21T00:14:14.979265+0000","last_fullsized":"2024-09-21T00:14:14.979265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:46.075015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500105+0000","last_change":"2024-09-21T00:14:09.952055+0000","last_active":"2024-09-21T00:14:15.500105+0000","last_peered":"2024-09-21T00:14:15.500105+0000","last_clean":"2024-09-21T00:14:15.500105+0000","last_became_active":"2024-09-21T00:14:09.951745+0000","last_became_peered":"2024-09-21T00:14:09.951745+0000","last_unstale":"2024-09-21T00:14:15.500105+0000","last_undegraded":"2024-09-21T00:14:15.500105+0000","last_fullsized":"2024-09-21T00:14:15.500105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:35.198862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.121996+0000","last_change":"2024-09-21T00:14:08.953140+0000","last_active":"2024-09-21T00:14:16.121996+0000","last_peered":"2024-09-21T00:14:16.121996+0000","last_clean":"2024-09-21T00:14:16.121996+0000","last_became_active":"2024-09-21T00:14:08.950002+0000","last_became_peered":"2024-09-21T00:14:08.950002+0000","last_unstale":"2024-09-21T00:14:16.121996+0000","last_undegraded":"2024-09-21T00:14:16.121996+0000","last_fullsized":"2024-09-21T00:14:16.121996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:05.121425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974140+0000","last_change":"2024-09-21T00:14:14.006167+0000","last_active":"2024-09-21T00:14:14.974140+0000","last_peered":"2024-09-21T00:14:14.974140+0000","last_clean":"2024-09-21T00:14:14.974140+0000","last_became_active":"2024-09-21T00:14:14.005001+0000","last_became_peered":"2024-09-21T00:14:14.005001+0000","last_unstale":"2024-09-21T00:14:14.974140+0000","last_undegraded":"2024-09-21T00:14:14.974140+0000","last_fullsized":"2024-09-21T00:14:14.974140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:57:27.249041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979047+0000","last_change":"2024-09-21T00:14:09.952929+0000","last_active":"2024-09-21T00:14:14.979047+0000","last_peered":"2024-09-21T00:14:14.979047+0000","last_clean":"2024-09-21T00:14:14.979047+0000","last_became_active":"2024-09-21T00:14:09.952574+0000","last_became_peered":"2024-09-21T00:14:09.952574+0000","last_unstale":"2024-09-21T00:14:14.979047+0000","last_undegraded":"2024-09-21T00:14:14.979047+0000","last_fullsized":"2024-09-21T00:14:14.979047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:02:57.284191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501092+0000","last_change":"2024-09-21T00:14:08.965568+0000","last_active":"2024-09-21T00:14:15.501092+0000","last_peered":"2024-09-21T00:14:15.501092+0000","last_clean":"2024-09-21T00:14:15.501092+0000","last_became_active":"2024-09-21T00:14:08.965239+0000","last_became_peered":"2024-09-21T00:14:08.965239+0000","last_unstale":"2024-09-21T00:14:15.501092+0000","last_undegraded":"2024-09-21T00:14:15.501092+0000","last_fullsized":"2024-09-21T00:14:15.501092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:00.848504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973649+0000","last_change":"2024-09-21T00:14:13.996979+0000","last_active":"2024-09-21T00:14:14.973649+0000","last_peered":"2024-09-21T00:14:14.973649+0000","last_clean":"2024-09-21T00:14:14.973649+0000","last_became_active":"2024-09-21T00:14:13.996457+0000","last_became_peered":"2024-09-21T00:14:13.996457+0000","last_unstale":"2024-09-21T00:14:14.973649+0000","last_undegraded":"2024-09-21T00:14:14.973649+0000","last_fullsized":"2024-09-21T00:14:14.973649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:14.192155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979358+0000","last_change":"2024-09-21T00:14:09.968623+0000","last_active":"2024-09-21T00:14:14.979358+0000","last_peered":"2024-09-21T00:14:14.979358+0000","last_clean":"2024-09-21T00:14:14.979358+0000","last_became_active":"2024-09-21T00:14:09.968243+0000","last_became_peered":"2024-09-21T00:14:09.968243+0000","last_unstale":"2024-09-21T00:14:14.979358+0000","last_undegraded":"2024-09-21T00:14:14.979358+0000","last_fullsized":"2024-09-21T00:14:14.979358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:54:02.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979198+0000","last_change":"2024-09-21T00:14:08.956965+0000","last_active":"2024-09-21T00:14:14.979198+0000","last_peered":"2024-09-21T00:14:14.979198+0000","last_clean":"2024-09-21T00:14:14.979198+0000","last_became_active":"2024-09-21T00:14:08.956594+0000","last_became_peered":"2024-09-21T00:14:08.956594+0000","last_unstale":"2024-09-21T00:14:14.979198+0000","last_undegraded":"2024-09-21T00:14:14.979198+0000","last_fullsized":"2024-09-21T00:14:14.979198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:51.700187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977217+0000","last_change":"2024-09-21T00:14:13.998452+0000","last_active":"2024-09-21T00:14:14.977217+0000","last_peered":"2024-09-21T00:14:14.977217+0000","last_clean":"2024-09-21T00:14:14.977217+0000","last_became_active":"2024-09-21T00:14:13.997896+0000","last_became_peered":"2024-09-21T00:14:13.997896+0000","last_unstale":"2024-09-21T00:14:14.977217+0000","last_undegraded":"2024-09-21T00:14:14.977217+0000","last_fullsized":"2024-09-21T00:14:14.977217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:06.050664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123575+0000","last_change":"2024-09-21T00:14:09.960305+0000","last_active":"2024-09-21T00:14:16.123575+0000","last_peered":"2024-09-21T00:14:16.123575+0000","last_clean":"2024-09-21T00:14:16.123575+0000","last_became_active":"2024-09-21T00:14:09.959991+0000","last_became_peered":"2024-09-21T00:14:09.959991+0000","last_unstale":"2024-09-21T00:14:16.123575+0000","last_undegraded":"2024-09-21T00:14:16.123575+0000","last_fullsized":"2024-09-21T00:14:16.123575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:01.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501177+0000","last_change":"2024-09-21T00:14:08.961047+0000","last_active":"2024-09-21T00:14:15.501177+0000","last_peered":"2024-09-21T00:14:15.501177+0000","last_clean":"2024-09-21T00:14:15.501177+0000","last_became_active":"2024-09-21T00:14:08.960716+0000","last_became_peered":"2024-09-21T00:14:08.960716+0000","last_unstale":"2024-09-21T00:14:15.501177+0000","last_undegraded":"2024-09-21T00:14:15.501177+0000","last_fullsized":"2024-09-21T00:14:15.501177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:06.314729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123221+0000","last_change":"2024-09-21T00:14:14.001333+0000","last_active":"2024-09-21T00:14:16.123221+0000","last_peered":"2024-09-21T00:14:16.123221+0000","last_clean":"2024-09-21T00:14:16.123221+0000","last_became_active":"2024-09-21T00:14:14.000838+0000","last_became_peered":"2024-09-21T00:14:14.000838+0000","last_unstale":"2024-09-21T00:14:16.123221+0000","last_undegraded":"2024-09-21T00:14:16.123221+0000","last_fullsized":"2024-09-21T00:14:16.123221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:04.996254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973835+0000","last_change":"2024-09-21T00:14:09.960278+0000","last_active":"2024-09-21T00:14:14.973835+0000","last_peered":"2024-09-21T00:14:14.973835+0000","last_clean":"2024-09-21T00:14:14.973835+0000","last_became_active":"2024-09-21T00:14:09.959949+0000","last_became_peered":"2024-09-21T00:14:09.959949+0000","last_unstale":"2024-09-21T00:14:14.973835+0000","last_undegraded":"2024-09-21T00:14:14.973835+0000","last_fullsized":"2024-09-21T00:14:14.973835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:09.105489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966906+0000","last_change":"2024-09-21T00:14:08.967871+0000","last_active":"2024-09-21T00:14:15.966906+0000","last_peered":"2024-09-21T00:14:15.966906+0000","last_clean":"2024-09-21T00:14:15.966906+0000","last_became_active":"2024-09-21T00:14:08.966840+0000","last_became_peered":"2024-09-21T00:14:08.966840+0000","last_unstale":"2024-09-21T00:14:15.966906+0000","last_undegraded":"2024-09-21T00:14:15.966906+0000","last_fullsized":"2024-09-21T00:14:15.966906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:12:50.931090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123068+0000","last_change":"2024-09-21T00:14:14.004129+0000","last_active":"2024-09-21T00:14:16.123068+0000","last_peered":"2024-09-21T00:14:16.123068+0000","last_clean":"2024-09-21T00:14:16.123068+0000","last_became_active":"2024-09-21T00:14:14.003631+0000","last_became_peered":"2024-09-21T00:14:14.003631+0000","last_unstale":"2024-09-21T00:14:16.123068+0000","last_undegraded":"2024-09-21T00:14:16.123068+0000","last_fullsized":"2024-09-21T00:14:16.123068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:31.535375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122448+0000","last_change":"2024-09-21T00:14:09.974665+0000","last_active":"2024-09-21T00:14:16.122448+0000","last_peered":"2024-09-21T00:14:16.122448+0000","last_clean":"2024-09-21T00:14:16.122448+0000","last_became_active":"2024-09-21T00:14:09.964253+0000","last_became_peered":"2024-09-21T00:14:09.964253+0000","last_unstale":"2024-09-21T00:14:16.122448+0000","last_undegraded":"2024-09-21T00:14:16.122448+0000","last_fullsized":"2024-09-21T00:14:16.122448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:40.707880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500462+0000","last_change":"2024-09-21T00:14:08.961331+0000","last_active":"2024-09-21T00:14:15.500462+0000","last_peered":"2024-09-21T00:14:15.500462+0000","last_clean":"2024-09-21T00:14:15.500462+0000","last_became_active":"2024-09-21T00:14:08.961064+0000","last_became_peered":"2024-09-21T00:14:08.961064+0000","last_unstale":"2024-09-21T00:14:15.500462+0000","last_undegraded":"2024-09-21T00:14:15.500462+0000","last_fullsized":"2024-09-21T00:14:15.500462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:09.528188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123408+0000","last_change":"2024-09-21T00:14:14.001325+0000","last_active":"2024-09-21T00:14:16.123408+0000","last_peered":"2024-09-21T00:14:16.123408+0000","last_clean":"2024-09-21T00:14:16.123408+0000","last_became_active":"2024-09-21T00:14:14.000838+0000","last_became_peered":"2024-09-21T00:14:14.000838+0000","last_unstale":"2024-09-21T00:14:16.123408+0000","last_undegraded":"2024-09-21T00:14:16.123408+0000","last_fullsized":"2024-09-21T00:14:16.123408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:14.306042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966733+0000","last_change":"2024-09-21T00:14:09.958391+0000","last_active":"2024-09-21T00:14:15.966733+0000","last_peered":"2024-09-21T00:14:15.966733+0000","last_clean":"2024-09-21T00:14:15.966733+0000","last_became_active":"2024-09-21T00:14:09.957844+0000","last_became_peered":"2024-09-21T00:14:09.957844+0000","last_unstale":"2024-09-21T00:14:15.966733+0000","last_undegraded":"2024-09-21T00:14:15.966733+0000","last_fullsized":"2024-09-21T00:14:15.966733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:30.770474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977238+0000","last_change":"2024-09-21T00:14:08.968128+0000","last_active":"2024-09-21T00:14:14.977238+0000","last_peered":"2024-09-21T00:14:14.977238+0000","last_clean":"2024-09-21T00:14:14.977238+0000","last_became_active":"2024-09-21T00:14:08.967257+0000","last_became_peered":"2024-09-21T00:14:08.967257+0000","last_unstale":"2024-09-21T00:14:14.977238+0000","last_undegraded":"2024-09-21T00:14:14.977238+0000","last_fullsized":"2024-09-21T00:14:14.977238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:03.075394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123840+0000","last_change":"2024-09-21T00:14:14.005119+0000","last_active":"2024-09-21T00:14:16.123840+0000","last_peered":"2024-09-21T00:14:16.123840+0000","last_clean":"2024-09-21T00:14:16.123840+0000","last_became_active":"2024-09-21T00:14:14.003742+0000","last_became_peered":"2024-09-21T00:14:14.003742+0000","last_unstale":"2024-09-21T00:14:16.123840+0000","last_undegraded":"2024-09-21T00:14:16.123840+0000","last_fullsized":"2024-09-21T00:14:16.123840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:06.050664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122838+0000","last_change":"2024-09-21T00:14:09.969231+0000","last_active":"2024-09-21T00:14:16.122838+0000","last_peered":"2024-09-21T00:14:16.122838+0000","last_clean":"2024-09-21T00:14:16.122838+0000","last_became_active":"2024-09-21T00:14:09.968567+0000","last_became_peered":"2024-09-21T00:14:09.968567+0000","last_unstale":"2024-09-21T00:14:16.122838+0000","last_undegraded":"2024-09-21T00:14:16.122838+0000","last_fullsized":"2024-09-21T00:14:16.122838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.302969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500274+0000","last_change":"2024-09-21T00:14:08.966891+0000","last_active":"2024-09-21T00:14:15.500274+0000","last_peered":"2024-09-21T00:14:15.500274+0000","last_clean":"2024-09-21T00:14:15.500274+0000","last_became_active":"2024-09-21T00:14:08.966521+0000","last_became_peered":"2024-09-21T00:14:08.966521+0000","last_unstale":"2024-09-21T00:14:15.500274+0000","last_undegraded":"2024-09-21T00:14:15.500274+0000","last_fullsized":"2024-09-21T00:14:15.500274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:17.687314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967312+0000","last_change":"2024-09-21T00:14:14.004905+0000","last_active":"2024-09-21T00:14:15.967312+0000","last_peered":"2024-09-21T00:14:15.967312+0000","last_clean":"2024-09-21T00:14:15.967312+0000","last_became_active":"2024-09-21T00:14:14.002340+0000","last_became_peered":"2024-09-21T00:14:14.002340+0000","last_unstale":"2024-09-21T00:14:15.967312+0000","last_undegraded":"2024-09-21T00:14:15.967312+0000","last_fullsized":"2024-09-21T00:14:15.967312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:46.951215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977585+0000","last_change":"2024-09-21T00:14:09.944543+0000","last_active":"2024-09-21T00:14:14.977585+0000","last_peered":"2024-09-21T00:14:14.977585+0000","last_clean":"2024-09-21T00:14:14.977585+0000","last_became_active":"2024-09-21T00:14:09.944211+0000","last_became_peered":"2024-09-21T00:14:09.944211+0000","last_unstale":"2024-09-21T00:14:14.977585+0000","last_undegraded":"2024-09-21T00:14:14.977585+0000","last_fullsized":"2024-09-21T00:14:14.977585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:26.273280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500607+0000","last_change":"2024-09-21T00:14:08.963265+0000","last_active":"2024-09-21T00:14:15.500607+0000","last_peered":"2024-09-21T00:14:15.500607+0000","last_clean":"2024-09-21T00:14:15.500607+0000","last_became_active":"2024-09-21T00:14:08.961984+0000","last_became_peered":"2024-09-21T00:14:08.961984+0000","last_unstale":"2024-09-21T00:14:15.500607+0000","last_undegraded":"2024-09-21T00:14:15.500607+0000","last_fullsized":"2024-09-21T00:14:15.500607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:23.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122745+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:14:16.122745+0000","last_peered":"2024-09-21T00:14:16.122745+0000","last_clean":"2024-09-21T00:14:16.122745+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:14:16.122745+0000","last_undegraded":"2024-09-21T00:14:16.122745+0000","last_fullsized":"2024-09-21T00:14:16.122745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501135+0000","last_change":"2024-09-21T00:14:13.987888+0000","last_active":"2024-09-21T00:14:15.501135+0000","last_peered":"2024-09-21T00:14:15.501135+0000","last_clean":"2024-09-21T00:14:15.501135+0000","last_became_active":"2024-09-21T00:14:13.987371+0000","last_became_peered":"2024-09-21T00:14:13.987371+0000","last_unstale":"2024-09-21T00:14:15.501135+0000","last_undegraded":"2024-09-21T00:14:15.501135+0000","last_fullsized":"2024-09-21T00:14:15.501135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:13.662595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500986+0000","last_change":"2024-09-21T00:14:09.976122+0000","last_active":"2024-09-21T00:14:15.500986+0000","last_peered":"2024-09-21T00:14:15.500986+0000","last_clean":"2024-09-21T00:14:15.500986+0000","last_became_active":"2024-09-21T00:14:09.975763+0000","last_became_peered":"2024-09-21T00:14:09.975763+0000","last_unstale":"2024-09-21T00:14:15.500986+0000","last_undegraded":"2024-09-21T00:14:15.500986+0000","last_fullsized":"2024-09-21T00:14:15.500986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:58.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123695+0000","last_change":"2024-09-21T00:14:08.965532+0000","last_active":"2024-09-21T00:14:16.123695+0000","last_peered":"2024-09-21T00:14:16.123695+0000","last_clean":"2024-09-21T00:14:16.123695+0000","last_became_active":"2024-09-21T00:14:08.965203+0000","last_became_peered":"2024-09-21T00:14:08.965203+0000","last_unstale":"2024-09-21T00:14:16.123695+0000","last_undegraded":"2024-09-21T00:14:16.123695+0000","last_fullsized":"2024-09-21T00:14:16.123695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:43:28.609507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973635+0000","last_change":"2024-09-21T00:14:14.010029+0000","last_active":"2024-09-21T00:14:14.973635+0000","last_peered":"2024-09-21T00:14:14.973635+0000","last_clean":"2024-09-21T00:14:14.973635+0000","last_became_active":"2024-09-21T00:14:14.009543+0000","last_became_peered":"2024-09-21T00:14:14.009543+0000","last_unstale":"2024-09-21T00:14:14.973635+0000","last_undegraded":"2024-09-21T00:14:14.973635+0000","last_fullsized":"2024-09-21T00:14:14.973635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:44.738397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122862+0000","last_change":"2024-09-21T00:14:09.956902+0000","last_active":"2024-09-21T00:14:16.122862+0000","last_peered":"2024-09-21T00:14:16.122862+0000","last_clean":"2024-09-21T00:14:16.122862+0000","last_became_active":"2024-09-21T00:14:09.956598+0000","last_became_peered":"2024-09-21T00:14:09.956598+0000","last_unstale":"2024-09-21T00:14:16.122862+0000","last_undegraded":"2024-09-21T00:14:16.122862+0000","last_fullsized":"2024-09-21T00:14:16.122862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:33.085847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967274+0000","last_change":"2024-09-21T00:14:08.960165+0000","last_active":"2024-09-21T00:14:15.967274+0000","last_peered":"2024-09-21T00:14:15.967274+0000","last_clean":"2024-09-21T00:14:15.967274+0000","last_became_active":"2024-09-21T00:14:08.959384+0000","last_became_peered":"2024-09-21T00:14:08.959384+0000","last_unstale":"2024-09-21T00:14:15.967274+0000","last_undegraded":"2024-09-21T00:14:15.967274+0000","last_fullsized":"2024-09-21T00:14:15.967274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:45.898250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967161+0000","last_change":"2024-09-21T00:14:13.991452+0000","last_active":"2024-09-21T00:14:15.967161+0000","last_peered":"2024-09-21T00:14:15.967161+0000","last_clean":"2024-09-21T00:14:15.967161+0000","last_became_active":"2024-09-21T00:14:13.991104+0000","last_became_peered":"2024-09-21T00:14:13.991104+0000","last_unstale":"2024-09-21T00:14:15.967161+0000","last_undegraded":"2024-09-21T00:14:15.967161+0000","last_fullsized":"2024-09-21T00:14:15.967161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:13.243815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123422+0000","last_change":"2024-09-21T00:14:09.965731+0000","last_active":"2024-09-21T00:14:16.123422+0000","last_peered":"2024-09-21T00:14:16.123422+0000","last_clean":"2024-09-21T00:14:16.123422+0000","last_became_active":"2024-09-21T00:14:09.965441+0000","last_became_peered":"2024-09-21T00:14:09.965441+0000","last_unstale":"2024-09-21T00:14:16.123422+0000","last_undegraded":"2024-09-21T00:14:16.123422+0000","last_fullsized":"2024-09-21T00:14:16.123422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:30.235970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979154+0000","last_change":"2024-09-21T00:14:08.956670+0000","last_active":"2024-09-21T00:14:14.979154+0000","last_peered":"2024-09-21T00:14:14.979154+0000","last_clean":"2024-09-21T00:14:14.979154+0000","last_became_active":"2024-09-21T00:14:08.955944+0000","last_became_peered":"2024-09-21T00:14:08.955944+0000","last_unstale":"2024-09-21T00:14:14.979154+0000","last_undegraded":"2024-09-21T00:14:14.979154+0000","last_fullsized":"2024-09-21T00:14:14.979154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:27.091939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500018+0000","last_change":"2024-09-21T00:14:13.993587+0000","last_active":"2024-09-21T00:14:15.500018+0000","last_peered":"2024-09-21T00:14:15.500018+0000","last_clean":"2024-09-21T00:14:15.500018+0000","last_became_active":"2024-09-21T00:14:13.993154+0000","last_became_peered":"2024-09-21T00:14:13.993154+0000","last_unstale":"2024-09-21T00:14:15.500018+0000","last_undegraded":"2024-09-21T00:14:15.500018+0000","last_fullsized":"2024-09-21T00:14:15.500018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:10.903336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974186+0000","last_change":"2024-09-21T00:14:09.956980+0000","last_active":"2024-09-21T00:14:14.974186+0000","last_peered":"2024-09-21T00:14:14.974186+0000","last_clean":"2024-09-21T00:14:14.974186+0000","last_became_active":"2024-09-21T00:14:09.956663+0000","last_became_peered":"2024-09-21T00:14:09.956663+0000","last_unstale":"2024-09-21T00:14:14.974186+0000","last_undegraded":"2024-09-21T00:14:14.974186+0000","last_fullsized":"2024-09-21T00:14:14.974186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.535510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123436+0000","last_change":"2024-09-21T00:14:08.962950+0000","last_active":"2024-09-21T00:14:16.123436+0000","last_peered":"2024-09-21T00:14:16.123436+0000","last_clean":"2024-09-21T00:14:16.123436+0000","last_became_active":"2024-09-21T00:14:08.962106+0000","last_became_peered":"2024-09-21T00:14:08.962106+0000","last_unstale":"2024-09-21T00:14:16.123436+0000","last_undegraded":"2024-09-21T00:14:16.123436+0000","last_fullsized":"2024-09-21T00:14:16.123436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:28.367381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123232+0000","last_change":"2024-09-21T00:14:13.998520+0000","last_active":"2024-09-21T00:14:16.123232+0000","last_peered":"2024-09-21T00:14:16.123232+0000","last_clean":"2024-09-21T00:14:16.123232+0000","last_became_active":"2024-09-21T00:14:13.998102+0000","last_became_peered":"2024-09-21T00:14:13.998102+0000","last_unstale":"2024-09-21T00:14:16.123232+0000","last_undegraded":"2024-09-21T00:14:16.123232+0000","last_fullsized":"2024-09-21T00:14:16.123232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:35.968823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500013+0000","last_change":"2024-09-21T00:14:09.971253+0000","last_active":"2024-09-21T00:14:15.500013+0000","last_peered":"2024-09-21T00:14:15.500013+0000","last_clean":"2024-09-21T00:14:15.500013+0000","last_became_active":"2024-09-21T00:14:09.966337+0000","last_became_peered":"2024-09-21T00:14:09.966337+0000","last_unstale":"2024-09-21T00:14:15.500013+0000","last_undegraded":"2024-09-21T00:14:15.500013+0000","last_fullsized":"2024-09-21T00:14:15.500013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:30.235970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977345+0000","last_change":"2024-09-21T00:14:08.956648+0000","last_active":"2024-09-21T00:14:14.977345+0000","last_peered":"2024-09-21T00:14:14.977345+0000","last_clean":"2024-09-21T00:14:14.977345+0000","last_became_active":"2024-09-21T00:14:08.956242+0000","last_became_peered":"2024-09-21T00:14:08.956242+0000","last_unstale":"2024-09-21T00:14:14.977345+0000","last_undegraded":"2024-09-21T00:14:14.977345+0000","last_fullsized":"2024-09-21T00:14:14.977345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:51:44.198197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967515+0000","last_change":"2024-09-21T00:14:14.010023+0000","last_active":"2024-09-21T00:14:15.967515+0000","last_peered":"2024-09-21T00:14:15.967515+0000","last_clean":"2024-09-21T00:14:15.967515+0000","last_became_active":"2024-09-21T00:14:14.009295+0000","last_became_peered":"2024-09-21T00:14:14.009295+0000","last_unstale":"2024-09-21T00:14:15.967515+0000","last_undegraded":"2024-09-21T00:14:15.967515+0000","last_fullsized":"2024-09-21T00:14:15.967515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:45.380314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122633+0000","last_change":"2024-09-21T00:14:09.958927+0000","last_active":"2024-09-21T00:14:16.122633+0000","last_peered":"2024-09-21T00:14:16.122633+0000","last_clean":"2024-09-21T00:14:16.122633+0000","last_became_active":"2024-09-21T00:14:09.958618+0000","last_became_peered":"2024-09-21T00:14:09.958618+0000","last_unstale":"2024-09-21T00:14:16.122633+0000","last_undegraded":"2024-09-21T00:14:16.122633+0000","last_fullsized":"2024-09-21T00:14:16.122633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122261+0000","last_change":"2024-09-21T00:14:08.962483+0000","last_active":"2024-09-21T00:14:16.122261+0000","last_peered":"2024-09-21T00:14:16.122261+0000","last_clean":"2024-09-21T00:14:16.122261+0000","last_became_active":"2024-09-21T00:14:08.961970+0000","last_became_peered":"2024-09-21T00:14:08.961970+0000","last_unstale":"2024-09-21T00:14:16.122261+0000","last_undegraded":"2024-09-21T00:14:16.122261+0000","last_fullsized":"2024-09-21T00:14:16.122261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:27.091939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967654+0000","last_change":"2024-09-21T00:14:13.994820+0000","last_active":"2024-09-21T00:14:15.967654+0000","last_peered":"2024-09-21T00:14:15.967654+0000","last_clean":"2024-09-21T00:14:15.967654+0000","last_became_active":"2024-09-21T00:14:13.994201+0000","last_became_peered":"2024-09-21T00:14:13.994201+0000","last_unstale":"2024-09-21T00:14:15.967654+0000","last_undegraded":"2024-09-21T00:14:15.967654+0000","last_fullsized":"2024-09-21T00:14:15.967654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.660541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500240+0000","last_change":"2024-09-21T00:14:09.954424+0000","last_active":"2024-09-21T00:14:15.500240+0000","last_peered":"2024-09-21T00:14:15.500240+0000","last_clean":"2024-09-21T00:14:15.500240+0000","last_became_active":"2024-09-21T00:14:09.953451+0000","last_became_peered":"2024-09-21T00:14:09.953451+0000","last_unstale":"2024-09-21T00:14:15.500240+0000","last_undegraded":"2024-09-21T00:14:15.500240+0000","last_fullsized":"2024-09-21T00:14:15.500240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:02.131667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500383+0000","last_change":"2024-09-21T00:14:08.955470+0000","last_active":"2024-09-21T00:14:15.500383+0000","last_peered":"2024-09-21T00:14:15.500383+0000","last_clean":"2024-09-21T00:14:15.500383+0000","last_became_active":"2024-09-21T00:14:08.952599+0000","last_became_peered":"2024-09-21T00:14:08.952599+0000","last_unstale":"2024-09-21T00:14:15.500383+0000","last_undegraded":"2024-09-21T00:14:15.500383+0000","last_fullsized":"2024-09-21T00:14:15.500383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:16.644911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123459+0000","last_change":"2024-09-21T00:14:14.004819+0000","last_active":"2024-09-21T00:14:16.123459+0000","last_peered":"2024-09-21T00:14:16.123459+0000","last_clean":"2024-09-21T00:14:16.123459+0000","last_became_active":"2024-09-21T00:14:14.003284+0000","last_became_peered":"2024-09-21T00:14:14.003284+0000","last_unstale":"2024-09-21T00:14:16.123459+0000","last_undegraded":"2024-09-21T00:14:16.123459+0000","last_fullsized":"2024-09-21T00:14:16.123459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:56:35.976927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123069+0000","last_change":"2024-09-21T00:14:09.966769+0000","last_active":"2024-09-21T00:14:16.123069+0000","last_peered":"2024-09-21T00:14:16.123069+0000","last_clean":"2024-09-21T00:14:16.123069+0000","last_became_active":"2024-09-21T00:14:09.966448+0000","last_became_peered":"2024-09-21T00:14:09.966448+0000","last_unstale":"2024-09-21T00:14:16.123069+0000","last_undegraded":"2024-09-21T00:14:16.123069+0000","last_fullsized":"2024-09-21T00:14:16.123069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978213+0000","last_change":"2024-09-21T00:14:08.967528+0000","last_active":"2024-09-21T00:14:14.978213+0000","last_peered":"2024-09-21T00:14:14.978213+0000","last_clean":"2024-09-21T00:14:14.978213+0000","last_became_active":"2024-09-21T00:14:08.966897+0000","last_became_peered":"2024-09-21T00:14:08.966897+0000","last_unstale":"2024-09-21T00:14:14.978213+0000","last_undegraded":"2024-09-21T00:14:14.978213+0000","last_fullsized":"2024-09-21T00:14:14.978213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:51:44.198197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501045+0000","last_change":"2024-09-21T00:14:13.989994+0000","last_active":"2024-09-21T00:14:15.501045+0000","last_peered":"2024-09-21T00:14:15.501045+0000","last_clean":"2024-09-21T00:14:15.501045+0000","last_became_active":"2024-09-21T00:14:13.989524+0000","last_became_peered":"2024-09-21T00:14:13.989524+0000","last_unstale":"2024-09-21T00:14:15.501045+0000","last_undegraded":"2024-09-21T00:14:15.501045+0000","last_fullsized":"2024-09-21T00:14:15.501045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:45.169356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123101+0000","last_change":"2024-09-21T00:14:09.955385+0000","last_active":"2024-09-21T00:14:16.123101+0000","last_peered":"2024-09-21T00:14:16.123101+0000","last_clean":"2024-09-21T00:14:16.123101+0000","last_became_active":"2024-09-21T00:14:09.955031+0000","last_became_peered":"2024-09-21T00:14:09.955031+0000","last_unstale":"2024-09-21T00:14:16.123101+0000","last_undegraded":"2024-09-21T00:14:16.123101+0000","last_fullsized":"2024-09-21T00:14:16.123101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:27.504857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:22.928007+0000","last_change":"2024-09-21T00:14:08.950520+0000","last_active":"2024-09-21T00:14:22.928007+0000","last_peered":"2024-09-21T00:14:22.928007+0000","last_clean":"2024-09-21T00:14:22.928007+0000","last_became_active":"2024-09-21T00:14:08.950052+0000","last_became_peered":"2024-09-21T00:14:08.950052+0000","last_unstale":"2024-09-21T00:14:22.928007+0000","last_undegraded":"2024-09-21T00:14:22.928007+0000","last_fullsized":"2024-09-21T00:14:22.928007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:03.572976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977762+0000","last_change":"2024-09-21T00:14:13.991051+0000","last_active":"2024-09-21T00:14:14.977762+0000","last_peered":"2024-09-21T00:14:14.977762+0000","last_clean":"2024-09-21T00:14:14.977762+0000","last_became_active":"2024-09-21T00:14:13.990544+0000","last_became_peered":"2024-09-21T00:14:13.990544+0000","last_unstale":"2024-09-21T00:14:14.977762+0000","last_undegraded":"2024-09-21T00:14:14.977762+0000","last_fullsized":"2024-09-21T00:14:14.977762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:21.835935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500587+0000","last_change":"2024-09-21T00:14:09.967875+0000","last_active":"2024-09-21T00:14:15.500587+0000","last_peered":"2024-09-21T00:14:15.500587+0000","last_clean":"2024-09-21T00:14:15.500587+0000","last_became_active":"2024-09-21T00:14:09.966515+0000","last_became_peered":"2024-09-21T00:14:09.966515+0000","last_unstale":"2024-09-21T00:14:15.500587+0000","last_undegraded":"2024-09-21T00:14:15.500587+0000","last_fullsized":"2024-09-21T00:14:15.500587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:18:31.266375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978569+0000","last_change":"2024-09-21T00:14:08.963443+0000","last_active":"2024-09-21T00:14:14.978569+0000","last_peered":"2024-09-21T00:14:14.978569+0000","last_clean":"2024-09-21T00:14:14.978569+0000","last_became_active":"2024-09-21T00:14:08.963001+0000","last_became_peered":"2024-09-21T00:14:08.963001+0000","last_unstale":"2024-09-21T00:14:14.978569+0000","last_undegraded":"2024-09-21T00:14:14.978569+0000","last_fullsized":"2024-09-21T00:14:14.978569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:38.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974431+0000","last_change":"2024-09-21T00:14:14.004423+0000","last_active":"2024-09-21T00:14:14.974431+0000","last_peered":"2024-09-21T00:14:14.974431+0000","last_clean":"2024-09-21T00:14:14.974431+0000","last_became_active":"2024-09-21T00:14:14.003993+0000","last_became_peered":"2024-09-21T00:14:14.003993+0000","last_unstale":"2024-09-21T00:14:14.974431+0000","last_undegraded":"2024-09-21T00:14:14.974431+0000","last_fullsized":"2024-09-21T00:14:14.974431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:07:20.224751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967722+0000","last_change":"2024-09-21T00:14:09.971797+0000","last_active":"2024-09-21T00:14:15.967722+0000","last_peered":"2024-09-21T00:14:15.967722+0000","last_clean":"2024-09-21T00:14:15.967722+0000","last_became_active":"2024-09-21T00:14:09.971424+0000","last_became_peered":"2024-09-21T00:14:09.971424+0000","last_unstale":"2024-09-21T00:14:15.967722+0000","last_undegraded":"2024-09-21T00:14:15.967722+0000","last_fullsized":"2024-09-21T00:14:15.967722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:26.244909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122745+0000","last_change":"2024-09-21T00:14:08.946131+0000","last_active":"2024-09-21T00:14:16.122745+0000","last_peered":"2024-09-21T00:14:16.122745+0000","last_clean":"2024-09-21T00:14:16.122745+0000","last_became_active":"2024-09-21T00:14:08.945798+0000","last_became_peered":"2024-09-21T00:14:08.945798+0000","last_unstale":"2024-09-21T00:14:16.122745+0000","last_undegraded":"2024-09-21T00:14:16.122745+0000","last_fullsized":"2024-09-21T00:14:16.122745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:19.481209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.976886+0000","last_change":"2024-09-21T00:14:14.009826+0000","last_active":"2024-09-21T00:14:14.976886+0000","last_peered":"2024-09-21T00:14:14.976886+0000","last_clean":"2024-09-21T00:14:14.976886+0000","last_became_active":"2024-09-21T00:14:14.009239+0000","last_became_peered":"2024-09-21T00:14:14.009239+0000","last_unstale":"2024-09-21T00:14:14.976886+0000","last_undegraded":"2024-09-21T00:14:14.976886+0000","last_fullsized":"2024-09-21T00:14:14.976886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:11.352568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.974080+0000","last_change":"2024-09-21T00:14:09.961500+0000","last_active":"2024-09-21T00:14:14.974080+0000","last_peered":"2024-09-21T00:14:14.974080+0000","last_clean":"2024-09-21T00:14:14.974080+0000","last_became_active":"2024-09-21T00:14:09.960752+0000","last_became_peered":"2024-09-21T00:14:09.960752+0000","last_unstale":"2024-09-21T00:14:14.974080+0000","last_undegraded":"2024-09-21T00:14:14.974080+0000","last_fullsized":"2024-09-21T00:14:14.974080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123962+0000","last_change":"2024-09-21T00:14:08.951923+0000","last_active":"2024-09-21T00:14:16.123962+0000","last_peered":"2024-09-21T00:14:16.123962+0000","last_clean":"2024-09-21T00:14:16.123962+0000","last_became_active":"2024-09-21T00:14:08.947804+0000","last_became_peered":"2024-09-21T00:14:08.947804+0000","last_unstale":"2024-09-21T00:14:16.123962+0000","last_undegraded":"2024-09-21T00:14:16.123962+0000","last_fullsized":"2024-09-21T00:14:16.123962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:28.286333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977974+0000","last_change":"2024-09-21T00:14:13.997051+0000","last_active":"2024-09-21T00:14:14.977974+0000","last_peered":"2024-09-21T00:14:14.977974+0000","last_clean":"2024-09-21T00:14:14.977974+0000","last_became_active":"2024-09-21T00:14:13.996692+0000","last_became_peered":"2024-09-21T00:14:13.996692+0000","last_unstale":"2024-09-21T00:14:14.977974+0000","last_undegraded":"2024-09-21T00:14:14.977974+0000","last_fullsized":"2024-09-21T00:14:14.977974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:37.116365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.979061+0000","last_change":"2024-09-21T00:14:13.993380+0000","last_active":"2024-09-21T00:14:14.979061+0000","last_peered":"2024-09-21T00:14:14.979061+0000","last_clean":"2024-09-21T00:14:14.979061+0000","last_became_active":"2024-09-21T00:14:13.992819+0000","last_became_peered":"2024-09-21T00:14:13.992819+0000","last_unstale":"2024-09-21T00:14:14.979061+0000","last_undegraded":"2024-09-21T00:14:14.979061+0000","last_fullsized":"2024-09-21T00:14:14.979061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.855429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978052+0000","last_change":"2024-09-21T00:14:09.962777+0000","last_active":"2024-09-21T00:14:14.978052+0000","last_peered":"2024-09-21T00:14:14.978052+0000","last_clean":"2024-09-21T00:14:14.978052+0000","last_became_active":"2024-09-21T00:14:09.962489+0000","last_became_peered":"2024-09-21T00:14:09.962489+0000","last_unstale":"2024-09-21T00:14:14.978052+0000","last_undegraded":"2024-09-21T00:14:14.978052+0000","last_fullsized":"2024-09-21T00:14:14.978052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:21.354918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500237+0000","last_change":"2024-09-21T00:14:08.955114+0000","last_active":"2024-09-21T00:14:15.500237+0000","last_peered":"2024-09-21T00:14:15.500237+0000","last_clean":"2024-09-21T00:14:15.500237+0000","last_became_active":"2024-09-21T00:14:08.954028+0000","last_became_peered":"2024-09-21T00:14:08.954028+0000","last_unstale":"2024-09-21T00:14:15.500237+0000","last_undegraded":"2024-09-21T00:14:15.500237+0000","last_fullsized":"2024-09-21T00:14:15.500237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:19.481209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500943+0000","last_change":"2024-09-21T00:14:13.993411+0000","last_active":"2024-09-21T00:14:15.500943+0000","last_peered":"2024-09-21T00:14:15.500943+0000","last_clean":"2024-09-21T00:14:15.500943+0000","last_became_active":"2024-09-21T00:14:13.992997+0000","last_became_peered":"2024-09-21T00:14:13.992997+0000","last_unstale":"2024-09-21T00:14:15.500943+0000","last_undegraded":"2024-09-21T00:14:15.500943+0000","last_fullsized":"2024-09-21T00:14:15.500943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:22.418960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967109+0000","last_change":"2024-09-21T00:14:09.962686+0000","last_active":"2024-09-21T00:14:15.967109+0000","last_peered":"2024-09-21T00:14:15.967109+0000","last_clean":"2024-09-21T00:14:15.967109+0000","last_became_active":"2024-09-21T00:14:09.961140+0000","last_became_peered":"2024-09-21T00:14:09.961140+0000","last_unstale":"2024-09-21T00:14:15.967109+0000","last_undegraded":"2024-09-21T00:14:15.967109+0000","last_fullsized":"2024-09-21T00:14:15.967109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:30.146682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122851+0000","last_change":"2024-09-21T00:14:08.961705+0000","last_active":"2024-09-21T00:14:16.122851+0000","last_peered":"2024-09-21T00:14:16.122851+0000","last_clean":"2024-09-21T00:14:16.122851+0000","last_became_active":"2024-09-21T00:14:08.961362+0000","last_became_peered":"2024-09-21T00:14:08.961362+0000","last_unstale":"2024-09-21T00:14:16.122851+0000","last_undegraded":"2024-09-21T00:14:16.122851+0000","last_fullsized":"2024-09-21T00:14:16.122851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:17.677016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500354+0000","last_change":"2024-09-21T00:14:08.967458+0000","last_active":"2024-09-21T00:14:15.500354+0000","last_peered":"2024-09-21T00:14:15.500354+0000","last_clean":"2024-09-21T00:14:15.500354+0000","last_became_active":"2024-09-21T00:14:08.966663+0000","last_became_peered":"2024-09-21T00:14:08.966663+0000","last_unstale":"2024-09-21T00:14:15.500354+0000","last_undegraded":"2024-09-21T00:14:15.500354+0000","last_fullsized":"2024-09-21T00:14:15.500354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:12.051409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978414+0000","last_change":"2024-09-21T00:14:09.955928+0000","last_active":"2024-09-21T00:14:14.978414+0000","last_peered":"2024-09-21T00:14:14.978414+0000","last_clean":"2024-09-21T00:14:14.978414+0000","last_became_active":"2024-09-21T00:14:09.955523+0000","last_became_peered":"2024-09-21T00:14:09.955523+0000","last_unstale":"2024-09-21T00:14:14.978414+0000","last_undegraded":"2024-09-21T00:14:14.978414+0000","last_fullsized":"2024-09-21T00:14:14.978414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:16.513288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978979+0000","last_change":"2024-09-21T00:14:14.003528+0000","last_active":"2024-09-21T00:14:14.978979+0000","last_peered":"2024-09-21T00:14:14.978979+0000","last_clean":"2024-09-21T00:14:14.978979+0000","last_became_active":"2024-09-21T00:14:14.002941+0000","last_became_peered":"2024-09-21T00:14:14.002941+0000","last_unstale":"2024-09-21T00:14:14.978979+0000","last_undegraded":"2024-09-21T00:14:14.978979+0000","last_fullsized":"2024-09-21T00:14:14.978979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:21.996124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967341+0000","last_change":"2024-09-21T00:14:08.968392+0000","last_active":"2024-09-21T00:14:15.967341+0000","last_peered":"2024-09-21T00:14:15.967341+0000","last_clean":"2024-09-21T00:14:15.967341+0000","last_became_active":"2024-09-21T00:14:08.967708+0000","last_became_peered":"2024-09-21T00:14:08.967708+0000","last_unstale":"2024-09-21T00:14:15.967341+0000","last_undegraded":"2024-09-21T00:14:15.967341+0000","last_fullsized":"2024-09-21T00:14:15.967341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:07.917024+0000","last_clean_scrub_stamp":"2024-09-21T00:14:07.917024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:36.352016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123057+0000","last_change":"2024-09-21T00:14:09.961926+0000","last_active":"2024-09-21T00:14:16.123057+0000","last_peered":"2024-09-21T00:14:16.123057+0000","last_clean":"2024-09-21T00:14:16.123057+0000","last_became_active":"2024-09-21T00:14:09.961227+0000","last_became_peered":"2024-09-21T00:14:09.961227+0000","last_unstale":"2024-09-21T00:14:16.123057+0000","last_undegraded":"2024-09-21T00:14:16.123057+0000","last_fullsized":"2024-09-21T00:14:16.123057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978238+0000","last_change":"2024-09-21T00:14:14.013035+0000","last_active":"2024-09-21T00:14:14.978238+0000","last_peered":"2024-09-21T00:14:14.978238+0000","last_clean":"2024-09-21T00:14:14.978238+0000","last_became_active":"2024-09-21T00:14:14.011549+0000","last_became_peered":"2024-09-21T00:14:14.011549+0000","last_unstale":"2024-09-21T00:14:14.978238+0000","last_undegraded":"2024-09-21T00:14:14.978238+0000","last_fullsized":"2024-09-21T00:14:14.978238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:12.954863+0000","last_clean_scrub_stamp":"2024-09-21T00:14:12.954863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:20.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973538+0000","last_change":"2024-09-21T00:14:09.960154+0000","last_active":"2024-09-21T00:14:14.973538+0000","last_peered":"2024-09-21T00:14:14.973538+0000","last_clean":"2024-09-21T00:14:14.973538+0000","last_became_active":"2024-09-21T00:14:09.959838+0000","last_became_peered":"2024-09-21T00:14:09.959838+0000","last_unstale":"2024-09-21T00:14:14.973538+0000","last_undegraded":"2024-09-21T00:14:14.973538+0000","last_fullsized":"2024-09-21T00:14:14.973538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.977119+0000","last_change":"2024-09-21T00:14:09.961472+0000","last_active":"2024-09-21T00:14:14.977119+0000","last_peered":"2024-09-21T00:14:14.977119+0000","last_clean":"2024-09-21T00:14:14.977119+0000","last_became_active":"2024-09-21T00:14:09.961159+0000","last_became_peered":"2024-09-21T00:14:09.961159+0000","last_unstale":"2024-09-21T00:14:14.977119+0000","last_undegraded":"2024-09-21T00:14:14.977119+0000","last_fullsized":"2024-09-21T00:14:14.977119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:18.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500115+0000","last_change":"2024-09-21T00:14:09.960102+0000","last_active":"2024-09-21T00:14:15.500115+0000","last_peered":"2024-09-21T00:14:15.500115+0000","last_clean":"2024-09-21T00:14:15.500115+0000","last_became_active":"2024-09-21T00:14:09.959770+0000","last_became_peered":"2024-09-21T00:14:09.959770+0000","last_unstale":"2024-09-21T00:14:15.500115+0000","last_undegraded":"2024-09-21T00:14:15.500115+0000","last_fullsized":"2024-09-21T00:14:15.500115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:48:17.648660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967160+0000","last_change":"2024-09-21T00:14:09.967922+0000","last_active":"2024-09-21T00:14:15.967160+0000","last_peered":"2024-09-21T00:14:15.967160+0000","last_clean":"2024-09-21T00:14:15.967160+0000","last_became_active":"2024-09-21T00:14:09.964230+0000","last_became_peered":"2024-09-21T00:14:09.964230+0000","last_unstale":"2024-09-21T00:14:15.967160+0000","last_undegraded":"2024-09-21T00:14:15.967160+0000","last_fullsized":"2024-09-21T00:14:15.967160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:12.855251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123529+0000","last_change":"2024-09-21T00:14:09.971876+0000","last_active":"2024-09-21T00:14:16.123529+0000","last_peered":"2024-09-21T00:14:16.123529+0000","last_clean":"2024-09-21T00:14:16.123529+0000","last_became_active":"2024-09-21T00:14:09.968741+0000","last_became_peered":"2024-09-21T00:14:09.968741+0000","last_unstale":"2024-09-21T00:14:16.123529+0000","last_undegraded":"2024-09-21T00:14:16.123529+0000","last_fullsized":"2024-09-21T00:14:16.123529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:16.513288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123468+0000","last_change":"2024-09-21T00:14:09.957134+0000","last_active":"2024-09-21T00:14:16.123468+0000","last_peered":"2024-09-21T00:14:16.123468+0000","last_clean":"2024-09-21T00:14:16.123468+0000","last_became_active":"2024-09-21T00:14:09.956848+0000","last_became_peered":"2024-09-21T00:14:09.956848+0000","last_unstale":"2024-09-21T00:14:16.123468+0000","last_undegraded":"2024-09-21T00:14:16.123468+0000","last_fullsized":"2024-09-21T00:14:16.123468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:42.044497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973970+0000","last_change":"2024-09-21T00:14:09.969393+0000","last_active":"2024-09-21T00:14:14.973970+0000","last_peered":"2024-09-21T00:14:14.973970+0000","last_clean":"2024-09-21T00:14:14.973970+0000","last_became_active":"2024-09-21T00:14:09.967322+0000","last_became_peered":"2024-09-21T00:14:09.967322+0000","last_unstale":"2024-09-21T00:14:14.973970+0000","last_undegraded":"2024-09-21T00:14:14.973970+0000","last_fullsized":"2024-09-21T00:14:14.973970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:13.058730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967420+0000","last_change":"2024-09-21T00:14:09.975534+0000","last_active":"2024-09-21T00:14:15.967420+0000","last_peered":"2024-09-21T00:14:15.967420+0000","last_clean":"2024-09-21T00:14:15.967420+0000","last_became_active":"2024-09-21T00:14:09.975223+0000","last_became_peered":"2024-09-21T00:14:09.975223+0000","last_unstale":"2024-09-21T00:14:15.967420+0000","last_undegraded":"2024-09-21T00:14:15.967420+0000","last_fullsized":"2024-09-21T00:14:15.967420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:34.284952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500162+0000","last_change":"2024-09-21T00:14:09.955799+0000","last_active":"2024-09-21T00:14:15.500162+0000","last_peered":"2024-09-21T00:14:15.500162+0000","last_clean":"2024-09-21T00:14:15.500162+0000","last_became_active":"2024-09-21T00:14:09.955490+0000","last_became_peered":"2024-09-21T00:14:09.955490+0000","last_unstale":"2024-09-21T00:14:15.500162+0000","last_undegraded":"2024-09-21T00:14:15.500162+0000","last_fullsized":"2024-09-21T00:14:15.500162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:17.805417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966906+0000","last_change":"2024-09-21T00:14:09.967087+0000","last_active":"2024-09-21T00:14:15.966906+0000","last_peered":"2024-09-21T00:14:15.966906+0000","last_clean":"2024-09-21T00:14:15.966906+0000","last_became_active":"2024-09-21T00:14:09.966758+0000","last_became_peered":"2024-09-21T00:14:09.966758+0000","last_unstale":"2024-09-21T00:14:15.966906+0000","last_undegraded":"2024-09-21T00:14:15.966906+0000","last_fullsized":"2024-09-21T00:14:15.966906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:56.369574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122953+0000","last_change":"2024-09-21T00:14:09.959275+0000","last_active":"2024-09-21T00:14:16.122953+0000","last_peered":"2024-09-21T00:14:16.122953+0000","last_clean":"2024-09-21T00:14:16.122953+0000","last_became_active":"2024-09-21T00:14:09.956637+0000","last_became_peered":"2024-09-21T00:14:09.956637+0000","last_unstale":"2024-09-21T00:14:16.122953+0000","last_undegraded":"2024-09-21T00:14:16.122953+0000","last_fullsized":"2024-09-21T00:14:16.122953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:09:18.694635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978300+0000","last_change":"2024-09-21T00:14:09.966758+0000","last_active":"2024-09-21T00:14:14.978300+0000","last_peered":"2024-09-21T00:14:14.978300+0000","last_clean":"2024-09-21T00:14:14.978300+0000","last_became_active":"2024-09-21T00:14:09.966435+0000","last_became_peered":"2024-09-21T00:14:09.966435+0000","last_unstale":"2024-09-21T00:14:14.978300+0000","last_undegraded":"2024-09-21T00:14:14.978300+0000","last_fullsized":"2024-09-21T00:14:14.978300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:14.814291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122756+0000","last_change":"2024-09-21T00:14:09.970050+0000","last_active":"2024-09-21T00:14:16.122756+0000","last_peered":"2024-09-21T00:14:16.122756+0000","last_clean":"2024-09-21T00:14:16.122756+0000","last_became_active":"2024-09-21T00:14:09.969400+0000","last_became_peered":"2024-09-21T00:14:09.969400+0000","last_unstale":"2024-09-21T00:14:16.122756+0000","last_undegraded":"2024-09-21T00:14:16.122756+0000","last_fullsized":"2024-09-21T00:14:16.122756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:10.275524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501120+0000","last_change":"2024-09-21T00:14:09.967005+0000","last_active":"2024-09-21T00:14:15.501120+0000","last_peered":"2024-09-21T00:14:15.501120+0000","last_clean":"2024-09-21T00:14:15.501120+0000","last_became_active":"2024-09-21T00:14:09.966713+0000","last_became_peered":"2024-09-21T00:14:09.966713+0000","last_unstale":"2024-09-21T00:14:15.501120+0000","last_undegraded":"2024-09-21T00:14:15.501120+0000","last_fullsized":"2024-09-21T00:14:15.501120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:46.902750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.978761+0000","last_change":"2024-09-21T00:14:09.963493+0000","last_active":"2024-09-21T00:14:14.978761+0000","last_peered":"2024-09-21T00:14:14.978761+0000","last_clean":"2024-09-21T00:14:14.978761+0000","last_became_active":"2024-09-21T00:14:09.963165+0000","last_became_peered":"2024-09-21T00:14:09.963165+0000","last_unstale":"2024-09-21T00:14:14.978761+0000","last_undegraded":"2024-09-21T00:14:14.978761+0000","last_fullsized":"2024-09-21T00:14:14.978761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:20.488530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.501052+0000","last_change":"2024-09-21T00:14:09.958838+0000","last_active":"2024-09-21T00:14:15.501052+0000","last_peered":"2024-09-21T00:14:15.501052+0000","last_clean":"2024-09-21T00:14:15.501052+0000","last_became_active":"2024-09-21T00:14:09.958571+0000","last_became_peered":"2024-09-21T00:14:09.958571+0000","last_unstale":"2024-09-21T00:14:15.501052+0000","last_undegraded":"2024-09-21T00:14:15.501052+0000","last_fullsized":"2024-09-21T00:14:15.501052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:25.477700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.500012+0000","last_change":"2024-09-21T00:14:09.966624+0000","last_active":"2024-09-21T00:14:15.500012+0000","last_peered":"2024-09-21T00:14:15.500012+0000","last_clean":"2024-09-21T00:14:15.500012+0000","last_became_active":"2024-09-21T00:14:09.966263+0000","last_became_peered":"2024-09-21T00:14:09.966263+0000","last_unstale":"2024-09-21T00:14:15.500012+0000","last_undegraded":"2024-09-21T00:14:15.500012+0000","last_fullsized":"2024-09-21T00:14:15.500012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:34.688163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966562+0000","last_change":"2024-09-21T00:14:09.968374+0000","last_active":"2024-09-21T00:14:15.966562+0000","last_peered":"2024-09-21T00:14:15.966562+0000","last_clean":"2024-09-21T00:14:15.966562+0000","last_became_active":"2024-09-21T00:14:09.966302+0000","last_became_peered":"2024-09-21T00:14:09.966302+0000","last_unstale":"2024-09-21T00:14:15.966562+0000","last_undegraded":"2024-09-21T00:14:15.966562+0000","last_fullsized":"2024-09-21T00:14:15.966562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:02.471950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122938+0000","last_change":"2024-09-21T00:14:09.957691+0000","last_active":"2024-09-21T00:14:16.122938+0000","last_peered":"2024-09-21T00:14:16.122938+0000","last_clean":"2024-09-21T00:14:16.122938+0000","last_became_active":"2024-09-21T00:14:09.957412+0000","last_became_peered":"2024-09-21T00:14:09.957412+0000","last_unstale":"2024-09-21T00:14:16.122938+0000","last_undegraded":"2024-09-21T00:14:16.122938+0000","last_fullsized":"2024-09-21T00:14:16.122938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.535510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123180+0000","last_change":"2024-09-21T00:14:09.975745+0000","last_active":"2024-09-21T00:14:16.123180+0000","last_peered":"2024-09-21T00:14:16.123180+0000","last_clean":"2024-09-21T00:14:16.123180+0000","last_became_active":"2024-09-21T00:14:09.975384+0000","last_became_peered":"2024-09-21T00:14:09.975384+0000","last_unstale":"2024-09-21T00:14:16.123180+0000","last_undegraded":"2024-09-21T00:14:16.123180+0000","last_fullsized":"2024-09-21T00:14:16.123180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:07.322051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123056+0000","last_change":"2024-09-21T00:14:09.969705+0000","last_active":"2024-09-21T00:14:16.123056+0000","last_peered":"2024-09-21T00:14:16.123056+0000","last_clean":"2024-09-21T00:14:16.123056+0000","last_became_active":"2024-09-21T00:14:09.969022+0000","last_became_peered":"2024-09-21T00:14:09.969022+0000","last_unstale":"2024-09-21T00:14:16.123056+0000","last_undegraded":"2024-09-21T00:14:16.123056+0000","last_fullsized":"2024-09-21T00:14:16.123056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:00.965737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123003+0000","last_change":"2024-09-21T00:14:09.967788+0000","last_active":"2024-09-21T00:14:16.123003+0000","last_peered":"2024-09-21T00:14:16.123003+0000","last_clean":"2024-09-21T00:14:16.123003+0000","last_became_active":"2024-09-21T00:14:09.967437+0000","last_became_peered":"2024-09-21T00:14:09.967437+0000","last_unstale":"2024-09-21T00:14:16.123003+0000","last_undegraded":"2024-09-21T00:14:16.123003+0000","last_fullsized":"2024-09-21T00:14:16.123003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:10.161637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122640+0000","last_change":"2024-09-21T00:14:09.964594+0000","last_active":"2024-09-21T00:14:16.122640+0000","last_peered":"2024-09-21T00:14:16.122640+0000","last_clean":"2024-09-21T00:14:16.122640+0000","last_became_active":"2024-09-21T00:14:09.964239+0000","last_became_peered":"2024-09-21T00:14:09.964239+0000","last_unstale":"2024-09-21T00:14:16.122640+0000","last_undegraded":"2024-09-21T00:14:16.122640+0000","last_fullsized":"2024-09-21T00:14:16.122640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:17.805417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123967+0000","last_change":"2024-09-21T00:14:09.970898+0000","last_active":"2024-09-21T00:14:16.123967+0000","last_peered":"2024-09-21T00:14:16.123967+0000","last_clean":"2024-09-21T00:14:16.123967+0000","last_became_active":"2024-09-21T00:14:09.970587+0000","last_became_peered":"2024-09-21T00:14:09.970587+0000","last_unstale":"2024-09-21T00:14:16.123967+0000","last_undegraded":"2024-09-21T00:14:16.123967+0000","last_fullsized":"2024-09-21T00:14:16.123967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:17.652232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.966562+0000","last_change":"2024-09-21T00:14:09.967642+0000","last_active":"2024-09-21T00:14:15.966562+0000","last_peered":"2024-09-21T00:14:15.966562+0000","last_clean":"2024-09-21T00:14:15.966562+0000","last_became_active":"2024-09-21T00:14:09.967322+0000","last_became_peered":"2024-09-21T00:14:09.967322+0000","last_unstale":"2024-09-21T00:14:15.966562+0000","last_undegraded":"2024-09-21T00:14:15.966562+0000","last_fullsized":"2024-09-21T00:14:15.966562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:40.005906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122249+0000","last_change":"2024-09-21T00:14:09.953742+0000","last_active":"2024-09-21T00:14:16.122249+0000","last_peered":"2024-09-21T00:14:16.122249+0000","last_clean":"2024-09-21T00:14:16.122249+0000","last_became_active":"2024-09-21T00:14:09.953446+0000","last_became_peered":"2024-09-21T00:14:09.953446+0000","last_unstale":"2024-09-21T00:14:16.122249+0000","last_undegraded":"2024-09-21T00:14:16.122249+0000","last_fullsized":"2024-09-21T00:14:16.122249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:02:57.284191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973747+0000","last_change":"2024-09-21T00:14:09.955667+0000","last_active":"2024-09-21T00:14:14.973747+0000","last_peered":"2024-09-21T00:14:14.973747+0000","last_clean":"2024-09-21T00:14:14.973747+0000","last_became_active":"2024-09-21T00:14:09.955303+0000","last_became_peered":"2024-09-21T00:14:09.955303+0000","last_unstale":"2024-09-21T00:14:14.973747+0000","last_undegraded":"2024-09-21T00:14:14.973747+0000","last_fullsized":"2024-09-21T00:14:14.973747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:29.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.122650+0000","last_change":"2024-09-21T00:14:09.964455+0000","last_active":"2024-09-21T00:14:16.122650+0000","last_peered":"2024-09-21T00:14:16.122650+0000","last_clean":"2024-09-21T00:14:16.122650+0000","last_became_active":"2024-09-21T00:14:09.964121+0000","last_became_peered":"2024-09-21T00:14:09.964121+0000","last_unstale":"2024-09-21T00:14:16.122650+0000","last_undegraded":"2024-09-21T00:14:16.122650+0000","last_fullsized":"2024-09-21T00:14:16.122650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:02.020147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:14.973720+0000","last_change":"2024-09-21T00:14:09.944636+0000","last_active":"2024-09-21T00:14:14.973720+0000","last_peered":"2024-09-21T00:14:14.973720+0000","last_clean":"2024-09-21T00:14:14.973720+0000","last_became_active":"2024-09-21T00:14:09.944026+0000","last_became_peered":"2024-09-21T00:14:09.944026+0000","last_unstale":"2024-09-21T00:14:14.973720+0000","last_undegraded":"2024-09-21T00:14:14.973720+0000","last_fullsized":"2024-09-21T00:14:14.973720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.302969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967108+0000","last_change":"2024-09-21T00:14:09.969613+0000","last_active":"2024-09-21T00:14:15.967108+0000","last_peered":"2024-09-21T00:14:15.967108+0000","last_clean":"2024-09-21T00:14:15.967108+0000","last_became_active":"2024-09-21T00:14:09.969262+0000","last_became_peered":"2024-09-21T00:14:09.969262+0000","last_unstale":"2024-09-21T00:14:15.967108+0000","last_undegraded":"2024-09-21T00:14:15.967108+0000","last_fullsized":"2024-09-21T00:14:15.967108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:39.405316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:15.967234+0000","last_change":"2024-09-21T00:14:09.960527+0000","last_active":"2024-09-21T00:14:15.967234+0000","last_peered":"2024-09-21T00:14:15.967234+0000","last_clean":"2024-09-21T00:14:15.967234+0000","last_became_active":"2024-09-21T00:14:09.960225+0000","last_became_peered":"2024-09-21T00:14:09.960225+0000","last_unstale":"2024-09-21T00:14:15.967234+0000","last_undegraded":"2024-09-21T00:14:15.967234+0000","last_fullsized":"2024-09-21T00:14:15.967234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:48.961824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T00:14:16.123379+0000","last_change":"2024-09-21T00:14:09.977233+0000","last_active":"2024-09-21T00:14:16.123379+0000","last_peered":"2024-09-21T00:14:16.123379+0000","last_clean":"2024-09-21T00:14:16.123379+0000","last_became_active":"2024-09-21T00:14:09.968098+0000","last_became_peered":"2024-09-21T00:14:09.968098+0000","last_unstale":"2024-09-21T00:14:16.123379+0000","last_undegraded":"2024-09-21T00:14:16.123379+0000","last_fullsized":"2024-09-21T00:14:16.123379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:14:08.924346+0000","last_clean_scrub_stamp":"2024-09-21T00:14:08.924346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:56:31.946410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:14:35.259 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T00:14:35.260 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T00:14:35.260 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T00:14:35.260 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T00:14:35.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.512+0000 7f9a3da00640 1 -- 172.21.15.83:0/793918021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a38162f00 msgr2=0x7f9a380d24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.512+0000 7f9a3da00640 1 --2- 172.21.15.83:0/793918021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a38162f00 0x7f9a380d24d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a380d0c00 tx=0x7f9a2802a4d0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.512+0000 7f9a3da00640 1 -- 172.21.15.83:0/793918021 shutdown_connections 2024-09-21T00:14:35.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.512+0000 7f9a3da00640 1 --2- 172.21.15.83:0/793918021 >> v2:172.21.15.142:3300/0 conn(0x7f9a380b2e40 0x7f9a380b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.512+0000 7f9a3da00640 1 --2- 172.21.15.83:0/793918021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a38162f00 0x7f9a380d24d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.512+0000 7f9a3da00640 1 -- 172.21.15.83:0/793918021 >> 172.21.15.83:0/793918021 conn(0x7f9a380b6b20 msgr2=0x7f9a380d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:35.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.512+0000 7f9a3da00640 1 -- 172.21.15.83:0/793918021 shutdown_connections 2024-09-21T00:14:35.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.512+0000 7f9a3da00640 1 -- 172.21.15.83:0/793918021 wait complete. 2024-09-21T00:14:35.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.514+0000 7f9a3da00640 1 Processor -- start 2024-09-21T00:14:35.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.514+0000 7f9a3da00640 1 -- start start 2024-09-21T00:14:35.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.515+0000 7f9a3da00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a380b2e40 0x7f9a380ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.515+0000 7f9a3da00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38162280 0x7f9a38158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.515+0000 7f9a3da00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a3814f980 0x7f9a380aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a3da00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3815e4b0 con 0x7f9a380b2e40 2024-09-21T00:14:35.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a3da00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9a380b39a0 con 0x7f9a38162280 2024-09-21T00:14:35.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a3da00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3815e630 con 0x7f9a3814f980 2024-09-21T00:14:35.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a36a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a380b2e40 0x7f9a380ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a36a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a380b2e40 0x7f9a380ab670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37270/0 (socket says 172.21.15.83:37270) 2024-09-21T00:14:35.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a36a00640 1 -- 172.21.15.83:0/3790117313 learned_addr learned my addr 172.21.15.83:0/3790117313 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:35.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a37400640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a3814f980 0x7f9a380aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a2e000640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38162280 0x7f9a38158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a36a00640 1 -- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a3814f980 msgr2=0x7f9a380aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a36a00640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a3814f980 0x7f9a380aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a36a00640 1 -- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38162280 msgr2=0x7f9a38158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a36a00640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38162280 0x7f9a38158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.516+0000 7f9a36a00640 1 -- 172.21.15.83:0/3790117313 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a380aff00 con 0x7f9a380b2e40 2024-09-21T00:14:35.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.517+0000 7f9a36a00640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a380b2e40 0x7f9a380ab670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9a280099c0 tx=0x7f9a280039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:35.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.517+0000 7f9a2f400640 1 -- 172.21.15.83:0/3790117313 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2803e030 con 0x7f9a380b2e40 2024-09-21T00:14:35.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.517+0000 7f9a2f400640 1 -- 172.21.15.83:0/3790117313 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a280047a0 con 0x7f9a380b2e40 2024-09-21T00:14:35.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.517+0000 7f9a2f400640 1 -- 172.21.15.83:0/3790117313 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28035040 con 0x7f9a380b2e40 2024-09-21T00:14:35.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.517+0000 7f9a3da00640 1 -- 172.21.15.83:0/3790117313 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a380abe30 con 0x7f9a380b2e40 2024-09-21T00:14:35.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.517+0000 7f9a3da00640 1 -- 172.21.15.83:0/3790117313 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a380ac3f0 con 0x7f9a380b2e40 2024-09-21T00:14:35.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.518+0000 7f9a3da00640 1 -- 172.21.15.83:0/3790117313 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a380b00d0 con 0x7f9a380b2e40 2024-09-21T00:14:35.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.519+0000 7f9a2f400640 1 -- 172.21.15.83:0/3790117313 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a28041030 con 0x7f9a380b2e40 2024-09-21T00:14:35.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.520+0000 7f9a2f400640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9a14078b90 0x7f9a1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.520+0000 7f9a2f400640 1 -- 172.21.15.83:0/3790117313 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9a280bb720 con 0x7f9a380b2e40 2024-09-21T00:14:35.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.521+0000 7f9a2e000640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9a14078b90 0x7f9a1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.521+0000 7f9a2e000640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9a14078b90 0x7f9a1407b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a38161fb0 tx=0x7f9a20009060 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:35.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.525+0000 7f9a2f400640 1 -- 172.21.15.83:0/3790117313 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9a28083260 con 0x7f9a380b2e40 2024-09-21T00:14:35.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.747+0000 7f9a3da00640 1 -- 172.21.15.83:0/3790117313 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9a38162f00 con 0x7f9a380b2e40 2024-09-21T00:14:35.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.748+0000 7f9a2f400640 1 -- 172.21.15.83:0/3790117313 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9a28088e20 con 0x7f9a380b2e40 2024-09-21T00:14:35.749 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:35.749 INFO:teuthology.orchestra.run.smithi083.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 -- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9a14078b90 msgr2=0x7f9a1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9a14078b90 0x7f9a1407b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a38161fb0 tx=0x7f9a20009060 comp rx=0 tx=0).stop 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 -- 172.21.15.83:0/3790117313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a380b2e40 msgr2=0x7f9a380ab670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a380b2e40 0x7f9a380ab670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9a280099c0 tx=0x7f9a280039e0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 -- 172.21.15.83:0/3790117313 shutdown_connections 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9a14078b90 0x7f9a1407b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a3814f980 0x7f9a380aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38162280 0x7f9a38158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 --2- 172.21.15.83:0/3790117313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a380b2e40 0x7f9a380ab670 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 -- 172.21.15.83:0/3790117313 >> 172.21.15.83:0/3790117313 conn(0x7f9a380b6b20 msgr2=0x7f9a3806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.750+0000 7f9a3da00640 1 -- 172.21.15.83:0/3790117313 shutdown_connections 2024-09-21T00:14:35.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.751+0000 7f9a3da00640 1 -- 172.21.15.83:0/3790117313 wait complete. 2024-09-21T00:14:35.774 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T00:14:35.774 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:14:35.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.993+0000 7f75fea00640 1 -- 172.21.15.83:0/2402115381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75f8073dd0 msgr2=0x7f75f806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:35.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.993+0000 7f75fea00640 1 --2- 172.21.15.83:0/2402115381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75f8073dd0 0x7f75f806ddf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f75f815d980 tx=0x7f75e402a530 comp rx=0 tx=0).stop 2024-09-21T00:14:35.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.993+0000 7f75fea00640 1 -- 172.21.15.83:0/2402115381 shutdown_connections 2024-09-21T00:14:35.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.993+0000 7f75fea00640 1 --2- 172.21.15.83:0/2402115381 >> v2:172.21.15.142:3300/0 conn(0x7f75f806e330 0x7f75f806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.993+0000 7f75fea00640 1 --2- 172.21.15.83:0/2402115381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75f8073dd0 0x7f75f806ddf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:35.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.993+0000 7f75fea00640 1 -- 172.21.15.83:0/2402115381 >> 172.21.15.83:0/2402115381 conn(0x7f75f80cca40 msgr2=0x7f75f80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:35.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.993+0000 7f75fea00640 1 -- 172.21.15.83:0/2402115381 shutdown_connections 2024-09-21T00:14:35.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.993+0000 7f75fea00640 1 -- 172.21.15.83:0/2402115381 wait complete. 2024-09-21T00:14:35.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.995+0000 7f75fea00640 1 Processor -- start 2024-09-21T00:14:35.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.996+0000 7f75fea00640 1 -- start start 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75fea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f806e330 0x7f75f809fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75fea00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75f8073dd0 0x7f75f809ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75fea00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75f8074cb0 0x7f75f80cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75fea00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f75f806f4a0 con 0x7f75f8073dd0 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75fea00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f75f806f320 con 0x7f75f806e330 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75fea00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f75f806f620 con 0x7f75f8074cb0 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75f7400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75f8073dd0 0x7f75f809ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75f7400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75f8073dd0 0x7f75f809ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37288/0 (socket says 172.21.15.83:37288) 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75f7400640 1 -- 172.21.15.83:0/3981642516 learned_addr learned my addr 172.21.15.83:0/3981642516 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75f7e00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f806e330 0x7f75f809fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.997+0000 7f75fca00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75f8074cb0 0x7f75f80cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:35.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75f7400640 1 -- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75f8074cb0 msgr2=0x7f75f80cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75f7400640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75f8074cb0 0x7f75f80cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75f7400640 1 -- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f806e330 msgr2=0x7f75f809fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75f7400640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f806e330 0x7f75f809fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75f7400640 1 -- 172.21.15.83:0/3981642516 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f81580e0 con 0x7f75f8073dd0 2024-09-21T00:14:36.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75fca00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75f8074cb0 0x7f75f80cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:36.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75f7400640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75f8073dd0 0x7f75f809ff70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009920 tx=0x7f75e4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:36.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75efe00640 1 -- 172.21.15.83:0/3981642516 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4031d60 con 0x7f75f8073dd0 2024-09-21T00:14:36.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75efe00640 1 -- 172.21.15.83:0/3981642516 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75e4033e10 con 0x7f75f8073dd0 2024-09-21T00:14:36.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75efe00640 1 -- 172.21.15.83:0/3981642516 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4005260 con 0x7f75f8073dd0 2024-09-21T00:14:36.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75fea00640 1 -- 172.21.15.83:0/3981642516 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f80cf6f0 con 0x7f75f8073dd0 2024-09-21T00:14:36.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.998+0000 7f75fea00640 1 -- 172.21.15.83:0/3981642516 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f8156050 con 0x7f75f8073dd0 2024-09-21T00:14:36.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:35.999+0000 7f75fea00640 1 -- 172.21.15.83:0/3981642516 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f806fbc0 con 0x7f75f8073dd0 2024-09-21T00:14:36.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.001+0000 7f75efe00640 1 -- 172.21.15.83:0/3981642516 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75e4005400 con 0x7f75f8073dd0 2024-09-21T00:14:36.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.002+0000 7f75efe00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f75d8078bc0 0x7f75d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:36.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.002+0000 7f75efe00640 1 -- 172.21.15.83:0/3981642516 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f75e40bc290 con 0x7f75f8073dd0 2024-09-21T00:14:36.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.002+0000 7f75f7e00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f75d8078bc0 0x7f75d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:36.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.003+0000 7f75f7e00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f75d8078bc0 0x7f75d807b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f75e8007fd0 tx=0x7f75e8009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:36.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.006+0000 7f75efe00640 1 -- 172.21.15.83:0/3981642516 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f75e403f030 con 0x7f75f8073dd0 2024-09-21T00:14:36.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.230+0000 7f75fea00640 1 -- 172.21.15.83:0/3981642516 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75f815a130 con 0x7f75f8073dd0 2024-09-21T00:14:36.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.230+0000 7f75efe00640 1 -- 172.21.15.83:0/3981642516 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5222 (secure 0 0 0) 0x7f75f806e740 con 0x7f75f8073dd0 2024-09-21T00:14:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:36.232 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"btime":"2024-09-21T00:14:27:026365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:14:09.437323+0000","modified":"2024-09-21T00:14:26.510440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-21T00:14:36.232 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-09-21T00:14:36.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 -- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f75d8078bc0 msgr2=0x7f75d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f75d8078bc0 0x7f75d807b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f75e8007fd0 tx=0x7f75e8009040 comp rx=0 tx=0).stop 2024-09-21T00:14:36.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 -- 172.21.15.83:0/3981642516 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75f8073dd0 msgr2=0x7f75f809ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75f8073dd0 0x7f75f809ff70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009920 tx=0x7f75e4033c20 comp rx=0 tx=0).stop 2024-09-21T00:14:36.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 -- 172.21.15.83:0/3981642516 shutdown_connections 2024-09-21T00:14:36.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f75d8078bc0 0x7f75d807b0d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75f8074cb0 0x7f75f80cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75f8073dd0 0x7f75f809ff70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 --2- 172.21.15.83:0/3981642516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f806e330 0x7f75f809fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 -- 172.21.15.83:0/3981642516 >> 172.21.15.83:0/3981642516 conn(0x7f75f80cca40 msgr2=0x7f75f8158330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:36.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 -- 172.21.15.83:0/3981642516 shutdown_connections 2024-09-21T00:14:36.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.233+0000 7f75fea00640 1 -- 172.21.15.83:0/3981642516 wait complete. 2024-09-21T00:14:36.255 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:14:36.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.474+0000 7f31fec00640 1 -- 172.21.15.83:0/1648803185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31f815b9f0 msgr2=0x7f31f80cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.474+0000 7f31fec00640 1 --2- 172.21.15.83:0/1648803185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31f815b9f0 0x7f31f80cf930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f31f8072d40 tx=0x7f31e802a560 comp rx=0 tx=0).stop 2024-09-21T00:14:36.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.474+0000 7f31fec00640 1 -- 172.21.15.83:0/1648803185 shutdown_connections 2024-09-21T00:14:36.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.474+0000 7f31fec00640 1 --2- 172.21.15.83:0/1648803185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31f80ce860 0x7f31f815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.474+0000 7f31fec00640 1 --2- 172.21.15.83:0/1648803185 >> v2:172.21.15.142:3300/0 conn(0x7f31f80cefa0 0x7f31f80ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.474+0000 7f31fec00640 1 --2- 172.21.15.83:0/1648803185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31f815b9f0 0x7f31f80cf930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.474+0000 7f31fec00640 1 -- 172.21.15.83:0/1648803185 >> 172.21.15.83:0/1648803185 conn(0x7f31f80cca40 msgr2=0x7f31f80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:36.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.474+0000 7f31fec00640 1 -- 172.21.15.83:0/1648803185 shutdown_connections 2024-09-21T00:14:36.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.474+0000 7f31fec00640 1 -- 172.21.15.83:0/1648803185 wait complete. 2024-09-21T00:14:36.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.476+0000 7f31fec00640 1 Processor -- start 2024-09-21T00:14:36.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.476+0000 7f31fec00640 1 -- start start 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31fec00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31f80ce860 0x7f31f8158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31fec00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31f80cefa0 0x7f31f80b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31fec00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f815b9f0 0x7f31f80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31fec00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f31f815fe70 con 0x7f31f80cefa0 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31fec00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f31f815fcf0 con 0x7f31f815b9f0 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31fec00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f31f806ddf0 con 0x7f31f80ce860 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31f7400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31f80cefa0 0x7f31f80b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31f7400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31f80cefa0 0x7f31f80b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37306/0 (socket says 172.21.15.83:37306) 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31f7400640 1 -- 172.21.15.83:0/1178720976 learned_addr learned my addr 172.21.15.83:0/1178720976 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31fcc00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f815b9f0 0x7f31f80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31f7e00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31f80ce860 0x7f31f8158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:36.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31f7400640 1 -- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31f80ce860 msgr2=0x7f31f8158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.478+0000 7f31f7400640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31f80ce860 0x7f31f8158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.479+0000 7f31f7400640 1 -- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f815b9f0 msgr2=0x7f31f80b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.479+0000 7f31f7400640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f815b9f0 0x7f31f80b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.479+0000 7f31f7400640 1 -- 172.21.15.83:0/1178720976 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f815e600 con 0x7f31f80cefa0 2024-09-21T00:14:36.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.479+0000 7f31f7400640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31f80cefa0 0x7f31f80b4fe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f31e400d770 tx=0x7f31e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:36.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.479+0000 7f31efe00640 1 -- 172.21.15.83:0/1178720976 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4017070 con 0x7f31f80cefa0 2024-09-21T00:14:36.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.479+0000 7f31efe00640 1 -- 172.21.15.83:0/1178720976 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31e4009d20 con 0x7f31f80cefa0 2024-09-21T00:14:36.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.479+0000 7f31fec00640 1 -- 172.21.15.83:0/1178720976 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f815df40 con 0x7f31f80cefa0 2024-09-21T00:14:36.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.479+0000 7f31efe00640 1 -- 172.21.15.83:0/1178720976 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e40106c0 con 0x7f31f80cefa0 2024-09-21T00:14:36.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.479+0000 7f31fec00640 1 -- 172.21.15.83:0/1178720976 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f81f6290 con 0x7f31f80cefa0 2024-09-21T00:14:36.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.480+0000 7f31fec00640 1 -- 172.21.15.83:0/1178720976 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f815e870 con 0x7f31f80cefa0 2024-09-21T00:14:36.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.481+0000 7f31efe00640 1 -- 172.21.15.83:0/1178720976 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31e401a070 con 0x7f31f80cefa0 2024-09-21T00:14:36.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.483+0000 7f31efe00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31d8078b90 0x7f31d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:36.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.483+0000 7f31efe00640 1 -- 172.21.15.83:0/1178720976 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f31e409b160 con 0x7f31f80cefa0 2024-09-21T00:14:36.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.483+0000 7f31f7e00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31d8078b90 0x7f31d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:36.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.484+0000 7f31f7e00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31d8078b90 0x7f31d807b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f31e8033000 tx=0x7f31e8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:36.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.488+0000 7f31efe00640 1 -- 172.21.15.83:0/1178720976 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f31e4063250 con 0x7f31f80cefa0 2024-09-21T00:14:36.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.708+0000 7f31fec00640 1 -- 172.21.15.83:0/1178720976 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31f806e4b0 con 0x7f31f80cefa0 2024-09-21T00:14:36.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.709+0000 7f31efe00640 1 -- 172.21.15.83:0/1178720976 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5222 (secure 0 0 0) 0x7f31e4062b50 con 0x7f31f80cefa0 2024-09-21T00:14:36.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:36.710 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"btime":"2024-09-21T00:14:27:026365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:14:09.437323+0000","modified":"2024-09-21T00:14:26.510440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-21T00:14:36.710 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-09-21T00:14:36.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 -- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31d8078b90 msgr2=0x7f31d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31d8078b90 0x7f31d807b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f31e8033000 tx=0x7f31e8004730 comp rx=0 tx=0).stop 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 -- 172.21.15.83:0/1178720976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31f80cefa0 msgr2=0x7f31f80b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31f80cefa0 0x7f31f80b4fe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f31e400d770 tx=0x7f31e400dc30 comp rx=0 tx=0).stop 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 -- 172.21.15.83:0/1178720976 shutdown_connections 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31d8078b90 0x7f31d807b0a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f815b9f0 0x7f31f80b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31f80cefa0 0x7f31f80b4fe0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 --2- 172.21.15.83:0/1178720976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31f80ce860 0x7f31f8158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 -- 172.21.15.83:0/1178720976 >> 172.21.15.83:0/1178720976 conn(0x7f31f80cca40 msgr2=0x7f31f815a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 -- 172.21.15.83:0/1178720976 shutdown_connections 2024-09-21T00:14:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.711+0000 7f31fec00640 1 -- 172.21.15.83:0/1178720976 wait complete. 2024-09-21T00:14:36.738 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:36.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.957+0000 7f8ea6c00640 1 -- 172.21.15.83:0/1833241576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00cf930 msgr2=0x7f8ea00ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.957+0000 7f8ea6c00640 1 --2- 172.21.15.83:0/1833241576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00cf930 0x7f8ea00ce320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c005fd0 tx=0x7f8e8c02a670 comp rx=0 tx=0).stop 2024-09-21T00:14:36.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.957+0000 7f8ea6c00640 1 -- 172.21.15.83:0/1833241576 shutdown_connections 2024-09-21T00:14:36.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.957+0000 7f8ea6c00640 1 --2- 172.21.15.83:0/1833241576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00cf930 0x7f8ea00ce320 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.957+0000 7f8ea6c00640 1 -- 172.21.15.83:0/1833241576 >> 172.21.15.83:0/1833241576 conn(0x7f8ea00cca40 msgr2=0x7f8ea00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:36.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.957+0000 7f8ea6c00640 1 -- 172.21.15.83:0/1833241576 shutdown_connections 2024-09-21T00:14:36.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.958+0000 7f8ea6c00640 1 -- 172.21.15.83:0/1833241576 wait complete. 2024-09-21T00:14:36.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.960+0000 7f8ea6c00640 1 Processor -- start 2024-09-21T00:14:36.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.960+0000 7f8ea6c00640 1 -- start start 2024-09-21T00:14:36.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.961+0000 7f8ea6c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ea00ce860 0x7f8ea015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:36.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.961+0000 7f8ea6c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00cf930 0x7f8ea01e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:36.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.961+0000 7f8ea6c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ea015b9f0 0x7f8ea01e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:36.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.961+0000 7f8ea6c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea006e180 con 0x7f8ea00cf930 2024-09-21T00:14:36.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.961+0000 7f8ea6c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea006e000 con 0x7f8ea015b9f0 2024-09-21T00:14:36.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.961+0000 7f8ea6c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea006e300 con 0x7f8ea00ce860 2024-09-21T00:14:36.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.961+0000 7f8e9f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00cf930 0x7f8ea01e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:36.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.961+0000 7f8e9f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00cf930 0x7f8ea01e8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37324/0 (socket says 172.21.15.83:37324) 2024-09-21T00:14:36.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.961+0000 7f8e9f400640 1 -- 172.21.15.83:0/919111261 learned_addr learned my addr 172.21.15.83:0/919111261 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:36.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.962+0000 7f8e9fe00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ea00ce860 0x7f8ea015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:36.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.962+0000 7f8ea4c00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ea015b9f0 0x7f8ea01e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:36.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.962+0000 7f8e9f400640 1 -- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ea00ce860 msgr2=0x7f8ea015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.962+0000 7f8e9f400640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ea00ce860 0x7f8ea015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.962+0000 7f8e9f400640 1 -- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ea015b9f0 msgr2=0x7f8ea01e94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:36.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.962+0000 7f8e9f400640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ea015b9f0 0x7f8ea01e94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:36.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.962+0000 7f8e9f400640 1 -- 172.21.15.83:0/919111261 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea01f53f0 con 0x7f8ea00cf930 2024-09-21T00:14:36.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.962+0000 7f8e9f400640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00cf930 0x7f8ea01e8f90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009230 tx=0x7f8e8c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:36.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.962+0000 7f8e97e00640 1 -- 172.21.15.83:0/919111261 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c03e030 con 0x7f8ea00cf930 2024-09-21T00:14:36.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.963+0000 7f8e97e00640 1 -- 172.21.15.83:0/919111261 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e8c003e00 con 0x7f8ea00cf930 2024-09-21T00:14:36.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.963+0000 7f8ea6c00640 1 -- 172.21.15.83:0/919111261 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea009e090 con 0x7f8ea00cf930 2024-09-21T00:14:36.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.963+0000 7f8e97e00640 1 -- 172.21.15.83:0/919111261 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c035040 con 0x7f8ea00cf930 2024-09-21T00:14:36.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.963+0000 7f8ea6c00640 1 -- 172.21.15.83:0/919111261 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea009e650 con 0x7f8ea00cf930 2024-09-21T00:14:36.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.964+0000 7f8ea6c00640 1 -- 172.21.15.83:0/919111261 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea00af550 con 0x7f8ea00cf930 2024-09-21T00:14:36.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.965+0000 7f8e97e00640 1 -- 172.21.15.83:0/919111261 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e8c041030 con 0x7f8ea00cf930 2024-09-21T00:14:36.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.966+0000 7f8e97e00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8e80078b90 0x7f8e8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:36.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.966+0000 7f8e97e00640 1 -- 172.21.15.83:0/919111261 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8e8c0bb920 con 0x7f8ea00cf930 2024-09-21T00:14:36.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.966+0000 7f8e9fe00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8e80078b90 0x7f8e8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:36.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.967+0000 7f8e9fe00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8e80078b90 0x7f8e8007b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e90000f60 tx=0x7f8e90009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:36.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:36.971+0000 7f8e97e00640 1 -- 172.21.15.83:0/919111261 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8e8c083340 con 0x7f8ea00cf930 2024-09-21T00:14:37.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.160+0000 7f8ea6c00640 1 -- 172.21.15.83:0/919111261 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ea00ce2a0 con 0x7f8ea00cf930 2024-09-21T00:14:37.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.161+0000 7f8e97e00640 1 -- 172.21.15.83:0/919111261 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f8e8c087d70 con 0x7f8ea00cf930 2024-09-21T00:14:37.170 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:37.170 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":27,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:14.484147+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:37.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 -- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8e80078b90 msgr2=0x7f8e8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:37.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8e80078b90 0x7f8e8007b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e90000f60 tx=0x7f8e90009040 comp rx=0 tx=0).stop 2024-09-21T00:14:37.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 -- 172.21.15.83:0/919111261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00cf930 msgr2=0x7f8ea01e8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:37.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00cf930 0x7f8ea01e8f90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009230 tx=0x7f8e8c003910 comp rx=0 tx=0).stop 2024-09-21T00:14:37.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 -- 172.21.15.83:0/919111261 shutdown_connections 2024-09-21T00:14:37.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8e80078b90 0x7f8e8007b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ea015b9f0 0x7f8ea01e94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea00cf930 0x7f8ea01e8f90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 --2- 172.21.15.83:0/919111261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ea00ce860 0x7f8ea015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 -- 172.21.15.83:0/919111261 >> 172.21.15.83:0/919111261 conn(0x7f8ea00cca40 msgr2=0x7f8ea00b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:37.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 -- 172.21.15.83:0/919111261 shutdown_connections 2024-09-21T00:14:37.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.164+0000 7f8ea6c00640 1 -- 172.21.15.83:0/919111261 wait complete. 2024-09-21T00:14:37.191 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:14:37.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.410+0000 7fd227a00640 1 -- 172.21.15.83:0/1890907420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd220074cb0 msgr2=0x7fd220073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:37.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.410+0000 7fd227a00640 1 --2- 172.21.15.83:0/1890907420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd220074cb0 0x7fd220073dd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd22009e110 tx=0x7fd21002a5f0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.410+0000 7fd227a00640 1 -- 172.21.15.83:0/1890907420 shutdown_connections 2024-09-21T00:14:37.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.410+0000 7fd227a00640 1 --2- 172.21.15.83:0/1890907420 >> v2:172.21.15.142:3300/0 conn(0x7fd2200cbc10 0x7fd2200cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.410+0000 7fd227a00640 1 --2- 172.21.15.83:0/1890907420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd220074cb0 0x7fd220073dd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.410+0000 7fd227a00640 1 -- 172.21.15.83:0/1890907420 >> 172.21.15.83:0/1890907420 conn(0x7fd2200cca40 msgr2=0x7fd2200cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:37.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.411+0000 7fd227a00640 1 -- 172.21.15.83:0/1890907420 shutdown_connections 2024-09-21T00:14:37.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.411+0000 7fd227a00640 1 -- 172.21.15.83:0/1890907420 wait complete. 2024-09-21T00:14:37.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.413+0000 7fd227a00640 1 Processor -- start 2024-09-21T00:14:37.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.413+0000 7fd227a00640 1 -- start start 2024-09-21T00:14:37.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.414+0000 7fd227a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd22006ddf0 0x7fd2201f9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:37.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.414+0000 7fd227a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd220074cb0 0x7fd2201e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:37.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.414+0000 7fd227a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2200cbc10 0x7fd2201e9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:37.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.414+0000 7fd227a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd22006f360 con 0x7fd2200cbc10 2024-09-21T00:14:37.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.414+0000 7fd227a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd22006f1e0 con 0x7fd22006ddf0 2024-09-21T00:14:37.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.414+0000 7fd227a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd22006f4e0 con 0x7fd220074cb0 2024-09-21T00:14:37.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd225a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2200cbc10 0x7fd2201e9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:37.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd225a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2200cbc10 0x7fd2201e9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37348/0 (socket says 172.21.15.83:37348) 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd225a00640 1 -- 172.21.15.83:0/1662207738 learned_addr learned my addr 172.21.15.83:0/1662207738 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd217e00640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd220074cb0 0x7fd2201e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd225000640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd22006ddf0 0x7fd2201f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd225a00640 1 -- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd220074cb0 msgr2=0x7fd2201e8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd225a00640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd220074cb0 0x7fd2201e8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd225a00640 1 -- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd22006ddf0 msgr2=0x7fd2201f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd225a00640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd22006ddf0 0x7fd2201f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd225a00640 1 -- 172.21.15.83:0/1662207738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2201f53f0 con 0x7fd2200cbc10 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.415+0000 7fd225a00640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2200cbc10 0x7fd2201e9430 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd21800c6f0 tx=0x7fd21800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.416+0000 7fd21d600640 1 -- 172.21.15.83:0/1662207738 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218003970 con 0x7fd2200cbc10 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.416+0000 7fd21d600640 1 -- 172.21.15.83:0/1662207738 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd218003b30 con 0x7fd2200cbc10 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.416+0000 7fd21d600640 1 -- 172.21.15.83:0/1662207738 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21800a850 con 0x7fd2200cbc10 2024-09-21T00:14:37.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.416+0000 7fd227a00640 1 -- 172.21.15.83:0/1662207738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2201f56b0 con 0x7fd2200cbc10 2024-09-21T00:14:37.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.416+0000 7fd227a00640 1 -- 172.21.15.83:0/1662207738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2201f5c70 con 0x7fd2200cbc10 2024-09-21T00:14:37.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.417+0000 7fd227a00640 1 -- 172.21.15.83:0/1662207738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd22006f990 con 0x7fd2200cbc10 2024-09-21T00:14:37.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.418+0000 7fd21d600640 1 -- 172.21.15.83:0/1662207738 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd21800a9f0 con 0x7fd2200cbc10 2024-09-21T00:14:37.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.420+0000 7fd21d600640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd1fc078bc0 0x7fd1fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:37.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.420+0000 7fd21d600640 1 -- 172.21.15.83:0/1662207738 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd21809ac00 con 0x7fd2200cbc10 2024-09-21T00:14:37.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.420+0000 7fd225000640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd1fc078bc0 0x7fd1fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:37.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.421+0000 7fd225000640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd1fc078bc0 0x7fd1fc07b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd210033000 tx=0x7fd210004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:37.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.424+0000 7fd21d600640 1 -- 172.21.15.83:0/1662207738 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd218062730 con 0x7fd2200cbc10 2024-09-21T00:14:37.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.644+0000 7fd227a00640 1 -- 172.21.15.83:0/1662207738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2200b5e20 con 0x7fd2200cbc10 2024-09-21T00:14:37.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.645+0000 7fd21d600640 1 -- 172.21.15.83:0/1662207738 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5222 (secure 0 0 0) 0x7fd218067160 con 0x7fd2200cbc10 2024-09-21T00:14:37.647 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:37.648 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"btime":"2024-09-21T00:14:27:026365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:14:09.437323+0000","modified":"2024-09-21T00:14:26.510440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-21T00:14:37.648 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.647+0000 7fd227a00640 1 -- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd1fc078bc0 msgr2=0x7fd1fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.647+0000 7fd227a00640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd1fc078bc0 0x7fd1fc07b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd210033000 tx=0x7fd210004730 comp rx=0 tx=0).stop 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.647+0000 7fd227a00640 1 -- 172.21.15.83:0/1662207738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2200cbc10 msgr2=0x7fd2201e9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.647+0000 7fd227a00640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2200cbc10 0x7fd2201e9430 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd21800c6f0 tx=0x7fd21800cbb0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.647+0000 7fd227a00640 1 -- 172.21.15.83:0/1662207738 shutdown_connections 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.647+0000 7fd227a00640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd1fc078bc0 0x7fd1fc07b0d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.647+0000 7fd227a00640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2200cbc10 0x7fd2201e9430 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.647+0000 7fd227a00640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd220074cb0 0x7fd2201e8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.647+0000 7fd227a00640 1 --2- 172.21.15.83:0/1662207738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd22006ddf0 0x7fd2201f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.647+0000 7fd227a00640 1 -- 172.21.15.83:0/1662207738 >> 172.21.15.83:0/1662207738 conn(0x7fd2200cca40 msgr2=0x7fd2200cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:37.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.648+0000 7fd227a00640 1 -- 172.21.15.83:0/1662207738 shutdown_connections 2024-09-21T00:14:37.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:37.648+0000 7fd227a00640 1 -- 172.21.15.83:0/1662207738 wait complete. 2024-09-21T00:14:38.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T00:14:09.437323+0000', 'modified': '2024-09-21T00:14:26.510440+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4371}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4371': {'gid': 4371, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6834/176272161', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6832', 'nonce': 176272161}, {'type': 'v1', 'addr': '172.21.15.83:6834', 'nonce': 176272161}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4371, 'qdb_cluster': [4371]} 2024-09-21T00:14:38.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T00:14:38.076 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T00:14:38.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.299+0000 7f9c75200640 1 -- 172.21.15.83:0/1224730713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c700cef00 msgr2=0x7f9c700cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:38.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.299+0000 7f9c75200640 1 --2- 172.21.15.83:0/1224730713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c700cef00 0x7f9c700cf310 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c58005fd0 tx=0x7f9c5802a5d0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.299+0000 7f9c75200640 1 -- 172.21.15.83:0/1224730713 shutdown_connections 2024-09-21T00:14:38.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.299+0000 7f9c75200640 1 --2- 172.21.15.83:0/1224730713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c700cef00 0x7f9c700cf310 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.299+0000 7f9c75200640 1 --2- 172.21.15.83:0/1224730713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c7015f6d0 0x7f9c7015e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.299+0000 7f9c75200640 1 -- 172.21.15.83:0/1224730713 >> 172.21.15.83:0/1224730713 conn(0x7f9c700d41e0 msgr2=0x7f9c700d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:38.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.299+0000 7f9c75200640 1 -- 172.21.15.83:0/1224730713 shutdown_connections 2024-09-21T00:14:38.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.299+0000 7f9c75200640 1 -- 172.21.15.83:0/1224730713 wait complete. 2024-09-21T00:14:38.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.301+0000 7f9c75200640 1 Processor -- start 2024-09-21T00:14:38.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.301+0000 7f9c75200640 1 -- start start 2024-09-21T00:14:38.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.302+0000 7f9c75200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c700cef00 0x7f9c701f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c75200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c7015f6d0 0x7f9c70161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c75200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c70162240 0x7f9c701f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c75200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7015eb00 con 0x7f9c700cef00 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c75200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7006dd20 con 0x7f9c70162240 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c75200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9c700d32a0 con 0x7f9c7015f6d0 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c700cef00 0x7f9c701f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c700cef00 0x7f9c701f2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37354/0 (socket says 172.21.15.83:37354) 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c6f400640 1 -- 172.21.15.83:0/1426869613 learned_addr learned my addr 172.21.15.83:0/1426869613 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c66a00640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c7015f6d0 0x7f9c70161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c70162240 0x7f9c701f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c6f400640 1 -- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c7015f6d0 msgr2=0x7f9c70161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c6f400640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c7015f6d0 0x7f9c70161100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c6f400640 1 -- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c70162240 msgr2=0x7f9c701f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c6f400640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c70162240 0x7f9c701f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.303+0000 7f9c6f400640 1 -- 172.21.15.83:0/1426869613 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c701f98a0 con 0x7f9c700cef00 2024-09-21T00:14:38.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.304+0000 7f9c6f400640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c700cef00 0x7f9c701f2850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000d770 tx=0x7f9c6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:38.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.304+0000 7f9c67e00640 1 -- 172.21.15.83:0/1426869613 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60017070 con 0x7f9c700cef00 2024-09-21T00:14:38.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.304+0000 7f9c67e00640 1 -- 172.21.15.83:0/1426869613 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c60009d20 con 0x7f9c700cef00 2024-09-21T00:14:38.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.304+0000 7f9c75200640 1 -- 172.21.15.83:0/1426869613 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c700aaea0 con 0x7f9c700cef00 2024-09-21T00:14:38.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.304+0000 7f9c67e00640 1 -- 172.21.15.83:0/1426869613 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c600106c0 con 0x7f9c700cef00 2024-09-21T00:14:38.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.304+0000 7f9c75200640 1 -- 172.21.15.83:0/1426869613 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c700ab460 con 0x7f9c700cef00 2024-09-21T00:14:38.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.306+0000 7f9c67e00640 1 -- 172.21.15.83:0/1426869613 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c6001a070 con 0x7f9c700cef00 2024-09-21T00:14:38.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.307+0000 7f9c67e00640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9c4c078b90 0x7f9c4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.307+0000 7f9c67e00640 1 -- 172.21.15.83:0/1426869613 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9c6009b150 con 0x7f9c700cef00 2024-09-21T00:14:38.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.308+0000 7f9c7d522740 1 Processor -- start 2024-09-21T00:14:38.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.308+0000 7f9c66a00640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9c4c078b90 0x7f9c4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.308+0000 7f9c7d522740 1 -- start start 2024-09-21T00:14:38.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.309+0000 7f9c66a00640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9c4c078b90 0x7f9c4c07b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9c58033000 tx=0x7f9c58004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.309+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 0x55bdd230cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.309+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f133b0 0x55bdd230d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.309+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f1b590 0x55bdd22dd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.309+0000 7f9c7d522740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bdd2266430 con 0x55bdd1f1b590 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.309+0000 7f9c7d522740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bdd22565d0 con 0x55bdd1f3c270 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.309+0000 7f9c7d522740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55bdd2245a00 con 0x55bdd1f133b0 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f1b590 0x55bdd22dd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 0x55bdd230cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f1b590 0x55bdd22dd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37356/0 (socket says 172.21.15.83:37356) 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c66a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f133b0 0x55bdd230d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6fe00640 1 -- 172.21.15.83:0/4235993090 learned_addr learned my addr 172.21.15.83:0/4235993090 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:38.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6fe00640 1 -- 172.21.15.83:0/4235993090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f133b0 msgr2=0x55bdd230d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:38.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/4235993090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f133b0 0x55bdd230d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6fe00640 1 -- 172.21.15.83:0/4235993090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 msgr2=0x55bdd230cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:38.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/4235993090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 0x55bdd230cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6fe00640 1 -- 172.21.15.83:0/4235993090 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd220e520 con 0x55bdd1f1b590 2024-09-21T00:14:38.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6f400640 1 --2- 172.21.15.83:0/4235993090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 0x55bdd230cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:14:38.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.310+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/4235993090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f1b590 0x55bdd22dd150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c68001ed0 tx=0x7f9c68001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebe735758148593 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:38.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.311+0000 7f9c5fe00640 1 -- 172.21.15.83:0/4235993090 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6800fe50 con 0x55bdd1f1b590 2024-09-21T00:14:38.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.311+0000 7f9c5fe00640 1 -- 172.21.15.83:0/4235993090 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c68018070 con 0x55bdd1f1b590 2024-09-21T00:14:38.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.311+0000 7f9c5fe00640 1 -- 172.21.15.83:0/4235993090 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68003bd0 con 0x55bdd1f1b590 2024-09-21T00:14:38.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.311+0000 7f9c7d522740 1 -- 172.21.15.83:0/4235993090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f1b590 msgr2=0x55bdd22dd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:38.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.311+0000 7f9c7d522740 1 --2- 172.21.15.83:0/4235993090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f1b590 0x55bdd22dd150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c68001ed0 tx=0x7f9c68001630 comp rx=0 tx=0).stop 2024-09-21T00:14:38.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.311+0000 7f9c7d522740 1 -- 172.21.15.83:0/4235993090 shutdown_connections 2024-09-21T00:14:38.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.311+0000 7f9c7d522740 1 --2- 172.21.15.83:0/4235993090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f1b590 0x55bdd22dd150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.311+0000 7f9c7d522740 1 --2- 172.21.15.83:0/4235993090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f133b0 0x55bdd230d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.311+0000 7f9c7d522740 1 --2- 172.21.15.83:0/4235993090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 0x55bdd230cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.312+0000 7f9c7d522740 1 -- 172.21.15.83:0/4235993090 >> 172.21.15.83:0/4235993090 conn(0x55bdd1f303c0 msgr2=0x55bdd22e2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:38.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.312+0000 7f9c7d522740 1 -- 172.21.15.83:0/4235993090 shutdown_connections 2024-09-21T00:14:38.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.312+0000 7f9c7d522740 1 -- 172.21.15.83:0/4235993090 wait complete. 2024-09-21T00:14:38.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.313+0000 7f9c7d522740 1 -- start start 2024-09-21T00:14:38.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.313+0000 7f9c7d522740 1 Processor -- start 2024-09-21T00:14:38.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.314+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f133b0 0x55bdd2321f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.314+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 0x55bdd2321750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.314+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f3c270 0x55bdd2329f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.314+0000 7f9c7d522740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bdd21ec330 con 0x55bdd1f3c270 2024-09-21T00:14:38.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.314+0000 7f9c7d522740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bdd2249810 con 0x55bdd1f133b0 2024-09-21T00:14:38.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.314+0000 7f9c7d522740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55bdd1fb6620 con 0x55bdd1f1b590 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.314+0000 7f9c7d522740 10 client.0 _ll_register_callbacks cb 0x55bdd21f1420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c6fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f3c270 0x55bdd2329f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f133b0 0x55bdd2321f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f133b0 0x55bdd2321f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:42020/0 (socket says 172.21.15.83:42020) 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c6f400640 1 -- 172.21.15.83:0/684120473 learned_addr learned my addr 172.21.15.83:0/684120473 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c66a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 0x55bdd2321750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c6fe00640 1 -- 172.21.15.83:0/684120473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 msgr2=0x55bdd2321750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 0x55bdd2321750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c6fe00640 1 -- 172.21.15.83:0/684120473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f133b0 msgr2=0x55bdd2321f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f133b0 0x55bdd2321f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c6fe00640 1 -- 172.21.15.83:0/684120473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd1fa7850 con 0x55bdd1f3c270 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f3c270 0x55bdd2329f60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c68001ed0 tx=0x7f9c68004fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45dc11034e52c21f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c5cc00640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T00:14:38.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.315+0000 7f9c5cc00640 1 -- 172.21.15.83:0/684120473 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c680052d0 con 0x55bdd1f3c270 2024-09-21T00:14:38.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c7d522740 1 -- 172.21.15.83:0/684120473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c68018070 con 0x55bdd1f3c270 2024-09-21T00:14:38.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c5cc00640 1 -- 172.21.15.83:0/684120473 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9c68005470 con 0x55bdd1f3c270 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c5cc00640 1 -- 172.21.15.83:0/684120473 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9c6802e050 con 0x55bdd1f3c270 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c7d522740 10 client.4806 fetch_fsmap learned FSMap version 9 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c7d522740 1 -- 172.21.15.83:0/684120473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55bdd201e6b0 con 0x55bdd1f3c270 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c5cc00640 1 -- 172.21.15.83:0/684120473 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c68018070 con 0x55bdd1f3c270 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c5cc00640 1 -- 172.21.15.83:0/684120473 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f9c68031020 con 0x55bdd1f3c270 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c7d522740 10 client.4806 fetch_fsmap finished waiting for FSMap version 9 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c7d522740 10 client.4806 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c7d522740 20 client.4806 populate_metadata read hostname 'smithi083' 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c7d522740 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55bdd1efae40 0x55bdd23086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c7d522740 4 client.4806 mds_command: new command op to 4371 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c7d522740 1 -- 172.21.15.83:0/684120473 --> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdd2258520 con 0x55bdd1efae40 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.316+0000 7f9c6f400640 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55bdd1efae40 0x55bdd23086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.317+0000 7f9c6f400640 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55bdd1efae40 0x55bdd23086e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8abb43cdedd65d65 server_cookie=4bdb72c6b92c1549 in_seq=0 out_seq=0 2024-09-21T00:14:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.317+0000 7f9c5cc00640 10 client.4806 ms_handle_connect on v2:172.21.15.83:6832/176272161 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c5cc00640 1 -- 172.21.15.83:0/684120473 <== mds.0 v2:172.21.15.83:6832/176272161 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bdd2258520 con 0x55bdd1efae40 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c5cc00640 10 client.4806 handle_command_reply: tid=0 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 client.4806 shutdown 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 -- 172.21.15.83:0/684120473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f3c270 msgr2=0x55bdd2329f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f3c270 0x55bdd2329f60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c68001ed0 tx=0x7f9c68004fd0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 -- 172.21.15.83:0/684120473 shutdown_connections 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55bdd1efae40 0x55bdd23086e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f3c270 0x55bdd2329f60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 0x55bdd2321750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 --2- 172.21.15.83:0/684120473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f133b0 0x55bdd2321f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c5cc00640 0 client.4806 ms_handle_reset on v2:172.21.15.83:6832/176272161 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 -- 172.21.15.83:0/684120473 >> 172.21.15.83:0/684120473 conn(0x55bdd1f303c0 msgr2=0x55bdd232aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:38.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 -- 172.21.15.83:0/684120473 shutdown_connections 2024-09-21T00:14:38.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 1 -- 172.21.15.83:0/684120473 wait complete. 2024-09-21T00:14:38.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.318+0000 7f9c7d522740 20 client.4806 trim_cache size 0 max 16384 2024-09-21T00:14:38.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.337+0000 7f9c7d522740 1 Processor -- start 2024-09-21T00:14:38.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.337+0000 7f9c7d522740 1 -- start start 2024-09-21T00:14:38.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23209d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f1b590 0x55bdd230c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f3c270 0x55bdd230cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c7d522740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9c702023d0 con 0x55bdd1f133b0 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c7d522740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70201760 con 0x55bdd1f1b590 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c7d522740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9c70201db0 con 0x55bdd1f3c270 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23209d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37370/0 (socket says 172.21.15.83:37370) 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6f400640 1 -- 172.21.15.83:0/3480932769 learned_addr learned my addr 172.21.15.83:0/3480932769 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c66a00640 1 --2- 172.21.15.83:0/3480932769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f1b590 0x55bdd230c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/3480932769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f3c270 0x55bdd230cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6f400640 1 -- 172.21.15.83:0/3480932769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f3c270 msgr2=0x55bdd230cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:38.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6f400640 1 --2- 172.21.15.83:0/3480932769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f3c270 0x55bdd230cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6f400640 1 -- 172.21.15.83:0/3480932769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f1b590 msgr2=0x55bdd230c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:38.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6f400640 1 --2- 172.21.15.83:0/3480932769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f1b590 0x55bdd230c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6f400640 1 -- 172.21.15.83:0/3480932769 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd2322700 con 0x55bdd1f133b0 2024-09-21T00:14:38.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/3480932769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f3c270 0x55bdd230cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:38.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.339+0000 7f9c6f400640 1 --2- 172.21.15.83:0/3480932769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23209d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c60062b80 tx=0x7f9c60066040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c536c30c0b5a2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:38.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.340+0000 7f9c5f400640 1 -- 172.21.15.83:0/3480932769 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60021040 con 0x55bdd1f133b0 2024-09-21T00:14:38.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.340+0000 7f9c5f400640 1 -- 172.21.15.83:0/3480932769 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c6004e170 con 0x55bdd1f133b0 2024-09-21T00:14:38.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.340+0000 7f9c5f400640 1 -- 172.21.15.83:0/3480932769 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6006c4d0 con 0x55bdd1f133b0 2024-09-21T00:14:38.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.340+0000 7f9c7d522740 1 -- 172.21.15.83:0/3480932769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 msgr2=0x55bdd23209d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:38.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.340+0000 7f9c7d522740 1 --2- 172.21.15.83:0/3480932769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23209d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c60062b80 tx=0x7f9c60066040 comp rx=0 tx=0).stop 2024-09-21T00:14:38.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.340+0000 7f9c7d522740 1 -- 172.21.15.83:0/3480932769 shutdown_connections 2024-09-21T00:14:38.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.340+0000 7f9c7d522740 1 --2- 172.21.15.83:0/3480932769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f3c270 0x55bdd230cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.340+0000 7f9c7d522740 1 --2- 172.21.15.83:0/3480932769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f1b590 0x55bdd230c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.340+0000 7f9c7d522740 1 --2- 172.21.15.83:0/3480932769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23209d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.340+0000 7f9c7d522740 1 -- 172.21.15.83:0/3480932769 >> 172.21.15.83:0/3480932769 conn(0x55bdd1f303c0 msgr2=0x55bdd230bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:38.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.341+0000 7f9c7d522740 1 -- 172.21.15.83:0/3480932769 shutdown_connections 2024-09-21T00:14:38.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.341+0000 7f9c7d522740 1 -- 172.21.15.83:0/3480932769 wait complete. 2024-09-21T00:14:38.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.341+0000 7f9c7d522740 1 -- start start 2024-09-21T00:14:38.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.342+0000 7f9c7d522740 1 Processor -- start 2024-09-21T00:14:38.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.343+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.343+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 0x55bdd23a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.343+0000 7f9c7d522740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 0x55bdd232aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.343+0000 7f9c7d522740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bdd2309760 con 0x55bdd1f133b0 2024-09-21T00:14:38.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.343+0000 7f9c7d522740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bdd23081c0 con 0x55bdd1f3c270 2024-09-21T00:14:38.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.343+0000 7f9c7d522740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55bdd2305f80 con 0x55bdd1f1b590 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.343+0000 7f9c7d522740 10 client.0 _ll_register_callbacks cb 0x7f9c68001d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.343+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.343+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23a7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37372/0 (socket says 172.21.15.83:37372) 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.343+0000 7f9c6f400640 1 -- 172.21.15.83:0/2464958241 learned_addr learned my addr 172.21.15.83:0/2464958241 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c66a00640 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 0x55bdd23a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 0x55bdd232aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c6f400640 1 -- 172.21.15.83:0/2464958241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 msgr2=0x55bdd23a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c6f400640 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 0x55bdd23a6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c6f400640 1 -- 172.21.15.83:0/2464958241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 msgr2=0x55bdd232aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c6f400640 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 0x55bdd232aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c6f400640 1 -- 172.21.15.83:0/2464958241 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd2303ac0 con 0x55bdd1f133b0 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c66a00640 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 0x55bdd23a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:38.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c6fe00640 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 0x55bdd232aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c6f400640 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23a7d30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009610 tx=0x7f9c6005f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3199c1e6082d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c5cc00640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c5cc00640 1 -- 172.21.15.83:0/2464958241 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60021070 con 0x55bdd1f133b0 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c5cc00640 1 -- 172.21.15.83:0/2464958241 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9c60067320 con 0x55bdd1f133b0 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.344+0000 7f9c7d522740 1 -- 172.21.15.83:0/2464958241 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c6004e170 con 0x55bdd1f133b0 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c5cc00640 1 -- 172.21.15.83:0/2464958241 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9c60070070 con 0x55bdd1f133b0 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c7d522740 10 client.4812 fetch_fsmap learned FSMap version 9 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c7d522740 1 -- 172.21.15.83:0/2464958241 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55bdd23a7870 con 0x55bdd1f133b0 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c5cc00640 1 -- 172.21.15.83:0/2464958241 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c6004e170 con 0x55bdd1f133b0 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c5cc00640 1 -- 172.21.15.83:0/2464958241 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f9c60061f40 con 0x55bdd1f133b0 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c7d522740 10 client.4812 fetch_fsmap finished waiting for FSMap version 9 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c7d522740 10 client.4812 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c7d522740 20 client.4812 populate_metadata read hostname 'smithi083' 2024-09-21T00:14:38.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c7d522740 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55bdd23aac60 0x55bdd230c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:38.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c7d522740 4 client.4812 mds_command: new command op to 4371 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:14:38.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c7d522740 1 -- 172.21.15.83:0/2464958241 --> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] -- command(tid 0: {"prefix": "status"}) -- 0x55bdd22e21a0 con 0x55bdd23aac60 2024-09-21T00:14:38.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.345+0000 7f9c66a00640 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55bdd23aac60 0x55bdd230c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:38.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c5cc00640 10 client.4812 ms_handle_connect on v2:172.21.15.83:6832/176272161 2024-09-21T00:14:38.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c66a00640 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55bdd23aac60 0x55bdd230c610 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6353b0de09b4684d server_cookie=f4c7f23192bf2407 in_seq=0 out_seq=0 2024-09-21T00:14:38.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c5cc00640 1 -- 172.21.15.83:0/2464958241 <== mds.0 v2:172.21.15.83:6832/176272161 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55bdd22e21a0 con 0x55bdd23aac60 2024-09-21T00:14:38.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c5cc00640 10 client.4812 handle_command_reply: tid=0 2024-09-21T00:14:38.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c7d522740 1 client.4812 shutdown 2024-09-21T00:14:38.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c7d522740 1 -- 172.21.15.83:0/2464958241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 msgr2=0x55bdd23a7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:38.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c7d522740 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23a7d30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009610 tx=0x7f9c6005f370 comp rx=0 tx=0).stop 2024-09-21T00:14:38.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c7d522740 1 -- 172.21.15.83:0/2464958241 shutdown_connections 2024-09-21T00:14:38.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c7d522740 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bdd1f3c270 0x55bdd232aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c7d522740 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bdd1f1b590 0x55bdd23a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c7d522740 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.83:6832/176272161,v1:172.21.15.83:6834/176272161] conn(0x55bdd23aac60 0x55bdd230c610 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c7d522740 1 --2- 172.21.15.83:0/2464958241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bdd1f133b0 0x55bdd23a7d30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c5cc00640 0 client.4812 ms_handle_reset on v2:172.21.15.83:6832/176272161 2024-09-21T00:14:38.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.346+0000 7f9c7d522740 1 -- 172.21.15.83:0/2464958241 >> 172.21.15.83:0/2464958241 conn(0x55bdd1f303c0 msgr2=0x55bdd23209d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:38.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c7d522740 1 -- 172.21.15.83:0/2464958241 shutdown_connections 2024-09-21T00:14:38.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c7d522740 1 -- 172.21.15.83:0/2464958241 wait complete. 2024-09-21T00:14:38.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c7d522740 20 client.4812 trim_cache size 0 max 16384 2024-09-21T00:14:38.352 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:14:38.352 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "d4df3382-b453-41c4-9497-6203e3b4e46e", 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4371, 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 28.398966914999999, 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 9, 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 27, 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 27, 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 34.452862244000002 2024-09-21T00:14:38.353 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:14:38.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 -- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9c4c078b90 msgr2=0x7f9c4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:38.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9c4c078b90 0x7f9c4c07b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9c58033000 tx=0x7f9c58004730 comp rx=0 tx=0).stop 2024-09-21T00:14:38.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 -- 172.21.15.83:0/1426869613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c700cef00 msgr2=0x7f9c701f2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:38.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c700cef00 0x7f9c701f2850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000d770 tx=0x7f9c6000dc30 comp rx=0 tx=0).stop 2024-09-21T00:14:38.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 -- 172.21.15.83:0/1426869613 shutdown_connections 2024-09-21T00:14:38.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9c4c078b90 0x7f9c4c07b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c70162240 0x7f9c701f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c7015f6d0 0x7f9c70161100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 --2- 172.21.15.83:0/1426869613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c700cef00 0x7f9c701f2850 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:38.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 -- 172.21.15.83:0/1426869613 >> 172.21.15.83:0/1426869613 conn(0x7f9c700d41e0 msgr2=0x7f9c700b6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:38.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 -- 172.21.15.83:0/1426869613 shutdown_connections 2024-09-21T00:14:38.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:38.347+0000 7f9c75200640 1 -- 172.21.15.83:0/1426869613 wait complete. 2024-09-21T00:14:38.371 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T00:14:38.386 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T00:14:38.386 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-21T00:14:38.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:38.386 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T00:14:38.421 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T00:14:38.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:38.422 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T00:14:38.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:38.518 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-09-21T00:14:38.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:38.807 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T00:14:38.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:38.843 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-09-21T00:14:38.942 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2024-09-21T00:14:38.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:14:38.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:38.945 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-21T00:14:38.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:38.986 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-21T00:14:39.091 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-09-21T00:14:39.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:14:39.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:39.094 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-21T00:14:39.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:39.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-21T00:14:39.230 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-09-21T00:14:39.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:14:39.233 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-21T00:14:39.233 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T00:14:39.233 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:14:39.234 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T00:14:39.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.452+0000 7f6184a00640 1 -- 172.21.15.83:0/3105512837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6180152530 msgr2=0x7f61800b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:39.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.452+0000 7f6184a00640 1 --2- 172.21.15.83:0/3105512837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6180152530 0x7f61800b3490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6168009830 tx=0x7f616802a510 comp rx=0 tx=0).stop 2024-09-21T00:14:39.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.452+0000 7f6184a00640 1 -- 172.21.15.83:0/3105512837 shutdown_connections 2024-09-21T00:14:39.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.452+0000 7f6184a00640 1 --2- 172.21.15.83:0/3105512837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6180152530 0x7f61800b3490 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:39.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.452+0000 7f6184a00640 1 --2- 172.21.15.83:0/3105512837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6180073dd0 0x7f618015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:39.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.452+0000 7f6184a00640 1 -- 172.21.15.83:0/3105512837 >> 172.21.15.83:0/3105512837 conn(0x7f618006f940 msgr2=0x7f61800b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:39.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.452+0000 7f6184a00640 1 -- 172.21.15.83:0/3105512837 shutdown_connections 2024-09-21T00:14:39.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.452+0000 7f6184a00640 1 -- 172.21.15.83:0/3105512837 wait complete. 2024-09-21T00:14:39.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.455+0000 7f6184a00640 1 Processor -- start 2024-09-21T00:14:39.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.455+0000 7f6184a00640 1 -- start start 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.456+0000 7f6184a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6180073dd0 0x7f618014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.456+0000 7f6184a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61800b39d0 0x7f61801e9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.456+0000 7f6184a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6180152530 0x7f61801f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.456+0000 7f6184a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f61800cf5b0 con 0x7f6180152530 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.456+0000 7f6184a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f61800cf430 con 0x7f6180073dd0 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.456+0000 7f6184a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f61800cf730 con 0x7f61800b39d0 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.456+0000 7f617fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6180152530 0x7f61801f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f6176a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61800b39d0 0x7f61801e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f617f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6180073dd0 0x7f618014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f617fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6180152530 0x7f61801f9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37392/0 (socket says 172.21.15.83:37392) 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f617fe00640 1 -- 172.21.15.83:0/3206106017 learned_addr learned my addr 172.21.15.83:0/3206106017 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:39.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f6176a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61800b39d0 0x7f61801e9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:39526/0 (socket says 172.21.15.83:39526) 2024-09-21T00:14:39.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f617fe00640 1 -- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61800b39d0 msgr2=0x7f61801e9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:39.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f617fe00640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61800b39d0 0x7f61801e9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:39.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f617fe00640 1 -- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6180073dd0 msgr2=0x7f618014fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:39.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f617fe00640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6180073dd0 0x7f618014fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:39.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f617fe00640 1 -- 172.21.15.83:0/3206106017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61800aff90 con 0x7f6180152530 2024-09-21T00:14:39.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.457+0000 7f617fe00640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6180152530 0x7f61801f9200 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f617800c9f0 tx=0x7f617800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:39.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.458+0000 7f6177e00640 1 -- 172.21.15.83:0/3206106017 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178016020 con 0x7f6180152530 2024-09-21T00:14:39.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.458+0000 7f6184a00640 1 -- 172.21.15.83:0/3206106017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61800b0270 con 0x7f6180152530 2024-09-21T00:14:39.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.458+0000 7f6177e00640 1 -- 172.21.15.83:0/3206106017 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f617800ac60 con 0x7f6180152530 2024-09-21T00:14:39.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.458+0000 7f6177e00640 1 -- 172.21.15.83:0/3206106017 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178012680 con 0x7f6180152530 2024-09-21T00:14:39.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.458+0000 7f6184a00640 1 -- 172.21.15.83:0/3206106017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61800b0830 con 0x7f6180152530 2024-09-21T00:14:39.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.459+0000 7f6184a00640 1 -- 172.21.15.83:0/3206106017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61800cfbe0 con 0x7f6180152530 2024-09-21T00:14:39.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.460+0000 7f6177e00640 1 -- 172.21.15.83:0/3206106017 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6178019020 con 0x7f6180152530 2024-09-21T00:14:39.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.461+0000 7f6177e00640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f615c078b90 0x7f615c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:39.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.461+0000 7f6177e00640 1 -- 172.21.15.83:0/3206106017 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f617809b610 con 0x7f6180152530 2024-09-21T00:14:39.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.461+0000 7f617f400640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f615c078b90 0x7f615c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:39.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.462+0000 7f617f400640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f615c078b90 0x7f615c07b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6170009b30 tx=0x7f6170005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:39.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.465+0000 7f6177e00640 1 -- 172.21.15.83:0/3206106017 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6178020020 con 0x7f6180152530 2024-09-21T00:14:39.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.688+0000 7f6184a00640 1 -- 172.21.15.83:0/3206106017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f61800b0a00 con 0x7f6180152530 2024-09-21T00:14:39.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.689+0000 7f6177e00640 1 -- 172.21.15.83:0/3206106017 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f618015c8f0 con 0x7f6180152530 2024-09-21T00:14:39.691 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T00:14:39.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 -- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f615c078b90 msgr2=0x7f615c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:39.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f615c078b90 0x7f615c07b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6170009b30 tx=0x7f6170005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:39.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 -- 172.21.15.83:0/3206106017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6180152530 msgr2=0x7f61801f9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:39.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6180152530 0x7f61801f9200 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f617800c9f0 tx=0x7f617800ceb0 comp rx=0 tx=0).stop 2024-09-21T00:14:39.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 -- 172.21.15.83:0/3206106017 shutdown_connections 2024-09-21T00:14:39.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f615c078b90 0x7f615c07b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:39.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6180152530 0x7f61801f9200 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:39.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61800b39d0 0x7f61801e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:39.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 --2- 172.21.15.83:0/3206106017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6180073dd0 0x7f618014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:39.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 -- 172.21.15.83:0/3206106017 >> 172.21.15.83:0/3206106017 conn(0x7f618006f940 msgr2=0x7f618006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:39.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 -- 172.21.15.83:0/3206106017 shutdown_connections 2024-09-21T00:14:39.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39.691+0000 7f6184a00640 1 -- 172.21.15.83:0/3206106017 wait complete. 2024-09-21T00:14:39.715 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T00:14:39.715 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:14:39.716 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-09-21T00:14:39.716 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T00:14:39.716 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:14:39.716 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T00:14:39.716 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T00:14:39.716 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:14:39.716 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:14:39.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:39.716 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-09-21T00:14:39.752 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:39.753 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:14:39.754 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:39.754 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T00:14:39.754 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42696sec preferred_lft 42696sec 2024-09-21T00:14:39.754 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2024-09-21T00:14:39.754 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:39.754 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T00:14:39.754 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:39.754 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:39.754 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2024-09-21T00:14:39.754 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2024-09-21T00:14:39.755 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2024-09-21T00:14:39.755 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T00:14:39.755 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:39.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:39.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:39.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:39.978 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:14:40.032 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-09-21T00:14:40.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:40.035 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-09-21T00:14:40.072 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-09-21T00:14:40.072 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:14:40.072 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T00:14:40.072 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T00:14:40.072 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:14:40.072 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:40.072 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:40.072 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T00:14:40.073 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T00:14:40.073 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T00:14:40.073 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:40.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:40.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:40.268 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T00:14:40.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:40.304 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-09-21T00:14:40.379 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:40.379 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:40.379 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:14:40.379 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T00:14:40.380 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:40.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:40.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:40.554 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T00:14:40.554 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:40.554 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:40.554 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T00:14:40.554 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T00:14:40.555 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T00:14:40.555 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T00:14:40.555 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T00:14:40.555 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:40.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:40.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:40.770 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:40.770 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:40.770 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-09-21T00:14:40.770 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T00:14:40.770 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:40.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:40.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:40.936 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:14:40.936 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T00:14:40.972 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:14:40.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:14:40.973 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:14:41.047 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T00:14:41.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:41.048 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T00:14:41.244 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T00:14:41.244 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T00:14:41.244 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2024-09-21T00:14:41.876 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T00:14:41.876 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T00:14:41.876 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2024-09-21T00:14:41.876 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.83:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-09-21T00:14:41.876 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T00:14:41.910 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T00:14:41.910 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T00:14:41.910 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2024-09-21T00:14:41.910 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.83:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-09-21T00:14:41.910 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T00:14:41.910 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.83:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-09-21T00:14:41.910 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.83:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-09-21T00:14:41.910 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=d4df3382-b453-41c4-9497-6203e3b4e46e" will pass to kernel 2024-09-21T00:14:41.912 INFO:teuthology.orchestra.run.smithi083.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T00:14:41.912 INFO:teuthology.orchestra.run.smithi083.stdout: You just mounted a file system that supports labels which does not 2024-09-21T00:14:41.912 INFO:teuthology.orchestra.run.smithi083.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T00:14:41.912 INFO:teuthology.orchestra.run.smithi083.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T00:14:41.912 INFO:teuthology.orchestra.run.smithi083.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T00:14:41.915 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T00:14:41.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:41.916 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:14:41.974 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:42.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:42.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:42.066 INFO:teuthology.orchestra.run.smithi083.stdout:client4613 2024-09-21T00:14:42.066 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:14:42.066 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:42.102 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:42.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:42.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:42.230 INFO:teuthology.orchestra.run.smithi083.stdout:client4613 2024-09-21T00:14:42.230 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:42.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:42.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:42.318 INFO:teuthology.orchestra.run.smithi083.stdout:client4613 2024-09-21T00:14:42.319 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4df3382-b453-41c4-9497-6203e3b4e46e.client4613/status') 2024-09-21T00:14:42.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:42.429 INFO:teuthology.orchestra.run.smithi083.stdout:instance: client.4613 (3)172.21.15.83:0/1122722793 2024-09-21T00:14:42.430 INFO:teuthology.orchestra.run.smithi083.stdout:blocklisted: false 2024-09-21T00:14:42.430 INFO:teuthology.orchestra.run.smithi083.stderr:0+1 records in 2024-09-21T00:14:42.430 INFO:teuthology.orchestra.run.smithi083.stderr:0+1 records out 2024-09-21T00:14:42.430 INFO:teuthology.orchestra.run.smithi083.stderr:70 bytes copied, 5.2305e-05 s, 1.3 MB/s 2024-09-21T00:14:42.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:42.441 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-21T00:14:42.441 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T00:14:42.441 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T00:14:42.441 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T00:14:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.664+0000 7f9849a00640 1 -- 172.21.15.83:0/1110707185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9828004d40 msgr2=0x7f98280051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.664+0000 7f9849a00640 1 --2- 172.21.15.83:0/1110707185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9828004d40 0x7f98280051f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f983c009ed0 tx=0x7f9828005830 comp rx=0 tx=0).stop 2024-09-21T00:14:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.664+0000 7f9849000640 1 -- 172.21.15.83:0/1110707185 reap_dead start 2024-09-21T00:14:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.664+0000 7f9849a00640 1 -- 172.21.15.83:0/1110707185 shutdown_connections 2024-09-21T00:14:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.664+0000 7f9849a00640 1 -- 172.21.15.83:0/1110707185 >> 172.21.15.83:0/1110707185 conn(0x7f984406f940 msgr2=0x7f98440b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.664+0000 7f9849a00640 1 -- 172.21.15.83:0/1110707185 shutdown_connections 2024-09-21T00:14:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.664+0000 7f9849a00640 1 -- 172.21.15.83:0/1110707185 wait complete. 2024-09-21T00:14:42.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.667+0000 7f9849a00640 1 Processor -- start 2024-09-21T00:14:42.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.667+0000 7f9849a00640 1 -- start start 2024-09-21T00:14:42.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.668+0000 7f9849a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9828004d40 0x7f98441409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:42.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.668+0000 7f9849a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f984415ddb0 0x7f984415a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:42.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.668+0000 7f9849a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f984415e1c0 0x7f984415a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:42.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.668+0000 7f9849a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f98440cf220 con 0x7f984415e1c0 2024-09-21T00:14:42.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.668+0000 7f9849a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f984406e5c0 con 0x7f9828004d40 2024-09-21T00:14:42.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.668+0000 7f9849a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f98440cf3a0 con 0x7f984415ddb0 2024-09-21T00:14:42.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9849000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f984415e1c0 0x7f984415a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9849000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f984415e1c0 0x7f984415a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36512/0 (socket says 172.21.15.83:36512) 2024-09-21T00:14:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9849000640 1 -- 172.21.15.83:0/3930346390 learned_addr learned my addr 172.21.15.83:0/3930346390 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9843400640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f984415ddb0 0x7f984415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9843e00640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9828004d40 0x7f98441409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9849000640 1 -- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f984415ddb0 msgr2=0x7f984415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9849000640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f984415ddb0 0x7f984415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9849000640 1 -- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9828004d40 msgr2=0x7f98441409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9849000640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9828004d40 0x7f98441409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:42.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9849000640 1 -- 172.21.15.83:0/3930346390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984415cd20 con 0x7f984415e1c0 2024-09-21T00:14:42.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.669+0000 7f9849000640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f984415e1c0 0x7f984415a940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f983c036040 tx=0x7f983c033bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:42.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.670+0000 7f983be00640 1 -- 172.21.15.83:0/3930346390 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c043070 con 0x7f984415e1c0 2024-09-21T00:14:42.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.670+0000 7f983be00640 1 -- 172.21.15.83:0/3930346390 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f983c033ce0 con 0x7f984415e1c0 2024-09-21T00:14:42.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.670+0000 7f983be00640 1 -- 172.21.15.83:0/3930346390 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c038040 con 0x7f984415e1c0 2024-09-21T00:14:42.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.670+0000 7f9849a00640 1 -- 172.21.15.83:0/3930346390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984415d000 con 0x7f984415e1c0 2024-09-21T00:14:42.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.670+0000 7f9849a00640 1 -- 172.21.15.83:0/3930346390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f984415d5c0 con 0x7f984415e1c0 2024-09-21T00:14:42.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.671+0000 7f9849a00640 1 -- 172.21.15.83:0/3930346390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98440cf900 con 0x7f984415e1c0 2024-09-21T00:14:42.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.672+0000 7f983be00640 1 -- 172.21.15.83:0/3930346390 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f983c003bd0 con 0x7f984415e1c0 2024-09-21T00:14:42.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.673+0000 7f983be00640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9824078b90 0x7f982407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:42.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.674+0000 7f983be00640 1 -- 172.21.15.83:0/3930346390 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f983c0bb060 con 0x7f984415e1c0 2024-09-21T00:14:42.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.674+0000 7f9843e00640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9824078b90 0x7f982407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:42.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.675+0000 7f9843e00640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9824078b90 0x7f982407b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9834000c00 tx=0x7f9834006b70 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:42.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.678+0000 7f983be00640 1 -- 172.21.15.83:0/3930346390 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f983c082a70 con 0x7f984415e1c0 2024-09-21T00:14:42.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.908+0000 7f9849a00640 1 -- 172.21.15.83:0/3930346390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f98440b1d50 con 0x7f984415e1c0 2024-09-21T00:14:42.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.908+0000 7f983be00640 1 -- 172.21.15.83:0/3930346390 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f983c0874a0 con 0x7f984415e1c0 2024-09-21T00:14:42.910 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T00:14:42.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 -- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9824078b90 msgr2=0x7f982407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:42.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9824078b90 0x7f982407b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9834000c00 tx=0x7f9834006b70 comp rx=0 tx=0).stop 2024-09-21T00:14:42.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 -- 172.21.15.83:0/3930346390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f984415e1c0 msgr2=0x7f984415a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:42.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f984415e1c0 0x7f984415a940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f983c036040 tx=0x7f983c033bf0 comp rx=0 tx=0).stop 2024-09-21T00:14:42.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 -- 172.21.15.83:0/3930346390 shutdown_connections 2024-09-21T00:14:42.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9824078b90 0x7f982407b0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:42.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f984415e1c0 0x7f984415a940 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:42.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f984415ddb0 0x7f984415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:42.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 --2- 172.21.15.83:0/3930346390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9828004d40 0x7f98441409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:42.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 -- 172.21.15.83:0/3930346390 >> 172.21.15.83:0/3930346390 conn(0x7f984406f940 msgr2=0x7f98440b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:42.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 -- 172.21.15.83:0/3930346390 shutdown_connections 2024-09-21T00:14:42.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:42.911+0000 7f9849a00640 1 -- 172.21.15.83:0/3930346390 wait complete. 2024-09-21T00:14:42.935 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T00:14:42.936 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:14:42.936 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-09-21T00:14:42.936 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-21T00:14:42.936 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T00:14:42.936 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T00:14:42.936 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T00:14:42.936 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:14:42.936 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-21T00:14:42.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:42.936 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-09-21T00:14:42.973 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:14:42.973 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:14:42.973 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:14:42.973 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:42.973 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-09-21T00:14:42.973 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:42.973 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:42.973 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42693sec preferred_lft 42693sec 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:42.974 INFO:teuthology.orchestra.run.smithi083.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T00:14:42.975 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether fe:84:23:45:d0:de brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:42.975 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T00:14:42.975 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:42.975 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::dc71:dfff:fe34:5f84/64 scope link 2024-09-21T00:14:42.975 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:42.975 INFO:teuthology.orchestra.run.smithi083.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T00:14:42.975 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether fe:84:23:45:d0:de brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:14:42.975 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::fc84:23ff:fe45:d0de/64 scope link 2024-09-21T00:14:42.975 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:42.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:42.975 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:14:43.067 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-09-21T00:14:43.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:43.070 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-09-21T00:14:43.106 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-09-21T00:14:43.107 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:14:43.107 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T00:14:43.107 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T00:14:43.107 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:14:43.107 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:43.107 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:43.107 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T00:14:43.107 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T00:14:43.107 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T00:14:43.107 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:43.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:43.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:43.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:43.311 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T00:14:43.346 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T00:14:43.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:43.347 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-09-21T00:14:43.423 INFO:teuthology.orchestra.run.smithi083.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-21T00:14:43.423 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:43.423 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:43.423 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T00:14:43.423 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-21T00:14:43.423 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:43.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:43.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:43.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:43.605 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T00:14:43.662 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:14:43.662 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:14:43.662 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:14:43.662 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:43.662 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-09-21T00:14:43.662 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:43.663 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T00:14:43.663 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether a2:04:a3:12:70:46 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T00:14:43.663 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T00:14:43.663 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:43.663 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::a004:a3ff:fe12:7046/64 scope link 2024-09-21T00:14:43.663 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:43.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:43.665 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T00:14:43.721 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:14:43.721 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:14:43.721 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:14:43.721 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:43.721 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-09-21T00:14:43.721 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:43.721 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T00:14:43.721 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether a2:04:a3:12:70:46 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T00:14:43.721 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T00:14:43.722 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:43.722 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::a004:a3ff:fe12:7046/64 scope link 2024-09-21T00:14:43.722 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:43.726 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-21T00:14:43.726 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:43.726 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:43.726 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-21T00:14:43.726 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T00:14:43.727 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-21T00:14:43.727 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-21T00:14:43.727 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-21T00:14:43.727 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:43.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:43.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:43.954 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:43.954 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:14:43.954 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.1 up 2024-09-21T00:14:43.954 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T00:14:43.955 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:14:44.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:44.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:44.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:14:44.123 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-21T00:14:44.159 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-21T00:14:44.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:14:44.159 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-21T00:14:44.234 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T00:14:44.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:44.234 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-21T00:14:44.431 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-21T00:14:44.431 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-21T00:14:44.432 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2024-09-21T00:14:44.452 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-21T00:14:44.452 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-21T00:14:44.452 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2024-09-21T00:14:44.452 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.83:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-09-21T00:14:44.452 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T00:14:44.484 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-21T00:14:44.484 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-21T00:14:44.485 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2024-09-21T00:14:44.485 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.83:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-09-21T00:14:44.485 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T00:14:44.485 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.83:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-09-21T00:14:44.485 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.83:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-09-21T00:14:44.485 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=d4df3382-b453-41c4-9497-6203e3b4e46e" will pass to kernel 2024-09-21T00:14:44.486 INFO:teuthology.orchestra.run.smithi083.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-21T00:14:44.486 INFO:teuthology.orchestra.run.smithi083.stdout: You just mounted a file system that supports labels which does not 2024-09-21T00:14:44.486 INFO:teuthology.orchestra.run.smithi083.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T00:14:44.486 INFO:teuthology.orchestra.run.smithi083.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T00:14:44.486 INFO:teuthology.orchestra.run.smithi083.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T00:14:44.489 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T00:14:44.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:44.490 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-21T00:14:44.546 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:44.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:44.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:44.635 INFO:teuthology.orchestra.run.smithi083.stdout:client4622 2024-09-21T00:14:44.635 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:14:44.635 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:44.671 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:44.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:44.800 INFO:teuthology.orchestra.run.smithi083.stdout:client4622 2024-09-21T00:14:44.801 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:44.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:44.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:44.890 INFO:teuthology.orchestra.run.smithi083.stdout:client4622 2024-09-21T00:14:44.891 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4df3382-b453-41c4-9497-6203e3b4e46e.client4622/status') 2024-09-21T00:14:44.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:44.990 INFO:teuthology.orchestra.run.smithi083.stdout:instance: client.4622 (3)172.21.15.83:0/1817164834 2024-09-21T00:14:44.990 INFO:teuthology.orchestra.run.smithi083.stdout:blocklisted: false 2024-09-21T00:14:44.990 INFO:teuthology.orchestra.run.smithi083.stderr:0+1 records in 2024-09-21T00:14:44.990 INFO:teuthology.orchestra.run.smithi083.stderr:0+1 records out 2024-09-21T00:14:44.990 INFO:teuthology.orchestra.run.smithi083.stderr:70 bytes copied, 5.5118e-05 s, 1.3 MB/s 2024-09-21T00:14:44.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:45.001 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-21T00:14:45.001 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T00:14:45.001 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T00:14:45.001 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T00:14:45.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.226+0000 7fd35b200640 1 -- 172.21.15.83:0/1206643637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340004020 msgr2=0x7fd340004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:45.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.226+0000 7fd35b200640 1 --2- 172.21.15.83:0/1206643637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340004020 0x7fd340004800 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd344009b20 tx=0x7fd340005830 comp rx=0 tx=0).stop 2024-09-21T00:14:45.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.226+0000 7fd35a800640 1 -- 172.21.15.83:0/1206643637 reap_dead start 2024-09-21T00:14:45.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.226+0000 7fd35b200640 1 -- 172.21.15.83:0/1206643637 shutdown_connections 2024-09-21T00:14:45.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.226+0000 7fd35b200640 1 -- 172.21.15.83:0/1206643637 >> 172.21.15.83:0/1206643637 conn(0x7fd35c0d0d40 msgr2=0x7fd35c0d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:45.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.226+0000 7fd35b200640 1 -- 172.21.15.83:0/1206643637 shutdown_connections 2024-09-21T00:14:45.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.226+0000 7fd35b200640 1 -- 172.21.15.83:0/1206643637 wait complete. 2024-09-21T00:14:45.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.228+0000 7fd35b200640 1 Processor -- start 2024-09-21T00:14:45.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.228+0000 7fd35b200640 1 -- start start 2024-09-21T00:14:45.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd340004020 0x7fd35c0acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c0aab90 0x7fd35c15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35b200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd35c160390 0x7fd35c1607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35b200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c0b7760 con 0x7fd35c160390 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c06e660 con 0x7fd35c0aab90 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd35c0b78e0 con 0x7fd340004020 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35a800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd35c160390 0x7fd35c1607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35a800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd35c160390 0x7fd35c1607a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36536/0 (socket says 172.21.15.83:36536) 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35a800640 1 -- 172.21.15.83:0/1237680267 learned_addr learned my addr 172.21.15.83:0/1237680267 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd359e00640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd340004020 0x7fd35c0acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd351400640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c0aab90 0x7fd35c15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35a800640 1 -- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd340004020 msgr2=0x7fd35c0acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:45.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35a800640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd340004020 0x7fd35c0acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:45.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35a800640 1 -- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c0aab90 msgr2=0x7fd35c15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:45.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35a800640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c0aab90 0x7fd35c15abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:45.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.230+0000 7fd35a800640 1 -- 172.21.15.83:0/1237680267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c160ce0 con 0x7fd35c160390 2024-09-21T00:14:45.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.231+0000 7fd35a800640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd35c160390 0x7fd35c1607a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd354000f80 tx=0x7fd35400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:45.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.231+0000 7fd352a00640 1 -- 172.21.15.83:0/1237680267 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354015070 con 0x7fd35c160390 2024-09-21T00:14:45.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.231+0000 7fd352a00640 1 -- 172.21.15.83:0/1237680267 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd35400cb00 con 0x7fd35c160390 2024-09-21T00:14:45.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.231+0000 7fd35b200640 1 -- 172.21.15.83:0/1237680267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35c1f5280 con 0x7fd35c160390 2024-09-21T00:14:45.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.231+0000 7fd352a00640 1 -- 172.21.15.83:0/1237680267 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354011460 con 0x7fd35c160390 2024-09-21T00:14:45.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.231+0000 7fd35b200640 1 -- 172.21.15.83:0/1237680267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35c1f8fe0 con 0x7fd35c160390 2024-09-21T00:14:45.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.232+0000 7fd35b200640 1 -- 172.21.15.83:0/1237680267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd35c0b7e40 con 0x7fd35c160390 2024-09-21T00:14:45.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.233+0000 7fd352a00640 1 -- 172.21.15.83:0/1237680267 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd354018070 con 0x7fd35c160390 2024-09-21T00:14:45.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.234+0000 7fd352a00640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd338078b90 0x7fd33807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:45.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.234+0000 7fd352a00640 1 -- 172.21.15.83:0/1237680267 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd35409b480 con 0x7fd35c160390 2024-09-21T00:14:45.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.235+0000 7fd359e00640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd338078b90 0x7fd33807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:45.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.236+0000 7fd359e00640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd338078b90 0x7fd33807b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd34c000c00 tx=0x7fd34c006b70 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:45.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.239+0000 7fd352a00640 1 -- 172.21.15.83:0/1237680267 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd35c160ce0 con 0x7fd35c160390 2024-09-21T00:14:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.460+0000 7fd35b200640 1 -- 172.21.15.83:0/1237680267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd35c1f8a90 con 0x7fd35c160390 2024-09-21T00:14:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.460+0000 7fd352a00640 1 -- 172.21.15.83:0/1237680267 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fd354062fb0 con 0x7fd35c160390 2024-09-21T00:14:45.462 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T00:14:45.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 -- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd338078b90 msgr2=0x7fd33807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:45.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd338078b90 0x7fd33807b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd34c000c00 tx=0x7fd34c006b70 comp rx=0 tx=0).stop 2024-09-21T00:14:45.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 -- 172.21.15.83:0/1237680267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd35c160390 msgr2=0x7fd35c1607a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:45.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd35c160390 0x7fd35c1607a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd354000f80 tx=0x7fd35400eb20 comp rx=0 tx=0).stop 2024-09-21T00:14:45.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 -- 172.21.15.83:0/1237680267 shutdown_connections 2024-09-21T00:14:45.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd338078b90 0x7fd33807b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:45.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd35c160390 0x7fd35c1607a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:45.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c0aab90 0x7fd35c15abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:45.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 --2- 172.21.15.83:0/1237680267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd340004020 0x7fd35c0acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:45.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 -- 172.21.15.83:0/1237680267 >> 172.21.15.83:0/1237680267 conn(0x7fd35c0d0d40 msgr2=0x7fd35c0cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:45.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 -- 172.21.15.83:0/1237680267 shutdown_connections 2024-09-21T00:14:45.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:45.463+0000 7fd35b200640 1 -- 172.21.15.83:0/1237680267 wait complete. 2024-09-21T00:14:45.486 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T00:14:45.486 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:14:45.486 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-09-21T00:14:45.486 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T00:14:45.486 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T00:14:45.486 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T00:14:45.486 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T00:14:45.486 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:14:45.486 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T00:14:45.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:45.486 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-09-21T00:14:45.526 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:14:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:14:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:14:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-09-21T00:14:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:45.526 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42685sec preferred_lft 42685sec 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2024-09-21T00:14:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:45.528 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T00:14:45.528 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:45.528 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-21T00:14:45.528 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2024-09-21T00:14:45.529 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2024-09-21T00:14:45.529 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2024-09-21T00:14:45.529 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T00:14:45.529 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-21T00:14:45.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:45.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:45.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:45.938 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:14:45.995 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-09-21T00:14:45.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:45.999 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-09-21T00:14:46.076 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-09-21T00:14:46.076 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:14:46.076 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T00:14:46.076 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T00:14:46.077 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:14:46.077 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:46.077 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-21T00:14:46.077 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T00:14:46.077 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T00:14:46.077 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T00:14:46.077 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-21T00:14:46.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:46.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:46.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:46.693 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-21T00:14:46.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:46.730 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-09-21T00:14:46.807 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:46.807 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-21T00:14:46.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T00:14:46.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T00:14:46.807 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-21T00:14:46.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:46.986 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T00:14:46.986 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:46.987 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-21T00:14:46.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T00:14:46.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T00:14:46.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T00:14:46.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T00:14:46.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T00:14:46.987 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-21T00:14:47.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:47.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:47.239 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:47.240 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-21T00:14:47.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-09-21T00:14:47.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T00:14:47.240 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-21T00:14:47.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:47.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:14:47.408 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T00:14:47.444 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T00:14:47.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:14:47.445 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T00:14:47.519 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T00:14:47.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:47.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T00:14:47.729 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T00:14:47.730 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T00:14:47.730 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-09-21T00:14:48.315 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T00:14:48.315 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T00:14:48.315 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-09-21T00:14:48.315 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.83:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-09-21T00:14:48.315 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T00:14:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T00:14:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T00:14:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-09-21T00:14:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.83:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-09-21T00:14:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T00:14:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.83:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-09-21T00:14:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.83:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-09-21T00:14:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=d4df3382-b453-41c4-9497-6203e3b4e46e" will pass to kernel 2024-09-21T00:14:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T00:14:48.353 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2024-09-21T00:14:48.353 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T00:14:48.353 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T00:14:48.353 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T00:14:48.356 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T00:14:48.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:48.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T00:14:48.412 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:48.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:48.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:48.502 INFO:teuthology.orchestra.run.smithi142.stdout:client4631 2024-09-21T00:14:48.503 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:14:48.503 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:48.538 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:48.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:48.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:48.667 INFO:teuthology.orchestra.run.smithi142.stdout:client4631 2024-09-21T00:14:48.667 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:48.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:48.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:48.756 INFO:teuthology.orchestra.run.smithi142.stdout:client4631 2024-09-21T00:14:48.756 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4df3382-b453-41c4-9497-6203e3b4e46e.client4631/status') 2024-09-21T00:14:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:48.856 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4631 (3)192.168.0.1:0/2759064807 2024-09-21T00:14:48.856 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2024-09-21T00:14:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2024-09-21T00:14:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2024-09-21T00:14:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:69 bytes copied, 5.544e-05 s, 1.2 MB/s 2024-09-21T00:14:48.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:48.866 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-21T00:14:48.866 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T00:14:48.867 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T00:14:48.867 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T00:14:49.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.100+0000 7fe58ba00640 1 -- 172.21.15.83:0/417502091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58406f890 msgr2=0x7fe58415ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:49.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.100+0000 7fe58ba00640 1 --2- 172.21.15.83:0/417502091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58406f890 0x7fe58415ab30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe57c005fd0 tx=0x7fe57c02aa00 comp rx=0 tx=0).stop 2024-09-21T00:14:49.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.100+0000 7fe58ba00640 1 -- 172.21.15.83:0/417502091 shutdown_connections 2024-09-21T00:14:49.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.100+0000 7fe58ba00640 1 --2- 172.21.15.83:0/417502091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58406f890 0x7fe58415ab30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:49.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.100+0000 7fe58ba00640 1 --2- 172.21.15.83:0/417502091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5840afd70 0x7fe58406f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:49.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.100+0000 7fe58ba00640 1 -- 172.21.15.83:0/417502091 >> 172.21.15.83:0/417502091 conn(0x7fe5840d0a30 msgr2=0x7fe5840d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:49.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.100+0000 7fe58ba00640 1 -- 172.21.15.83:0/417502091 shutdown_connections 2024-09-21T00:14:49.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.100+0000 7fe58ba00640 1 -- 172.21.15.83:0/417502091 wait complete. 2024-09-21T00:14:49.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.102+0000 7fe58ba00640 1 Processor -- start 2024-09-21T00:14:49.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.103+0000 7fe58ba00640 1 -- start start 2024-09-21T00:14:49.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.104+0000 7fe58ba00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58406e1d0 0x7fe5840ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:49.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.104+0000 7fe58ba00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe58406f890 0x7fe5841f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.104+0000 7fe58ba00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5840afd70 0x7fe5841f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.104+0000 7fe58ba00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe58415b400 con 0x7fe58406e1d0 2024-09-21T00:14:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.104+0000 7fe58ba00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe58415b280 con 0x7fe58406f890 2024-09-21T00:14:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.104+0000 7fe58ba00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe58415b580 con 0x7fe5840afd70 2024-09-21T00:14:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.104+0000 7fe589000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58406e1d0 0x7fe5840ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.104+0000 7fe589000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58406e1d0 0x7fe5840ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36556/0 (socket says 172.21.15.83:36556) 2024-09-21T00:14:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.104+0000 7fe589000640 1 -- 172.21.15.83:0/3025118502 learned_addr learned my addr 172.21.15.83:0/3025118502 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.105+0000 7fe589a00640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5840afd70 0x7fe5841f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.105+0000 7fe57be00640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe58406f890 0x7fe5841f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.105+0000 7fe589000640 1 -- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5840afd70 msgr2=0x7fe5841f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.105+0000 7fe589000640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5840afd70 0x7fe5841f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.105+0000 7fe589000640 1 -- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe58406f890 msgr2=0x7fe5841f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.105+0000 7fe589000640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe58406f890 0x7fe5841f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.105+0000 7fe589000640 1 -- 172.21.15.83:0/3025118502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5841f8ee0 con 0x7fe58406e1d0 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.105+0000 7fe589000640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58406e1d0 0x7fe5840ccd20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe57400c3d0 tx=0x7fe57400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.105+0000 7fe581600640 1 -- 172.21.15.83:0/3025118502 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574017070 con 0x7fe58406e1d0 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.106+0000 7fe581600640 1 -- 172.21.15.83:0/3025118502 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5740053c0 con 0x7fe58406e1d0 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.106+0000 7fe58ba00640 1 -- 172.21.15.83:0/3025118502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5841f91c0 con 0x7fe58406e1d0 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.106+0000 7fe581600640 1 -- 172.21.15.83:0/3025118502 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574003850 con 0x7fe58406e1d0 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.106+0000 7fe58ba00640 1 -- 172.21.15.83:0/3025118502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5841f5470 con 0x7fe58406e1d0 2024-09-21T00:14:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.107+0000 7fe58ba00640 1 -- 172.21.15.83:0/3025118502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5841f9400 con 0x7fe58406e1d0 2024-09-21T00:14:49.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.108+0000 7fe581600640 1 -- 172.21.15.83:0/3025118502 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe57401a070 con 0x7fe58406e1d0 2024-09-21T00:14:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.109+0000 7fe581600640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe560078bc0 0x7fe56007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.109+0000 7fe581600640 1 -- 172.21.15.83:0/3025118502 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe57409a390 con 0x7fe58406e1d0 2024-09-21T00:14:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.109+0000 7fe57be00640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe560078bc0 0x7fe56007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:49.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.110+0000 7fe57be00640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe560078bc0 0x7fe56007b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe58406a7a0 tx=0x7fe56c00b390 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:49.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.113+0000 7fe581600640 1 -- 172.21.15.83:0/3025118502 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe5841f9400 con 0x7fe58406e1d0 2024-09-21T00:14:49.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.337+0000 7fe58ba00640 1 -- 172.21.15.83:0/3025118502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe58415ab30 con 0x7fe58406e1d0 2024-09-21T00:14:49.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.337+0000 7fe581600640 1 -- 172.21.15.83:0/3025118502 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fe574061e00 con 0x7fe58406e1d0 2024-09-21T00:14:49.339 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T00:14:49.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 -- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe560078bc0 msgr2=0x7fe56007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:49.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe560078bc0 0x7fe56007b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe58406a7a0 tx=0x7fe56c00b390 comp rx=0 tx=0).stop 2024-09-21T00:14:49.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 -- 172.21.15.83:0/3025118502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58406e1d0 msgr2=0x7fe5840ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:49.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58406e1d0 0x7fe5840ccd20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe57400c3d0 tx=0x7fe57400c890 comp rx=0 tx=0).stop 2024-09-21T00:14:49.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 -- 172.21.15.83:0/3025118502 shutdown_connections 2024-09-21T00:14:49.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe560078bc0 0x7fe56007b0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:49.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5840afd70 0x7fe5841f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:49.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe58406f890 0x7fe5841f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:49.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 --2- 172.21.15.83:0/3025118502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe58406e1d0 0x7fe5840ccd20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:49.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 -- 172.21.15.83:0/3025118502 >> 172.21.15.83:0/3025118502 conn(0x7fe5840d0a30 msgr2=0x7fe58415f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:49.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 -- 172.21.15.83:0/3025118502 shutdown_connections 2024-09-21T00:14:49.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:49.340+0000 7fe58ba00640 1 -- 172.21.15.83:0/3025118502 wait complete. 2024-09-21T00:14:49.365 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T00:14:49.365 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:14:49.365 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-09-21T00:14:49.365 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-21T00:14:49.365 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T00:14:49.365 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T00:14:49.365 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T00:14:49.365 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:14:49.365 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-21T00:14:49.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:49.365 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-09-21T00:14:49.401 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:14:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:14:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:14:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-09-21T00:14:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42681sec preferred_lft 42681sec 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2024-09-21T00:14:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0e:74:b9:5f:c5:0c brd ff:ff:ff:ff:ff:ff 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::6821:d1ff:fe25:c921/64 scope link 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0e:74:b9:5f:c5:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::c74:b9ff:fe5f:c50c/64 scope link 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:49.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:49.404 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:14:49.494 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-09-21T00:14:49.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:49.498 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-09-21T00:14:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-09-21T00:14:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:14:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T00:14:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T00:14:49.534 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:14:49.535 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:49.535 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-21T00:14:49.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T00:14:49.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T00:14:49.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T00:14:49.535 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-21T00:14:49.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:49.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:49.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:49.730 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-21T00:14:49.765 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T00:14:49.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:49.765 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-09-21T00:14:49.839 INFO:teuthology.orchestra.run.smithi142.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-21T00:14:49.840 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:49.840 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-21T00:14:49.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T00:14:49.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-21T00:14:49.840 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-21T00:14:49.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:50.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:50.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:50.018 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T00:14:50.073 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:a2:42:4e:85:5b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::74a2:42ff:fe4e:855b/64 scope link 2024-09-21T00:14:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:50.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:50.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:a2:42:4e:85:5b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::74a2:42ff:fe4e:855b/64 scope link 2024-09-21T00:14:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:14:50.134 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-21T00:14:50.135 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:50.135 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-21T00:14:50.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-21T00:14:50.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T00:14:50.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-21T00:14:50.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-21T00:14:50.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-21T00:14:50.135 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-21T00:14:50.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:50.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:50.351 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:14:50.351 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-21T00:14:50.352 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.1 up 2024-09-21T00:14:50.352 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T00:14:50.352 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-21T00:14:50.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:50.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:50.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:14:50.517 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-21T00:14:50.552 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-21T00:14:50.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:14:50.552 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-21T00:14:50.627 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T00:14:50.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:50.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-21T00:14:50.821 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-21T00:14:50.821 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-21T00:14:50.821 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-09-21T00:14:50.841 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-21T00:14:50.841 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-21T00:14:50.841 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-09-21T00:14:50.841 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.83:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-09-21T00:14:50.841 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T00:14:50.870 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-21T00:14:50.871 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-21T00:14:50.871 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-09-21T00:14:50.871 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.83:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-09-21T00:14:50.871 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T00:14:50.871 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.83:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-09-21T00:14:50.871 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.83:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-09-21T00:14:50.871 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=d4df3382-b453-41c4-9497-6203e3b4e46e" will pass to kernel 2024-09-21T00:14:50.872 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-21T00:14:50.872 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2024-09-21T00:14:50.872 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T00:14:50.872 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T00:14:50.873 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T00:14:50.875 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T00:14:50.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:50.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-21T00:14:50.931 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:51.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:51.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:51.021 INFO:teuthology.orchestra.run.smithi142.stdout:client4786 2024-09-21T00:14:51.021 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:14:51.022 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:51.057 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:51.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:51.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:51.187 INFO:teuthology.orchestra.run.smithi142.stdout:client4786 2024-09-21T00:14:51.188 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:14:51.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:14:51.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:51.276 INFO:teuthology.orchestra.run.smithi142.stdout:client4786 2024-09-21T00:14:51.276 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4df3382-b453-41c4-9497-6203e3b4e46e.client4786/status') 2024-09-21T00:14:51.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:14:51.375 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4786 (3)192.168.0.2:0/1817957707 2024-09-21T00:14:51.375 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2024-09-21T00:14:51.375 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2024-09-21T00:14:51.375 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2024-09-21T00:14:51.375 INFO:teuthology.orchestra.run.smithi142.stderr:69 bytes copied, 5.5728e-05 s, 1.2 MB/s 2024-09-21T00:14:51.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:14:51.386 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-21T00:14:53.867 INFO:tasks.cephfs_test_runner:Starting test: test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) 2024-09-21T00:14:53.868 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:14:54.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.103+0000 7ff8d3000640 1 -- 172.21.15.83:0/2268771294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8cc06ddf0 msgr2=0x7ff8cc154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:54.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.103+0000 7ff8d3000640 1 --2- 172.21.15.83:0/2268771294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8cc06ddf0 0x7ff8cc154f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4005fd0 tx=0x7ff8c402aaa0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.103+0000 7ff8d3000640 1 -- 172.21.15.83:0/2268771294 shutdown_connections 2024-09-21T00:14:54.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.103+0000 7ff8d3000640 1 --2- 172.21.15.83:0/2268771294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8cc06ddf0 0x7ff8cc154f20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.103+0000 7ff8d3000640 1 -- 172.21.15.83:0/2268771294 >> 172.21.15.83:0/2268771294 conn(0x7ff8cc0d4360 msgr2=0x7ff8cc0d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:54.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.103+0000 7ff8d3000640 1 -- 172.21.15.83:0/2268771294 shutdown_connections 2024-09-21T00:14:54.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.103+0000 7ff8d3000640 1 -- 172.21.15.83:0/2268771294 wait complete. 2024-09-21T00:14:54.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.105+0000 7ff8d3000640 1 Processor -- start 2024-09-21T00:14:54.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.105+0000 7ff8d3000640 1 -- start start 2024-09-21T00:14:54.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.106+0000 7ff8d3000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc06ddf0 0x7ff8cc142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:54.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.106+0000 7ff8d3000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8cc0cede0 0x7ff8cc15eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:54.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d3000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8cc1622a0 0x7ff8cc1f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:54.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d3000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc1555e0 con 0x7ff8cc1622a0 2024-09-21T00:14:54.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d3000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc155460 con 0x7ff8cc06ddf0 2024-09-21T00:14:54.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d3000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc155760 con 0x7ff8cc0cede0 2024-09-21T00:14:54.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d2600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8cc1622a0 0x7ff8cc1f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:54.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d2600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8cc1622a0 0x7ff8cc1f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50770/0 (socket says 172.21.15.83:50770) 2024-09-21T00:14:54.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d2600640 1 -- 172.21.15.83:0/3317582806 learned_addr learned my addr 172.21.15.83:0/3317582806 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:54.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d1c00640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc06ddf0 0x7ff8cc142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:54.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d2600640 1 -- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8cc0cede0 msgr2=0x7ff8cc15eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:54.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d2600640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8cc0cede0 0x7ff8cc15eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d2600640 1 -- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc06ddf0 msgr2=0x7ff8cc142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:54.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d2600640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc06ddf0 0x7ff8cc142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.107+0000 7ff8d2600640 1 -- 172.21.15.83:0/3317582806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc1432a0 con 0x7ff8cc1622a0 2024-09-21T00:14:54.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.108+0000 7ff8d2600640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8cc1622a0 0x7ff8cc1f2470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009bf0 tx=0x7ff8c4003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:54.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.108+0000 7ff8c9600640 1 -- 172.21.15.83:0/3317582806 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4044070 con 0x7ff8cc1622a0 2024-09-21T00:14:54.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.108+0000 7ff8c9600640 1 -- 172.21.15.83:0/3317582806 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8c4004250 con 0x7ff8cc1622a0 2024-09-21T00:14:54.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.108+0000 7ff8c9600640 1 -- 172.21.15.83:0/3317582806 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4004660 con 0x7ff8cc1622a0 2024-09-21T00:14:54.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.108+0000 7ff8d3000640 1 -- 172.21.15.83:0/3317582806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc156db0 con 0x7ff8cc1622a0 2024-09-21T00:14:54.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.108+0000 7ff8d3000640 1 -- 172.21.15.83:0/3317582806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc157330 con 0x7ff8cc1622a0 2024-09-21T00:14:54.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.109+0000 7ff8d3000640 1 -- 172.21.15.83:0/3317582806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8cc154f20 con 0x7ff8cc1622a0 2024-09-21T00:14:54.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.110+0000 7ff8c9600640 1 -- 172.21.15.83:0/3317582806 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8c4047070 con 0x7ff8cc1622a0 2024-09-21T00:14:54.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.111+0000 7ff8c9600640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8ac078b90 0x7ff8ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:54.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.111+0000 7ff8c9600640 1 -- 172.21.15.83:0/3317582806 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff8c40bc1f0 con 0x7ff8cc1622a0 2024-09-21T00:14:54.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.112+0000 7ff8d1c00640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8ac078b90 0x7ff8ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:54.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.112+0000 7ff8d1c00640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8ac078b90 0x7ff8ac07b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0000f60 tx=0x7ff8c0009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:54.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.116+0000 7ff8c9600640 1 -- 172.21.15.83:0/3317582806 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff8c4032030 con 0x7ff8cc1622a0 2024-09-21T00:14:54.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.310+0000 7ff8d3000640 1 -- 172.21.15.83:0/3317582806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8cc1f94e0 con 0x7ff8cc1622a0 2024-09-21T00:14:54.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.311+0000 7ff8c9600640 1 -- 172.21.15.83:0/3317582806 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18721 (secure 0 0 0) 0x7ff8c40842b0 con 0x7ff8cc1622a0 2024-09-21T00:14:54.312 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:14:54.313 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":29,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:48.133505+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:14:54.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.313+0000 7ff8d3000640 1 -- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8ac078b90 msgr2=0x7ff8ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:54.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.313+0000 7ff8d3000640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8ac078b90 0x7ff8ac07b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0000f60 tx=0x7ff8c0009040 comp rx=0 tx=0).stop 2024-09-21T00:14:54.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.313+0000 7ff8d3000640 1 -- 172.21.15.83:0/3317582806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8cc1622a0 msgr2=0x7ff8cc1f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:54.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.313+0000 7ff8d3000640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8cc1622a0 0x7ff8cc1f2470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009bf0 tx=0x7ff8c4003d00 comp rx=0 tx=0).stop 2024-09-21T00:14:54.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.314+0000 7ff8d3000640 1 -- 172.21.15.83:0/3317582806 shutdown_connections 2024-09-21T00:14:54.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.314+0000 7ff8d3000640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff8ac078b90 0x7ff8ac07b0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.314+0000 7ff8d3000640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8cc1622a0 0x7ff8cc1f2470 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.314+0000 7ff8d3000640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8cc0cede0 0x7ff8cc15eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.314+0000 7ff8d3000640 1 --2- 172.21.15.83:0/3317582806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc06ddf0 0x7ff8cc142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.314+0000 7ff8d3000640 1 -- 172.21.15.83:0/3317582806 >> 172.21.15.83:0/3317582806 conn(0x7ff8cc0d4360 msgr2=0x7ff8cc15dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:54.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.314+0000 7ff8d3000640 1 -- 172.21.15.83:0/3317582806 shutdown_connections 2024-09-21T00:14:54.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.314+0000 7ff8d3000640 1 -- 172.21.15.83:0/3317582806 wait complete. 2024-09-21T00:14:54.339 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:13:58.878947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T00:14:07.577195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T00:14:08.392531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T00:14:11.967856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T00:14:54.340 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T00:14:54.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.563+0000 7f16cf400640 1 -- 172.21.15.83:0/1628258227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c815cb10 msgr2=0x7f16c815cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:54.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.563+0000 7f16cf400640 1 --2- 172.21.15.83:0/1628258227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c815cb10 0x7f16c815cf20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f16b8005fd0 tx=0x7f16b802a5d0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.563+0000 7f16cf400640 1 -- 172.21.15.83:0/1628258227 shutdown_connections 2024-09-21T00:14:54.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.563+0000 7f16cf400640 1 --2- 172.21.15.83:0/1628258227 >> v2:172.21.15.142:3300/0 conn(0x7f16c80d12e0 0x7f16c80d16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.563+0000 7f16cf400640 1 --2- 172.21.15.83:0/1628258227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c815cb10 0x7f16c815cf20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.563+0000 7f16cf400640 1 -- 172.21.15.83:0/1628258227 >> 172.21.15.83:0/1628258227 conn(0x7f16c80d2350 msgr2=0x7f16c80d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:54.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.563+0000 7f16cf400640 1 -- 172.21.15.83:0/1628258227 shutdown_connections 2024-09-21T00:14:54.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.563+0000 7f16cf400640 1 -- 172.21.15.83:0/1628258227 wait complete. 2024-09-21T00:14:54.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.566+0000 7f16cf400640 1 Processor -- start 2024-09-21T00:14:54.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.566+0000 7f16cf400640 1 -- start start 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.567+0000 7f16cf400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c80d12e0 0x7f16c813fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.567+0000 7f16cf400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c815cb10 0x7f16c81e9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.567+0000 7f16cf400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16c8160100 0x7f16c81e9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.567+0000 7f16cf400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f16c80b73e0 con 0x7f16c8160100 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.567+0000 7f16cf400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f16c80b7260 con 0x7f16c80d12e0 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.567+0000 7f16cf400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f16c8160c20 con 0x7f16c815cb10 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16cd400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16c8160100 0x7f16c81e9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16cd400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16c8160100 0x7f16c81e9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50784/0 (socket says 172.21.15.83:50784) 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16cca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c80d12e0 0x7f16c813fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16cd400640 1 -- 172.21.15.83:0/1968917096 learned_addr learned my addr 172.21.15.83:0/1968917096 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16bfe00640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c815cb10 0x7f16c81e9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:54.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16cd400640 1 -- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c815cb10 msgr2=0x7f16c81e9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:54.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16cd400640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c815cb10 0x7f16c81e9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16cd400640 1 -- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c80d12e0 msgr2=0x7f16c813fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:54.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16cd400640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c80d12e0 0x7f16c813fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16cd400640 1 -- 172.21.15.83:0/1968917096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c81f3780 con 0x7f16c8160100 2024-09-21T00:14:54.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.568+0000 7f16cd400640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16c8160100 0x7f16c81e9780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f16c000c730 tx=0x7f16c000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:54.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.569+0000 7f16c5600640 1 -- 172.21.15.83:0/1968917096 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c0003b70 con 0x7f16c8160100 2024-09-21T00:14:54.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.569+0000 7f16c5600640 1 -- 172.21.15.83:0/1968917096 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16c0003d10 con 0x7f16c8160100 2024-09-21T00:14:54.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.569+0000 7f16c5600640 1 -- 172.21.15.83:0/1968917096 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c0005330 con 0x7f16c8160100 2024-09-21T00:14:54.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.569+0000 7f16cf400640 1 -- 172.21.15.83:0/1968917096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c81f3cc0 con 0x7f16c8160100 2024-09-21T00:14:54.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.569+0000 7f16cf400640 1 -- 172.21.15.83:0/1968917096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c81f4280 con 0x7f16c8160100 2024-09-21T00:14:54.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.570+0000 7f16cf400640 1 -- 172.21.15.83:0/1968917096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c80d16f0 con 0x7f16c8160100 2024-09-21T00:14:54.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.571+0000 7f16c5600640 1 -- 172.21.15.83:0/1968917096 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16c00054d0 con 0x7f16c8160100 2024-09-21T00:14:54.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.572+0000 7f16c5600640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f16a4078b90 0x7f16a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:54.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.572+0000 7f16c5600640 1 -- 172.21.15.83:0/1968917096 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f16c009ad50 con 0x7f16c8160100 2024-09-21T00:14:54.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.573+0000 7f16cca00640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f16a4078b90 0x7f16a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:54.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.573+0000 7f16cca00640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f16a4078b90 0x7f16a407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f16b8033000 tx=0x7f16b8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:54.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.576+0000 7f16c5600640 1 -- 172.21.15.83:0/1968917096 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f16c0062740 con 0x7f16c8160100 2024-09-21T00:14:54.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.764+0000 7f16cf400640 1 -- 172.21.15.83:0/1968917096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f16c81f3a10 con 0x7f16c8160100 2024-09-21T00:14:54.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.764+0000 7f16c5600640 1 -- 172.21.15.83:0/1968917096 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f16c0067170 con 0x7f16c8160100 2024-09-21T00:14:54.766 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-09-21T00:14:54.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 -- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f16a4078b90 msgr2=0x7f16a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:54.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f16a4078b90 0x7f16a407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f16b8033000 tx=0x7f16b8004730 comp rx=0 tx=0).stop 2024-09-21T00:14:54.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 -- 172.21.15.83:0/1968917096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16c8160100 msgr2=0x7f16c81e9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:54.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16c8160100 0x7f16c81e9780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f16c000c730 tx=0x7f16c000cb30 comp rx=0 tx=0).stop 2024-09-21T00:14:54.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 -- 172.21.15.83:0/1968917096 shutdown_connections 2024-09-21T00:14:54.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f16a4078b90 0x7f16a407b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16c8160100 0x7f16c81e9780 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c815cb10 0x7f16c81e9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 --2- 172.21.15.83:0/1968917096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c80d12e0 0x7f16c813fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:54.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 -- 172.21.15.83:0/1968917096 >> 172.21.15.83:0/1968917096 conn(0x7f16c80d2350 msgr2=0x7f16c80b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:54.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 -- 172.21.15.83:0/1968917096 shutdown_connections 2024-09-21T00:14:54.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:54.767+0000 7f16cf400640 1 -- 172.21.15.83:0/1968917096 wait complete. 2024-09-21T00:14:54.794 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T00:14:55.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.021+0000 7ff606000640 1 -- 172.21.15.83:0/240959557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff60006e330 msgr2=0x7ff6000cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.021+0000 7ff606000640 1 --2- 172.21.15.83:0/240959557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff60006e330 0x7ff6000cdc70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff6000cca40 tx=0x7ff5f802aa30 comp rx=0 tx=0).stop 2024-09-21T00:14:55.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.021+0000 7ff606000640 1 -- 172.21.15.83:0/240959557 shutdown_connections 2024-09-21T00:14:55.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.021+0000 7ff606000640 1 --2- 172.21.15.83:0/240959557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff60006e330 0x7ff6000cdc70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.021+0000 7ff606000640 1 --2- 172.21.15.83:0/240959557 >> v2:172.21.15.142:3300/0 conn(0x7ff600074b60 0x7ff60006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.021+0000 7ff606000640 1 --2- 172.21.15.83:0/240959557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff600156a50 0x7ff600074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.021+0000 7ff606000640 1 -- 172.21.15.83:0/240959557 >> 172.21.15.83:0/240959557 conn(0x7ff6000b1b90 msgr2=0x7ff6000b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:55.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.021+0000 7ff606000640 1 -- 172.21.15.83:0/240959557 shutdown_connections 2024-09-21T00:14:55.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.021+0000 7ff606000640 1 -- 172.21.15.83:0/240959557 wait complete. 2024-09-21T00:14:55.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.024+0000 7ff606000640 1 Processor -- start 2024-09-21T00:14:55.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.024+0000 7ff606000640 1 -- start start 2024-09-21T00:14:55.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.025+0000 7ff606000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff60006e330 0x7ff6001f9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.025+0000 7ff606000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff600074b60 0x7ff6000b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.025+0000 7ff606000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff600156a50 0x7ff6000c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.025+0000 7ff606000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff6000ce330 con 0x7ff60006e330 2024-09-21T00:14:55.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.025+0000 7ff606000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff6000ce1b0 con 0x7ff600156a50 2024-09-21T00:14:55.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.025+0000 7ff606000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff6000ce4b0 con 0x7ff600074b60 2024-09-21T00:14:55.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.025+0000 7ff5ff400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff60006e330 0x7ff6001f9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.025+0000 7ff5ff400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff60006e330 0x7ff6001f9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50800/0 (socket says 172.21.15.83:50800) 2024-09-21T00:14:55.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.025+0000 7ff5ff400640 1 -- 172.21.15.83:0/1889975211 learned_addr learned my addr 172.21.15.83:0/1889975211 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:55.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5ffe00640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff600156a50 0x7ff6000c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5fea00640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff600074b60 0x7ff6000b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5ff400640 1 -- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff600074b60 msgr2=0x7ff6000b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5ff400640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff600074b60 0x7ff6000b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5ff400640 1 -- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff600156a50 msgr2=0x7ff6000c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5ff400640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff600156a50 0x7ff6000c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5ff400640 1 -- 172.21.15.83:0/1889975211 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6000b59c0 con 0x7ff60006e330 2024-09-21T00:14:55.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5ffe00640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff600156a50 0x7ff6000c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:55.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5ff400640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff60006e330 0x7ff6001f9d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000e7c0 tx=0x7ff5f000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:55.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5f7400640 1 -- 172.21.15.83:0/1889975211 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f000ccc0 con 0x7ff60006e330 2024-09-21T00:14:55.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5f7400640 1 -- 172.21.15.83:0/1889975211 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5f000ce80 con 0x7ff60006e330 2024-09-21T00:14:55.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff606000640 1 -- 172.21.15.83:0/1889975211 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6001f9250 con 0x7ff60006e330 2024-09-21T00:14:55.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff5f7400640 1 -- 172.21.15.83:0/1889975211 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0005280 con 0x7ff60006e330 2024-09-21T00:14:55.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.026+0000 7ff606000640 1 -- 172.21.15.83:0/1889975211 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6001f6690 con 0x7ff60006e330 2024-09-21T00:14:55.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.027+0000 7ff606000640 1 -- 172.21.15.83:0/1889975211 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6000ce9d0 con 0x7ff60006e330 2024-09-21T00:14:55.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.029+0000 7ff5f7400640 1 -- 172.21.15.83:0/1889975211 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff5f0005420 con 0x7ff60006e330 2024-09-21T00:14:55.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.030+0000 7ff5f7400640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff5e0078b90 0x7ff5e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.030+0000 7ff5f7400640 1 -- 172.21.15.83:0/1889975211 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff5f009bb60 con 0x7ff60006e330 2024-09-21T00:14:55.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.030+0000 7ff5fea00640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff5e0078b90 0x7ff5e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.031+0000 7ff5fea00640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff5e0078b90 0x7ff5e007b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff6001f0230 tx=0x7ff5ec005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:55.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.034+0000 7ff5f7400640 1 -- 172.21.15.83:0/1889975211 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff5f0063b90 con 0x7ff60006e330 2024-09-21T00:14:55.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.221+0000 7ff606000640 1 -- 172.21.15.83:0/1889975211 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff60015ec90 con 0x7ff60006e330 2024-09-21T00:14:55.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.221+0000 7ff5f7400640 1 -- 172.21.15.83:0/1889975211 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7ff5f0063490 con 0x7ff60006e330 2024-09-21T00:14:55.223 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-09-21T00:14:55.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.223+0000 7ff606000640 1 -- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff5e0078b90 msgr2=0x7ff5e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.223+0000 7ff606000640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff5e0078b90 0x7ff5e007b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff6001f0230 tx=0x7ff5ec005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:55.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.223+0000 7ff606000640 1 -- 172.21.15.83:0/1889975211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff60006e330 msgr2=0x7ff6001f9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.223+0000 7ff606000640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff60006e330 0x7ff6001f9d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000e7c0 tx=0x7ff5f000ec80 comp rx=0 tx=0).stop 2024-09-21T00:14:55.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.223+0000 7ff606000640 1 -- 172.21.15.83:0/1889975211 shutdown_connections 2024-09-21T00:14:55.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.223+0000 7ff606000640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff5e0078b90 0x7ff5e007b0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.223+0000 7ff606000640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff600156a50 0x7ff6000c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.223+0000 7ff606000640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff600074b60 0x7ff6000b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.223+0000 7ff606000640 1 --2- 172.21.15.83:0/1889975211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff60006e330 0x7ff6001f9d30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.223+0000 7ff606000640 1 -- 172.21.15.83:0/1889975211 >> 172.21.15.83:0/1889975211 conn(0x7ff6000b1b90 msgr2=0x7ff60006d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:55.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.224+0000 7ff606000640 1 -- 172.21.15.83:0/1889975211 shutdown_connections 2024-09-21T00:14:55.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.224+0000 7ff606000640 1 -- 172.21.15.83:0/1889975211 wait complete. 2024-09-21T00:14:55.247 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T00:14:55.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.471+0000 7fd9cea00640 1 -- 172.21.15.83:0/1478697074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c80ccef0 msgr2=0x7fd9c806cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.471+0000 7fd9cea00640 1 --2- 172.21.15.83:0/1478697074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c80ccef0 0x7fd9c806cf90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80726b0 tx=0x7fd9c002aa30 comp rx=0 tx=0).stop 2024-09-21T00:14:55.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.471+0000 7fd9cea00640 1 -- 172.21.15.83:0/1478697074 shutdown_connections 2024-09-21T00:14:55.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.471+0000 7fd9cea00640 1 --2- 172.21.15.83:0/1478697074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c80ccef0 0x7fd9c806cf90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.471+0000 7fd9cea00640 1 --2- 172.21.15.83:0/1478697074 >> v2:172.21.15.142:3300/0 conn(0x7fd9c806e2c0 0x7fd9c80cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.471+0000 7fd9cea00640 1 -- 172.21.15.83:0/1478697074 >> 172.21.15.83:0/1478697074 conn(0x7fd9c806f920 msgr2=0x7fd9c80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:55.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.471+0000 7fd9cea00640 1 -- 172.21.15.83:0/1478697074 shutdown_connections 2024-09-21T00:14:55.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.471+0000 7fd9cea00640 1 -- 172.21.15.83:0/1478697074 wait complete. 2024-09-21T00:14:55.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.473+0000 7fd9cea00640 1 Processor -- start 2024-09-21T00:14:55.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.474+0000 7fd9cea00640 1 -- start start 2024-09-21T00:14:55.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.475+0000 7fd9cea00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c806e2c0 0x7fd9c80a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.475+0000 7fd9cea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c8160a00 0x7fd9c80caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.475+0000 7fd9cea00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9c81f87d0 0x7fd9c81f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.475+0000 7fd9cea00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c806d4d0 con 0x7fd9c806e2c0 2024-09-21T00:14:55.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.475+0000 7fd9cea00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c806d650 con 0x7fd9c8160a00 2024-09-21T00:14:55.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.475+0000 7fd9cea00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c806d7d0 con 0x7fd9c81f87d0 2024-09-21T00:14:55.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.475+0000 7fd9cd600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c806e2c0 0x7fd9c80a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.475+0000 7fd9cd600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c806e2c0 0x7fd9c80a9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50810/0 (socket says 172.21.15.83:50810) 2024-09-21T00:14:55.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.475+0000 7fd9cd600640 1 -- 172.21.15.83:0/3258617992 learned_addr learned my addr 172.21.15.83:0/3258617992 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:55.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9ce000640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9c81f87d0 0x7fd9c81f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9ccc00640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c8160a00 0x7fd9c80caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9cd600640 1 -- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9c81f87d0 msgr2=0x7fd9c81f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9cd600640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9c81f87d0 0x7fd9c81f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9cd600640 1 -- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c8160a00 msgr2=0x7fd9c80caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9cd600640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c8160a00 0x7fd9c80caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9cd600640 1 -- 172.21.15.83:0/3258617992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c81f9120 con 0x7fd9c806e2c0 2024-09-21T00:14:55.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9ce000640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9c81f87d0 0x7fd9c81f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:14:55.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9cd600640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c806e2c0 0x7fd9c80a9440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00d700 tx=0x7fd9bc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:55.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9c5600640 1 -- 172.21.15.83:0/3258617992 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc017070 con 0x7fd9c806e2c0 2024-09-21T00:14:55.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9c5600640 1 -- 172.21.15.83:0/3258617992 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9bc005310 con 0x7fd9c806e2c0 2024-09-21T00:14:55.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9cea00640 1 -- 172.21.15.83:0/3258617992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c81f9610 con 0x7fd9c806e2c0 2024-09-21T00:14:55.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9c5600640 1 -- 172.21.15.83:0/3258617992 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc0097c0 con 0x7fd9c806e2c0 2024-09-21T00:14:55.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.476+0000 7fd9cea00640 1 -- 172.21.15.83:0/3258617992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c80aa290 con 0x7fd9c806e2c0 2024-09-21T00:14:55.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.477+0000 7fd9cea00640 1 -- 172.21.15.83:0/3258617992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c806dc60 con 0x7fd9c806e2c0 2024-09-21T00:14:55.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.479+0000 7fd9c5600640 1 -- 172.21.15.83:0/3258617992 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9bc009960 con 0x7fd9c806e2c0 2024-09-21T00:14:55.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.480+0000 7fd9c5600640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9a8078b90 0x7fd9a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.480+0000 7fd9c5600640 1 -- 172.21.15.83:0/3258617992 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fd9bc09b270 con 0x7fd9c806e2c0 2024-09-21T00:14:55.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.481+0000 7fd9ccc00640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9a8078b90 0x7fd9a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.481+0000 7fd9ccc00640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9a8078b90 0x7fd9a807b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4006fd0 tx=0x7fd9b4008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:55.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.485+0000 7fd9c5600640 1 -- 172.21.15.83:0/3258617992 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd9c81f9120 con 0x7fd9c806e2c0 2024-09-21T00:14:55.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.668+0000 7fd9cea00640 1 -- 172.21.15.83:0/3258617992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd9c815c2b0 con 0x7fd9c806e2c0 2024-09-21T00:14:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.669+0000 7fd9c5600640 1 -- 172.21.15.83:0/3258617992 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fd9bc0632a0 con 0x7fd9c806e2c0 2024-09-21T00:14:55.670 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-09-21T00:14:55.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 -- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9a8078b90 msgr2=0x7fd9a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9a8078b90 0x7fd9a807b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4006fd0 tx=0x7fd9b4008040 comp rx=0 tx=0).stop 2024-09-21T00:14:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 -- 172.21.15.83:0/3258617992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c806e2c0 msgr2=0x7fd9c80a9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c806e2c0 0x7fd9c80a9440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00d700 tx=0x7fd9bc00dbc0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 -- 172.21.15.83:0/3258617992 shutdown_connections 2024-09-21T00:14:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9a8078b90 0x7fd9a807b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9c81f87d0 0x7fd9c81f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c8160a00 0x7fd9c80caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 --2- 172.21.15.83:0/3258617992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c806e2c0 0x7fd9c80a9440 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 -- 172.21.15.83:0/3258617992 >> 172.21.15.83:0/3258617992 conn(0x7fd9c806f920 msgr2=0x7fd9c80cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 -- 172.21.15.83:0/3258617992 shutdown_connections 2024-09-21T00:14:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.671+0000 7fd9cea00640 1 -- 172.21.15.83:0/3258617992 wait complete. 2024-09-21T00:14:55.694 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T00:14:55.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.917+0000 7f51a0600640 1 -- 172.21.15.83:0/4292272724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5198070370 msgr2=0x7f51980cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.917+0000 7f51a0600640 1 --2- 172.21.15.83:0/4292272724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5198070370 0x7f51980cdc70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5190005fd0 tx=0x7f519002bb30 comp rx=0 tx=0).stop 2024-09-21T00:14:55.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.917+0000 7f51a0600640 1 -- 172.21.15.83:0/4292272724 shutdown_connections 2024-09-21T00:14:55.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.917+0000 7f51a0600640 1 --2- 172.21.15.83:0/4292272724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5198070370 0x7f51980cdc70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.917+0000 7f51a0600640 1 --2- 172.21.15.83:0/4292272724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5198074b00 0x7f519815aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.917+0000 7f51a0600640 1 -- 172.21.15.83:0/4292272724 >> 172.21.15.83:0/4292272724 conn(0x7f51980b1b90 msgr2=0x7f51980b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:55.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.917+0000 7f51a0600640 1 -- 172.21.15.83:0/4292272724 shutdown_connections 2024-09-21T00:14:55.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.917+0000 7f51a0600640 1 -- 172.21.15.83:0/4292272724 wait complete. 2024-09-21T00:14:55.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.919+0000 7f51a0600640 1 Processor -- start 2024-09-21T00:14:55.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.919+0000 7f51a0600640 1 -- start start 2024-09-21T00:14:55.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f51a0600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5198070370 0x7f519815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f51a0600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5198074b00 0x7f51981f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f51a0600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f519815afd0 0x7f51980c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f51a0600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f519806e360 con 0x7f5198070370 2024-09-21T00:14:55.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f51a0600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f519806e1e0 con 0x7f519815afd0 2024-09-21T00:14:55.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f51a0600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f519806e4e0 con 0x7f5198074b00 2024-09-21T00:14:55.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f519dc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5198070370 0x7f519815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f519dc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5198070370 0x7f519815d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50836/0 (socket says 172.21.15.83:50836) 2024-09-21T00:14:55.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f519dc00640 1 -- 172.21.15.83:0/2692981744 learned_addr learned my addr 172.21.15.83:0/2692981744 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:55.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f519e600640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f519815afd0 0x7f51980c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f519d200640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5198074b00 0x7f51981f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f519dc00640 1 -- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5198074b00 msgr2=0x7f51981f32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f519dc00640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5198074b00 0x7f51981f32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f519dc00640 1 -- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f519815afd0 msgr2=0x7f51980c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:55.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f519dc00640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f519815afd0 0x7f51980c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:55.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.921+0000 7f519dc00640 1 -- 172.21.15.83:0/2692981744 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51981f6700 con 0x7f5198070370 2024-09-21T00:14:55.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.922+0000 7f519dc00640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5198070370 0x7f519815d440 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f518c00e790 tx=0x7f518c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:55.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.922+0000 7f5195600640 1 -- 172.21.15.83:0/2692981744 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c00eea0 con 0x7f5198070370 2024-09-21T00:14:55.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.922+0000 7f5195600640 1 -- 172.21.15.83:0/2692981744 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f518c00cdb0 con 0x7f5198070370 2024-09-21T00:14:55.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.922+0000 7f51a0600640 1 -- 172.21.15.83:0/2692981744 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51981f69a0 con 0x7f5198070370 2024-09-21T00:14:55.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.922+0000 7f5195600640 1 -- 172.21.15.83:0/2692981744 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c010690 con 0x7f5198070370 2024-09-21T00:14:55.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.922+0000 7f51a0600640 1 -- 172.21.15.83:0/2692981744 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51981f6f60 con 0x7f5198070370 2024-09-21T00:14:55.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.923+0000 7f51a0600640 1 -- 172.21.15.83:0/2692981744 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51980cdc50 con 0x7f5198070370 2024-09-21T00:14:55.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.924+0000 7f5195600640 1 -- 172.21.15.83:0/2692981744 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f518c010830 con 0x7f5198070370 2024-09-21T00:14:55.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.925+0000 7f5195600640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5178078b90 0x7f517807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:55.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.926+0000 7f5195600640 1 -- 172.21.15.83:0/2692981744 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f518c09ba20 con 0x7f5198070370 2024-09-21T00:14:55.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.926+0000 7f519d200640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5178078b90 0x7f517807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:55.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.926+0000 7f519d200640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5178078b90 0x7f517807b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f519815d3d0 tx=0x7f5184009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:55.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:55.930+0000 7f5195600640 1 -- 172.21.15.83:0/2692981744 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f518c063b80 con 0x7f5198070370 2024-09-21T00:14:56.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.114+0000 7f51a0600640 1 -- 172.21.15.83:0/2692981744 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f51980cb160 con 0x7f5198070370 2024-09-21T00:14:56.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.114+0000 7f5195600640 1 -- 172.21.15.83:0/2692981744 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f518c063480 con 0x7f5198070370 2024-09-21T00:14:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-09-21T00:14:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.116+0000 7f51a0600640 1 -- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5178078b90 msgr2=0x7f517807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5178078b90 0x7f517807b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f519815d3d0 tx=0x7f5184009040 comp rx=0 tx=0).stop 2024-09-21T00:14:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 -- 172.21.15.83:0/2692981744 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5198070370 msgr2=0x7f519815d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5198070370 0x7f519815d440 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f518c00e790 tx=0x7f518c00ec50 comp rx=0 tx=0).stop 2024-09-21T00:14:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 -- 172.21.15.83:0/2692981744 shutdown_connections 2024-09-21T00:14:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5178078b90 0x7f517807b0a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f519815afd0 0x7f51980c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:56.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5198074b00 0x7f51981f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:56.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 --2- 172.21.15.83:0/2692981744 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5198070370 0x7f519815d440 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:56.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 -- 172.21.15.83:0/2692981744 >> 172.21.15.83:0/2692981744 conn(0x7f51980b1b90 msgr2=0x7f51980a0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:56.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 -- 172.21.15.83:0/2692981744 shutdown_connections 2024-09-21T00:14:56.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.117+0000 7f51a0600640 1 -- 172.21.15.83:0/2692981744 wait complete. 2024-09-21T00:14:56.139 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal' 2024-09-21T00:14:56.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.360+0000 7fa682800640 1 -- 172.21.15.83:0/637810660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa660003a30 msgr2=0x7fa660003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:56.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.360+0000 7fa682800640 1 --2- 172.21.15.83:0/637810660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa660003a30 0x7fa660003ea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009b20 tx=0x7fa660005830 comp rx=0 tx=0).stop 2024-09-21T00:14:56.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.360+0000 7fa67be00640 1 -- 172.21.15.83:0/637810660 reap_dead start 2024-09-21T00:14:56.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.360+0000 7fa682800640 1 -- 172.21.15.83:0/637810660 shutdown_connections 2024-09-21T00:14:56.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.360+0000 7fa682800640 1 -- 172.21.15.83:0/637810660 >> 172.21.15.83:0/637810660 conn(0x7fa67c0cca40 msgr2=0x7fa67c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:56.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.360+0000 7fa682800640 1 -- 172.21.15.83:0/637810660 shutdown_connections 2024-09-21T00:14:56.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.360+0000 7fa682800640 1 -- 172.21.15.83:0/637810660 wait complete. 2024-09-21T00:14:56.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.362+0000 7fa682800640 1 Processor -- start 2024-09-21T00:14:56.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.363+0000 7fa682800640 1 -- start start 2024-09-21T00:14:56.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.364+0000 7fa682800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa660003a30 0x7fa67c0cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:56.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.364+0000 7fa682800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa67c1f5d20 0x7fa67c0ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:56.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.364+0000 7fa682800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa67c1e6c60 0x7fa67c1e7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:56.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.364+0000 7fa682800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c0cc1a0 con 0x7fa67c1e6c60 2024-09-21T00:14:56.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.364+0000 7fa682800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c0cc020 con 0x7fa67c1f5d20 2024-09-21T00:14:56.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.364+0000 7fa682800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa67c0cc320 con 0x7fa660003a30 2024-09-21T00:14:56.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.364+0000 7fa67be00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa67c1e6c60 0x7fa67c1e7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:56.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.364+0000 7fa67be00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa67c1e6c60 0x7fa67c1e7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50868/0 (socket says 172.21.15.83:50868) 2024-09-21T00:14:56.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.364+0000 7fa67be00640 1 -- 172.21.15.83:0/3062005896 learned_addr learned my addr 172.21.15.83:0/3062005896 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:56.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa67b400640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa660003a30 0x7fa67c0cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:56.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa67be00640 1 -- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa660003a30 msgr2=0x7fa67c0cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:56.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa67aa00640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa67c1f5d20 0x7fa67c0ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:56.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa67be00640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa660003a30 0x7fa67c0cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:56.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa67be00640 1 -- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa67c1f5d20 msgr2=0x7fa67c0ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:56.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa67be00640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa67c1f5d20 0x7fa67c0ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:56.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa67be00640 1 -- 172.21.15.83:0/3062005896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0cf740 con 0x7fa67c1e6c60 2024-09-21T00:14:56.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa67b400640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa660003a30 0x7fa67c0cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:56.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa67aa00640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa67c1f5d20 0x7fa67c0ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:14:56.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa67be00640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa67c1e6c60 0x7fa67c1e7070 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa67c072b90 tx=0x7fa6740019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:56.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa673400640 1 -- 172.21.15.83:0/3062005896 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674011870 con 0x7fa67c1e6c60 2024-09-21T00:14:56.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa673400640 1 -- 172.21.15.83:0/3062005896 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa674017070 con 0x7fa67c1e6c60 2024-09-21T00:14:56.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa682800640 1 -- 172.21.15.83:0/3062005896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c0cfa20 con 0x7fa67c1e6c60 2024-09-21T00:14:56.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.365+0000 7fa673400640 1 -- 172.21.15.83:0/3062005896 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674011dc0 con 0x7fa67c1e6c60 2024-09-21T00:14:56.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.366+0000 7fa682800640 1 -- 172.21.15.83:0/3062005896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67c1e6740 con 0x7fa67c1e6c60 2024-09-21T00:14:56.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.366+0000 7fa682800640 1 -- 172.21.15.83:0/3062005896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa67c06f720 con 0x7fa67c1e6c60 2024-09-21T00:14:56.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.368+0000 7fa673400640 1 -- 172.21.15.83:0/3062005896 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa67401c460 con 0x7fa67c1e6c60 2024-09-21T00:14:56.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.369+0000 7fa673400640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa65c078b90 0x7fa65c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:56.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.369+0000 7fa673400640 1 -- 172.21.15.83:0/3062005896 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa67409b930 con 0x7fa67c1e6c60 2024-09-21T00:14:56.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.369+0000 7fa67b400640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa65c078b90 0x7fa65c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:56.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.370+0000 7fa67b400640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa65c078b90 0x7fa65c07b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa66c035000 tx=0x7fa66c02d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:56.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.373+0000 7fa673400640 1 -- 172.21.15.83:0/3062005896 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa674063960 con 0x7fa67c1e6c60 2024-09-21T00:14:56.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:56.628+0000 7fa682800640 1 -- 172.21.15.83:0/3062005896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]} v 0) -- 0x7fa67c0ca270 con 0x7fa67c1e6c60 2024-09-21T00:14:57.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.177+0000 7fa673400640 1 -- 172.21.15.83:0/3062005896 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]}]=0 v67) ==== 162+0+0 (secure 0 0 0) 0x7fa674063260 con 0x7fa67c1e6c60 2024-09-21T00:14:57.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.179+0000 7fa682800640 1 -- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa65c078b90 msgr2=0x7fa65c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:57.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.179+0000 7fa682800640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa65c078b90 0x7fa65c07b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa66c035000 tx=0x7fa66c02d040 comp rx=0 tx=0).stop 2024-09-21T00:14:57.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.179+0000 7fa682800640 1 -- 172.21.15.83:0/3062005896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa67c1e6c60 msgr2=0x7fa67c1e7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:57.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.179+0000 7fa682800640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa67c1e6c60 0x7fa67c1e7070 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa67c072b90 tx=0x7fa6740019b0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.180+0000 7fa682800640 1 -- 172.21.15.83:0/3062005896 shutdown_connections 2024-09-21T00:14:57.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.180+0000 7fa682800640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa65c078b90 0x7fa65c07b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.180+0000 7fa682800640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa67c1e6c60 0x7fa67c1e7070 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.180+0000 7fa682800640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa67c1f5d20 0x7fa67c0ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.180+0000 7fa682800640 1 --2- 172.21.15.83:0/3062005896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa660003a30 0x7fa67c0cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.180+0000 7fa682800640 1 -- 172.21.15.83:0/3062005896 >> 172.21.15.83:0/3062005896 conn(0x7fa67c0cca40 msgr2=0x7fa67c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:57.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.180+0000 7fa682800640 1 -- 172.21.15.83:0/3062005896 shutdown_connections 2024-09-21T00:14:57.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.180+0000 7fa682800640 1 -- 172.21.15.83:0/3062005896 wait complete. 2024-09-21T00:14:57.203 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T00:14:57.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.424+0000 7fc50fa00640 1 -- 172.21.15.83:0/1164701064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f0004d40 msgr2=0x7fc4f0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:57.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.424+0000 7fc50fa00640 1 --2- 172.21.15.83:0/1164701064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f0004d40 0x7fc4f0005150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc500009ed0 tx=0x7fc4f0005830 comp rx=0 tx=0).stop 2024-09-21T00:14:57.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.424+0000 7fc50da00640 1 -- 172.21.15.83:0/1164701064 reap_dead start 2024-09-21T00:14:57.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.424+0000 7fc50fa00640 1 -- 172.21.15.83:0/1164701064 shutdown_connections 2024-09-21T00:14:57.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.424+0000 7fc50fa00640 1 -- 172.21.15.83:0/1164701064 >> 172.21.15.83:0/1164701064 conn(0x7fc5080cca40 msgr2=0x7fc5080cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:57.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.424+0000 7fc50fa00640 1 -- 172.21.15.83:0/1164701064 shutdown_connections 2024-09-21T00:14:57.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.424+0000 7fc50fa00640 1 -- 172.21.15.83:0/1164701064 wait complete. 2024-09-21T00:14:57.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.427+0000 7fc50fa00640 1 Processor -- start 2024-09-21T00:14:57.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.427+0000 7fc50fa00640 1 -- start start 2024-09-21T00:14:57.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.428+0000 7fc50fa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f0004d40 0x7fc508152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:57.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.428+0000 7fc50fa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc508159510 0x7fc5080ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:57.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.428+0000 7fc50fa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50809e2a0 0x7fc50809c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:57.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.428+0000 7fc50fa00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc50806df70 con 0x7fc4f0004d40 2024-09-21T00:14:57.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.428+0000 7fc50fa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc50806ddf0 con 0x7fc50809e2a0 2024-09-21T00:14:57.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.428+0000 7fc50fa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc50806e0f0 con 0x7fc508159510 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.429+0000 7fc50d000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f0004d40 0x7fc508152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.429+0000 7fc50d000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f0004d40 0x7fc508152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50894/0 (socket says 172.21.15.83:50894) 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.429+0000 7fc50d000640 1 -- 172.21.15.83:0/615867263 learned_addr learned my addr 172.21.15.83:0/615867263 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.429+0000 7fc50da00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50809e2a0 0x7fc50809c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.429+0000 7fc507e00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc508159510 0x7fc5080ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.429+0000 7fc50d000640 1 -- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc508159510 msgr2=0x7fc5080ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.429+0000 7fc50d000640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc508159510 0x7fc5080ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.429+0000 7fc50d000640 1 -- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50809e2a0 msgr2=0x7fc50809c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.429+0000 7fc50d000640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50809e2a0 0x7fc50809c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.429+0000 7fc50d000640 1 -- 172.21.15.83:0/615867263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5081f5080 con 0x7fc4f0004d40 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.430+0000 7fc50d000640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f0004d40 0x7fc508152ef0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00e630 tx=0x7fc4fc00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.430+0000 7fc504c00640 1 -- 172.21.15.83:0/615867263 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc015070 con 0x7fc4f0004d40 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.430+0000 7fc504c00640 1 -- 172.21.15.83:0/615867263 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4fc004310 con 0x7fc4f0004d40 2024-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.430+0000 7fc50fa00640 1 -- 172.21.15.83:0/615867263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50809b520 con 0x7fc4f0004d40 2024-09-21T00:14:57.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.430+0000 7fc504c00640 1 -- 172.21.15.83:0/615867263 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc00ca00 con 0x7fc4f0004d40 2024-09-21T00:14:57.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.430+0000 7fc50fa00640 1 -- 172.21.15.83:0/615867263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50809baa0 con 0x7fc4f0004d40 2024-09-21T00:14:57.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.431+0000 7fc50fa00640 1 -- 172.21.15.83:0/615867263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50806ede0 con 0x7fc4f0004d40 2024-09-21T00:14:57.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.432+0000 7fc504c00640 1 -- 172.21.15.83:0/615867263 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc4fc00cba0 con 0x7fc4f0004d40 2024-09-21T00:14:57.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.433+0000 7fc504c00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc4e8078bc0 0x7fc4e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:57.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.433+0000 7fc504c00640 1 -- 172.21.15.83:0/615867263 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc4fc09b560 con 0x7fc4f0004d40 2024-09-21T00:14:57.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.433+0000 7fc507e00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc4e8078bc0 0x7fc4e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:57.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.434+0000 7fc507e00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc4e8078bc0 0x7fc4e807b0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc50815f870 tx=0x7fc4f4005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:57.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.438+0000 7fc504c00640 1 -- 172.21.15.83:0/615867263 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc50806e740 con 0x7fc4f0004d40 2024-09-21T00:14:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.623+0000 7fc50fa00640 1 -- 172.21.15.83:0/615867263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc50806f9b0 con 0x7fc4f0004d40 2024-09-21T00:14:57.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.624+0000 7fc504c00640 1 -- 172.21.15.83:0/615867263 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7fc4fc062f40 con 0x7fc4f0004d40 2024-09-21T00:14:57.625 INFO:teuthology.orchestra.run.smithi083.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T00:14:57.625 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T00:14:57.625 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced client_mount_timeout 30 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced debug_client 20/20 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced debug_mgr 20/20 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced debug_ms 1/1 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3210.622046 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3196.037217 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3215.836773 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3514.044521 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4090.307466 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7328.676217 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4124.949579 2024-09-21T00:14:57.626 INFO:teuthology.orchestra.run.smithi083.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4292.199683 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced debug_mds 20/20 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced debug_ms 2/2 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:mds dev mds_debug_frag true 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:mds dev mds_debug_scatterstat true 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:mds dev mds_verify_scatter true 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced client_mount_timeout 600 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced debug_client 20/20 2024-09-21T00:14:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced debug_ms 1/1 2024-09-21T00:14:57.628 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T00:14:57.628 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.626+0000 7fc50fa00640 1 -- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc4e8078bc0 msgr2=0x7fc4e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.626+0000 7fc50fa00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc4e8078bc0 0x7fc4e807b0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc50815f870 tx=0x7fc4f4005f90 comp rx=0 tx=0).stop 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.626+0000 7fc50fa00640 1 -- 172.21.15.83:0/615867263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f0004d40 msgr2=0x7fc508152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.626+0000 7fc50fa00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f0004d40 0x7fc508152ef0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00e630 tx=0x7fc4fc00eaf0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.626+0000 7fc50fa00640 1 -- 172.21.15.83:0/615867263 shutdown_connections 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.626+0000 7fc50fa00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc4e8078bc0 0x7fc4e807b0d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.626+0000 7fc50fa00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50809e2a0 0x7fc50809c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.626+0000 7fc50fa00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc508159510 0x7fc5080ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.626+0000 7fc50fa00640 1 --2- 172.21.15.83:0/615867263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f0004d40 0x7fc508152ef0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.626+0000 7fc50fa00640 1 -- 172.21.15.83:0/615867263 >> 172.21.15.83:0/615867263 conn(0x7fc5080cca40 msgr2=0x7fc5080cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.627+0000 7fc50fa00640 1 -- 172.21.15.83:0/615867263 shutdown_connections 2024-09-21T00:14:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.627+0000 7fc50fa00640 1 -- 172.21.15.83:0/615867263 wait complete. 2024-09-21T00:14:57.654 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T00:14:57.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.877+0000 7fe3e1000640 1 -- 172.21.15.83:0/4030709141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3dc0cc530 msgr2=0x7fe3dc15ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:57.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.877+0000 7fe3e1000640 1 --2- 172.21.15.83:0/4030709141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3dc0cc530 0x7fe3dc15ead0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc005fd0 tx=0x7fe3cc02a5d0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.877+0000 7fe3e1000640 1 -- 172.21.15.83:0/4030709141 shutdown_connections 2024-09-21T00:14:57.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.877+0000 7fe3e1000640 1 --2- 172.21.15.83:0/4030709141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3dc0cc530 0x7fe3dc15ead0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.877+0000 7fe3e1000640 1 -- 172.21.15.83:0/4030709141 >> 172.21.15.83:0/4030709141 conn(0x7fe3dc0b1b90 msgr2=0x7fe3dc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:57.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.878+0000 7fe3e1000640 1 -- 172.21.15.83:0/4030709141 shutdown_connections 2024-09-21T00:14:57.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.878+0000 7fe3e1000640 1 -- 172.21.15.83:0/4030709141 wait complete. 2024-09-21T00:14:57.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.880+0000 7fe3e1000640 1 Processor -- start 2024-09-21T00:14:57.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.880+0000 7fe3e1000640 1 -- start start 2024-09-21T00:14:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.881+0000 7fe3e1000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3dc0af5b0 0x7fe3dc0b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.881+0000 7fe3e1000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3dc0cc530 0x7fe3dc15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.881+0000 7fe3e1000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3dc0a00f0 0x7fe3dc0a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.881+0000 7fe3e1000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc0ceff0 con 0x7fe3dc0a00f0 2024-09-21T00:14:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.881+0000 7fe3e1000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc0cee70 con 0x7fe3dc0cc530 2024-09-21T00:14:57.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.881+0000 7fe3e1000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe3dc0cf170 con 0x7fe3dc0af5b0 2024-09-21T00:14:57.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3da800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3dc0a00f0 0x7fe3dc0a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:57.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3d9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3dc0af5b0 0x7fe3dc0b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:57.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3d9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3dc0af5b0 0x7fe3dc0b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:38550/0 (socket says 172.21.15.83:38550) 2024-09-21T00:14:57.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3d9e00640 1 -- 172.21.15.83:0/3920641099 learned_addr learned my addr 172.21.15.83:0/3920641099 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:57.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3d9400640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3dc0cc530 0x7fe3dc15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:57.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3da800640 1 -- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3dc0af5b0 msgr2=0x7fe3dc0b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:57.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3da800640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3dc0af5b0 0x7fe3dc0b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3da800640 1 -- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3dc0cc530 msgr2=0x7fe3dc15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:57.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3da800640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3dc0cc530 0x7fe3dc15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3da800640 1 -- 172.21.15.83:0/3920641099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3dc0a0a40 con 0x7fe3dc0a00f0 2024-09-21T00:14:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.882+0000 7fe3da800640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3dc0a00f0 0x7fe3dc0a0500 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400be00 tx=0x7fe3d400bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.883+0000 7fe3d2000640 1 -- 172.21.15.83:0/3920641099 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4003970 con 0x7fe3dc0a00f0 2024-09-21T00:14:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.883+0000 7fe3d2000640 1 -- 172.21.15.83:0/3920641099 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3d4003c00 con 0x7fe3dc0a00f0 2024-09-21T00:14:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.883+0000 7fe3d2000640 1 -- 172.21.15.83:0/3920641099 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4004020 con 0x7fe3dc0a00f0 2024-09-21T00:14:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.883+0000 7fe3e1000640 1 -- 172.21.15.83:0/3920641099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3dc15ee80 con 0x7fe3dc0a00f0 2024-09-21T00:14:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.883+0000 7fe3e1000640 1 -- 172.21.15.83:0/3920641099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3dc15f120 con 0x7fe3dc0a00f0 2024-09-21T00:14:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.884+0000 7fe3e1000640 1 -- 172.21.15.83:0/3920641099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3dc0b4d00 con 0x7fe3dc0a00f0 2024-09-21T00:14:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.885+0000 7fe3d2000640 1 -- 172.21.15.83:0/3920641099 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3d40041c0 con 0x7fe3dc0a00f0 2024-09-21T00:14:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.886+0000 7fe3d2000640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe3bc078bc0 0x7fe3bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.886+0000 7fe3d2000640 1 -- 172.21.15.83:0/3920641099 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe3d409b1d0 con 0x7fe3dc0a00f0 2024-09-21T00:14:57.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.886+0000 7fe3d9e00640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe3bc078bc0 0x7fe3bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:57.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.887+0000 7fe3d9e00640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe3bc078bc0 0x7fe3bc07b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009230 tx=0x7fe3cc004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:57.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:57.890+0000 7fe3d2000640 1 -- 172.21.15.83:0/3920641099 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe3dc0a0a40 con 0x7fe3dc0a00f0 2024-09-21T00:14:58.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.081+0000 7fe3e1000640 1 -- 172.21.15.83:0/3920641099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe3dc06fa30 con 0x7fe3dc0a00f0 2024-09-21T00:14:58.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.086+0000 7fe3d2000640 1 -- 172.21.15.83:0/3920641099 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7fe3d4062b30 con 0x7fe3dc0a00f0 2024-09-21T00:14:58.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 -- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe3bc078bc0 msgr2=0x7fe3bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:58.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe3bc078bc0 0x7fe3bc07b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009230 tx=0x7fe3cc004730 comp rx=0 tx=0).stop 2024-09-21T00:14:58.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 -- 172.21.15.83:0/3920641099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3dc0a00f0 msgr2=0x7fe3dc0a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:58.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3dc0a00f0 0x7fe3dc0a0500 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400be00 tx=0x7fe3d400bef0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 -- 172.21.15.83:0/3920641099 shutdown_connections 2024-09-21T00:14:58.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe3bc078bc0 0x7fe3bc07b0d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3dc0a00f0 0x7fe3dc0a0500 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3dc0cc530 0x7fe3dc15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 --2- 172.21.15.83:0/3920641099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3dc0af5b0 0x7fe3dc0b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 -- 172.21.15.83:0/3920641099 >> 172.21.15.83:0/3920641099 conn(0x7fe3dc0b1b90 msgr2=0x7fe3dc15de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:58.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 -- 172.21.15.83:0/3920641099 shutdown_connections 2024-09-21T00:14:58.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.088+0000 7fe3e1000640 1 -- 172.21.15.83:0/3920641099 wait complete. 2024-09-21T00:14:58.114 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T00:14:58.114 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T00:14:58.198 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:14:58.199 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T00:14:58.243 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:14:58.285 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T00:14:58.285 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:14:58.285 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:58.320 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:14:58.320 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:58.411 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:14:58.411 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:58.488 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T00:14:58.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.746+0000 7fc70a600640 1 -- 172.21.15.83:0/2328822773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7040d2ba0 msgr2=0x7fc7040b9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:58.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.746+0000 7fc70a600640 1 --2- 172.21.15.83:0/2328822773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7040d2ba0 0x7fc7040b9dd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009830 tx=0x7fc6f402a510 comp rx=0 tx=0).stop 2024-09-21T00:14:58.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.746+0000 7fc70a600640 1 -- 172.21.15.83:0/2328822773 shutdown_connections 2024-09-21T00:14:58.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.746+0000 7fc70a600640 1 --2- 172.21.15.83:0/2328822773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7040cf7e0 0x7fc704162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.746+0000 7fc70a600640 1 --2- 172.21.15.83:0/2328822773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7040d2ba0 0x7fc7040b9dd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.746+0000 7fc70a600640 1 -- 172.21.15.83:0/2328822773 >> 172.21.15.83:0/2328822773 conn(0x7fc7040d42e0 msgr2=0x7fc7040d46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:58.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.746+0000 7fc70a600640 1 -- 172.21.15.83:0/2328822773 shutdown_connections 2024-09-21T00:14:58.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.746+0000 7fc70a600640 1 -- 172.21.15.83:0/2328822773 wait complete. 2024-09-21T00:14:58.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.748+0000 7fc70a600640 1 Processor -- start 2024-09-21T00:14:58.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.748+0000 7fc70a600640 1 -- start start 2024-09-21T00:14:58.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc70a600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7040cf7e0 0x7fc7040c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:58.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc70a600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7040cfbf0 0x7fc7041532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc70a600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7040d2ba0 0x7fc704153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc70a600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc704155730 con 0x7fc7040d2ba0 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc70a600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc7041555b0 con 0x7fc7040cf7e0 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc70a600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc7041558b0 con 0x7fc7040cfbf0 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc709200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7040cf7e0 0x7fc7040c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc6fbe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7040cfbf0 0x7fc7041532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc709c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7040d2ba0 0x7fc704153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc709200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7040cf7e0 0x7fc7040c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:57892/0 (socket says 172.21.15.83:57892) 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc6fbe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7040cfbf0 0x7fc7041532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.83:38558/0 (socket says 172.21.15.83:38558) 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.750+0000 7fc709200640 1 -- 172.21.15.83:0/3137430159 learned_addr learned my addr 172.21.15.83:0/3137430159 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc6fbe00640 1 -- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7040cf7e0 msgr2=0x7fc7040c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc6fbe00640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7040cf7e0 0x7fc7040c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc6fbe00640 1 -- 172.21.15.83:0/3137430159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7040d2ba0 msgr2=0x7fc704153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:58.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc6fbe00640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7040d2ba0 0x7fc704153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc6fbe00640 1 -- 172.21.15.83:0/3137430159 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70415b050 con 0x7fc7040cfbf0 2024-09-21T00:14:58.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc709c00640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7040d2ba0 0x7fc704153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:14:58.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc6fbe00640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7040cfbf0 0x7fc7041532f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00e6d0 tx=0x7fc6ec00eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:58.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc701600640 1 -- 172.21.15.83:0/3137430159 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec00cab0 con 0x7fc7040cfbf0 2024-09-21T00:14:58.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc701600640 1 -- 172.21.15.83:0/3137430159 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6ec00cd40 con 0x7fc7040cfbf0 2024-09-21T00:14:58.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc70a600640 1 -- 172.21.15.83:0/3137430159 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc70415b330 con 0x7fc7040cfbf0 2024-09-21T00:14:58.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc701600640 1 -- 172.21.15.83:0/3137430159 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec010690 con 0x7fc7040cfbf0 2024-09-21T00:14:58.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.751+0000 7fc70a600640 1 -- 172.21.15.83:0/3137430159 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc70415b8f0 con 0x7fc7040cfbf0 2024-09-21T00:14:58.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.752+0000 7fc70a600640 1 -- 172.21.15.83:0/3137430159 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc70415adc0 con 0x7fc7040cfbf0 2024-09-21T00:14:58.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.754+0000 7fc701600640 1 -- 172.21.15.83:0/3137430159 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6ec010830 con 0x7fc7040cfbf0 2024-09-21T00:14:58.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.755+0000 7fc701600640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc6e0078bc0 0x7fc6e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:58.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.755+0000 7fc701600640 1 -- 172.21.15.83:0/3137430159 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc6ec09b960 con 0x7fc7040cfbf0 2024-09-21T00:14:58.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.755+0000 7fc709200640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc6e0078bc0 0x7fc6e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:58.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.756+0000 7fc709200640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc6e0078bc0 0x7fc6e007b0d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4005eb0 tx=0x7fc6f4004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:58.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.760+0000 7fc701600640 1 -- 172.21.15.83:0/3137430159 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc6ec0633d0 con 0x7fc7040cfbf0 2024-09-21T00:14:58.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.958+0000 7fc70a600640 1 -- 172.21.15.83:0/3137430159 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc704162230 con 0x7fc7040cfbf0 2024-09-21T00:14:58.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.959+0000 7fc701600640 1 -- 172.21.15.83:0/3137430159 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fc6ec067e00 con 0x7fc7040cfbf0 2024-09-21T00:14:58.960 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-09-21T00:14:58.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.961+0000 7fc70a600640 1 -- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc6e0078bc0 msgr2=0x7fc6e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:58.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.961+0000 7fc70a600640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc6e0078bc0 0x7fc6e007b0d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4005eb0 tx=0x7fc6f4004730 comp rx=0 tx=0).stop 2024-09-21T00:14:58.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.961+0000 7fc70a600640 1 -- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7040cfbf0 msgr2=0x7fc7041532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:58.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.961+0000 7fc70a600640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7040cfbf0 0x7fc7041532f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00e6d0 tx=0x7fc6ec00eb90 comp rx=0 tx=0).stop 2024-09-21T00:14:58.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.961+0000 7fc70a600640 1 -- 172.21.15.83:0/3137430159 shutdown_connections 2024-09-21T00:14:58.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.961+0000 7fc70a600640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc6e0078bc0 0x7fc6e007b0d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.961+0000 7fc70a600640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7040d2ba0 0x7fc704153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.962+0000 7fc70a600640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7040cfbf0 0x7fc7041532f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.962+0000 7fc70a600640 1 --2- 172.21.15.83:0/3137430159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7040cf7e0 0x7fc7040c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:58.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.962+0000 7fc70a600640 1 -- 172.21.15.83:0/3137430159 >> 172.21.15.83:0/3137430159 conn(0x7fc7040d42e0 msgr2=0x7fc704154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:58.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.962+0000 7fc70a600640 1 -- 172.21.15.83:0/3137430159 shutdown_connections 2024-09-21T00:14:58.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:58.962+0000 7fc70a600640 1 -- 172.21.15.83:0/3137430159 wait complete. 2024-09-21T00:14:58.988 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T00:14:58.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:58.988 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-21T00:14:59.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:14:59.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:59.050 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T00:14:59.087 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:14:59.087 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:59.125 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:14:59.126 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:59.204 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:14:59.205 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:59.281 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T00:14:59.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.503+0000 7f2c4c200640 1 -- 172.21.15.83:0/506027240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c44156a50 msgr2=0x7f2c44074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:59.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.503+0000 7f2c4c200640 1 --2- 172.21.15.83:0/506027240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c44156a50 0x7f2c44074620 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c38005fd0 tx=0x7f2c3802a5d0 comp rx=0 tx=0).stop 2024-09-21T00:14:59.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.503+0000 7f2c4c200640 1 -- 172.21.15.83:0/506027240 shutdown_connections 2024-09-21T00:14:59.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.503+0000 7f2c4c200640 1 --2- 172.21.15.83:0/506027240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c4406e500 0x7f2c440cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:59.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.503+0000 7f2c4c200640 1 --2- 172.21.15.83:0/506027240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c44156a50 0x7f2c44074620 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:59.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.503+0000 7f2c4c200640 1 -- 172.21.15.83:0/506027240 >> 172.21.15.83:0/506027240 conn(0x7f2c440b1b90 msgr2=0x7f2c440b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:59.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.503+0000 7f2c4c200640 1 -- 172.21.15.83:0/506027240 shutdown_connections 2024-09-21T00:14:59.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.503+0000 7f2c4c200640 1 -- 172.21.15.83:0/506027240 wait complete. 2024-09-21T00:14:59.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.505+0000 7f2c4c200640 1 Processor -- start 2024-09-21T00:14:59.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.506+0000 7f2c4c200640 1 -- start start 2024-09-21T00:14:59.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.507+0000 7f2c4c200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c44074b60 0x7f2c44159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:59.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.507+0000 7f2c4c200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c44156a50 0x7f2c4415b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:59.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.507+0000 7f2c4c200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c441f5810 0x7f2c4415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:59.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.507+0000 7f2c4c200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440cf7d0 con 0x7f2c44074b60 2024-09-21T00:14:59.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.507+0000 7f2c4c200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440cf650 con 0x7f2c441f5810 2024-09-21T00:14:59.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.507+0000 7f2c4c200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2c440cf950 con 0x7f2c44156a50 2024-09-21T00:14:59.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.507+0000 7f2c49800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c44074b60 0x7f2c44159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:59.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.507+0000 7f2c49800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c44074b60 0x7f2c44159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50944/0 (socket says 172.21.15.83:50944) 2024-09-21T00:14:59.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.507+0000 7f2c49800640 1 -- 172.21.15.83:0/2246844608 learned_addr learned my addr 172.21.15.83:0/2246844608 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:14:59.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.507+0000 7f2c48e00640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c44156a50 0x7f2c4415b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:59.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.508+0000 7f2c4a200640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c441f5810 0x7f2c4415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:59.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.508+0000 7f2c49800640 1 -- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c44156a50 msgr2=0x7f2c4415b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:59.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.508+0000 7f2c49800640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c44156a50 0x7f2c4415b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:59.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.508+0000 7f2c49800640 1 -- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c441f5810 msgr2=0x7f2c4415bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:59.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.508+0000 7f2c49800640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c441f5810 0x7f2c4415bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:59.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.508+0000 7f2c49800640 1 -- 172.21.15.83:0/2246844608 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c44157280 con 0x7f2c44074b60 2024-09-21T00:14:59.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.508+0000 7f2c49800640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c44074b60 0x7f2c44159f80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c38034040 tx=0x7f2c380035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:59.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.508+0000 7f2c41600640 1 -- 172.21.15.83:0/2246844608 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3803e030 con 0x7f2c44074b60 2024-09-21T00:14:59.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.509+0000 7f2c41600640 1 -- 172.21.15.83:0/2246844608 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c38003ae0 con 0x7f2c44074b60 2024-09-21T00:14:59.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.509+0000 7f2c4c200640 1 -- 172.21.15.83:0/2246844608 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c44157560 con 0x7f2c44074b60 2024-09-21T00:14:59.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.509+0000 7f2c41600640 1 -- 172.21.15.83:0/2246844608 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c38035040 con 0x7f2c44074b60 2024-09-21T00:14:59.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.509+0000 7f2c4c200640 1 -- 172.21.15.83:0/2246844608 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c44157b20 con 0x7f2c44074b60 2024-09-21T00:14:59.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.510+0000 7f2c4c200640 1 -- 172.21.15.83:0/2246844608 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c440cef00 con 0x7f2c44074b60 2024-09-21T00:14:59.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.511+0000 7f2c41600640 1 -- 172.21.15.83:0/2246844608 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c38041030 con 0x7f2c44074b60 2024-09-21T00:14:59.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.512+0000 7f2c41600640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2c24078b90 0x7f2c2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:14:59.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.512+0000 7f2c41600640 1 -- 172.21.15.83:0/2246844608 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2c380bb4e0 con 0x7f2c44074b60 2024-09-21T00:14:59.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.512+0000 7f2c48e00640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2c24078b90 0x7f2c2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:14:59.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.513+0000 7f2c48e00640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2c24078b90 0x7f2c2407b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2c440c5980 tx=0x7f2c30009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:14:59.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.517+0000 7f2c41600640 1 -- 172.21.15.83:0/2246844608 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2c38082ff0 con 0x7f2c44074b60 2024-09-21T00:14:59.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.715+0000 7f2c4c200640 1 -- 172.21.15.83:0/2246844608 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2c4406dab0 con 0x7f2c44074b60 2024-09-21T00:14:59.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.716+0000 7f2c41600640 1 -- 172.21.15.83:0/2246844608 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f2c38087a20 con 0x7f2c44074b60 2024-09-21T00:14:59.717 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 -- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2c24078b90 msgr2=0x7f2c2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2c24078b90 0x7f2c2407b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2c440c5980 tx=0x7f2c30009040 comp rx=0 tx=0).stop 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 -- 172.21.15.83:0/2246844608 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c44074b60 msgr2=0x7f2c44159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c44074b60 0x7f2c44159f80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c38034040 tx=0x7f2c380035f0 comp rx=0 tx=0).stop 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 -- 172.21.15.83:0/2246844608 shutdown_connections 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2c24078b90 0x7f2c2407b0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c441f5810 0x7f2c4415bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c44156a50 0x7f2c4415b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 --2- 172.21.15.83:0/2246844608 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c44074b60 0x7f2c44159f80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 -- 172.21.15.83:0/2246844608 >> 172.21.15.83:0/2246844608 conn(0x7f2c440b1b90 msgr2=0x7f2c440b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 -- 172.21.15.83:0/2246844608 shutdown_connections 2024-09-21T00:14:59.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:14:59.718+0000 7f2c4c200640 1 -- 172.21.15.83:0/2246844608 wait complete. 2024-09-21T00:14:59.745 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T00:14:59.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:59.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-21T00:14:59.806 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:14:59.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:14:59.807 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T00:14:59.849 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:14:59.849 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:59.885 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:14:59.885 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:14:59.960 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:14:59.960 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:00.037 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T00:15:00.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.297+0000 7fe659400640 1 -- 172.21.15.83:0/2857369167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe654156a50 msgr2=0x7fe654074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:00.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.297+0000 7fe659400640 1 --2- 172.21.15.83:0/2857369167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe654156a50 0x7fe654074620 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe644005fd0 tx=0x7fe64402a5d0 comp rx=0 tx=0).stop 2024-09-21T00:15:00.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.297+0000 7fe659400640 1 -- 172.21.15.83:0/2857369167 shutdown_connections 2024-09-21T00:15:00.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.297+0000 7fe659400640 1 --2- 172.21.15.83:0/2857369167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe65406e500 0x7fe6540cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:00.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.297+0000 7fe659400640 1 --2- 172.21.15.83:0/2857369167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe654156a50 0x7fe654074620 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:00.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.297+0000 7fe659400640 1 -- 172.21.15.83:0/2857369167 >> 172.21.15.83:0/2857369167 conn(0x7fe6540b1b90 msgr2=0x7fe6540b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:00.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.297+0000 7fe659400640 1 -- 172.21.15.83:0/2857369167 shutdown_connections 2024-09-21T00:15:00.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.297+0000 7fe659400640 1 -- 172.21.15.83:0/2857369167 wait complete. 2024-09-21T00:15:00.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.300+0000 7fe659400640 1 Processor -- start 2024-09-21T00:15:00.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.300+0000 7fe659400640 1 -- start start 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.301+0000 7fe659400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654074b60 0x7fe654158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.301+0000 7fe659400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe654156a50 0x7fe654156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.301+0000 7fe659400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6540bbc50 0x7fe6540bc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.301+0000 7fe659400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe6540cf7d0 con 0x7fe6540bbc50 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.301+0000 7fe659400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe6540cf650 con 0x7fe654074b60 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.301+0000 7fe659400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe6540cf950 con 0x7fe654156a50 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe653200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6540bbc50 0x7fe6540bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe653200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6540bbc50 0x7fe6540bc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50948/0 (socket says 172.21.15.83:50948) 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe653200640 1 -- 172.21.15.83:0/811303522 learned_addr learned my addr 172.21.15.83:0/811303522 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe649e00640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe654156a50 0x7fe654156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:00.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe652800640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654074b60 0x7fe654158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe653200640 1 -- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe654156a50 msgr2=0x7fe654156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe653200640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe654156a50 0x7fe654156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe653200640 1 -- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654074b60 msgr2=0x7fe654158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe653200640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654074b60 0x7fe654158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe653200640 1 -- 172.21.15.83:0/811303522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65415a4f0 con 0x7fe6540bbc50 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe649e00640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe654156a50 0x7fe654156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe652800640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654074b60 0x7fe654158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe653200640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6540bbc50 0x7fe6540bc060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00d9d0 tx=0x7fe64c00de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.302+0000 7fe64b400640 1 -- 172.21.15.83:0/811303522 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c017070 con 0x7fe6540bbc50 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.303+0000 7fe64b400640 1 -- 172.21.15.83:0/811303522 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe64c003970 con 0x7fe6540bbc50 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.303+0000 7fe64b400640 1 -- 172.21.15.83:0/811303522 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00be60 con 0x7fe6540bbc50 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.303+0000 7fe659400640 1 -- 172.21.15.83:0/811303522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe654158f40 con 0x7fe6540bbc50 2024-09-21T00:15:00.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.303+0000 7fe659400640 1 -- 172.21.15.83:0/811303522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe654159450 con 0x7fe6540bbc50 2024-09-21T00:15:00.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.304+0000 7fe659400640 1 -- 172.21.15.83:0/811303522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6541591c0 con 0x7fe6540bbc50 2024-09-21T00:15:00.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.305+0000 7fe64b400640 1 -- 172.21.15.83:0/811303522 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe64c010460 con 0x7fe6540bbc50 2024-09-21T00:15:00.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.306+0000 7fe64b400640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe630078b90 0x7fe63007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:00.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.306+0000 7fe64b400640 1 -- 172.21.15.83:0/811303522 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe64c09b540 con 0x7fe6540bbc50 2024-09-21T00:15:00.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.306+0000 7fe652800640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe630078b90 0x7fe63007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:00.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.307+0000 7fe652800640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe630078b90 0x7fe63007b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe644033000 tx=0x7fe644004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:00.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.310+0000 7fe64b400640 1 -- 172.21.15.83:0/811303522 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe64c063610 con 0x7fe6540bbc50 2024-09-21T00:15:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.506+0000 7fe659400640 1 -- 172.21.15.83:0/811303522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe6540b1700 con 0x7fe6540bbc50 2024-09-21T00:15:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.506+0000 7fe64b400640 1 -- 172.21.15.83:0/811303522 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fe64c062f10 con 0x7fe6540bbc50 2024-09-21T00:15:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-09-21T00:15:00.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 -- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe630078b90 msgr2=0x7fe63007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe630078b90 0x7fe63007b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe644033000 tx=0x7fe644004730 comp rx=0 tx=0).stop 2024-09-21T00:15:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 -- 172.21.15.83:0/811303522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6540bbc50 msgr2=0x7fe6540bc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6540bbc50 0x7fe6540bc060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00d9d0 tx=0x7fe64c00de90 comp rx=0 tx=0).stop 2024-09-21T00:15:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 -- 172.21.15.83:0/811303522 shutdown_connections 2024-09-21T00:15:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe630078b90 0x7fe63007b0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6540bbc50 0x7fe6540bc060 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe654156a50 0x7fe654156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 --2- 172.21.15.83:0/811303522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654074b60 0x7fe654158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 -- 172.21.15.83:0/811303522 >> 172.21.15.83:0/811303522 conn(0x7fe6540b1b90 msgr2=0x7fe6540afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:00.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 -- 172.21.15.83:0/811303522 shutdown_connections 2024-09-21T00:15:00.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:00.509+0000 7fe659400640 1 -- 172.21.15.83:0/811303522 wait complete. 2024-09-21T00:15:00.532 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-21T00:15:00.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:00.532 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-21T00:15:00.592 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:15:00.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:00.593 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-21T00:15:00.630 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:15:00.630 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:00.668 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:15:00.668 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:00.743 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:15:00.743 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:00.818 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T00:15:01.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.040+0000 7f4b2b200640 1 -- 172.21.15.83:0/62019353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b2c152680 msgr2=0x7f4b2c0cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:01.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.040+0000 7f4b2b200640 1 --2- 172.21.15.83:0/62019353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b2c152680 0x7f4b2c0cf750 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c072620 tx=0x7f4b1402a580 comp rx=0 tx=0).stop 2024-09-21T00:15:01.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.040+0000 7f4b2b200640 1 -- 172.21.15.83:0/62019353 shutdown_connections 2024-09-21T00:15:01.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.040+0000 7f4b2b200640 1 --2- 172.21.15.83:0/62019353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b2c152680 0x7f4b2c0cf750 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.040+0000 7f4b2b200640 1 --2- 172.21.15.83:0/62019353 >> v2:172.21.15.142:3300/0 conn(0x7f4b2c152270 0x7f4b2c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.040+0000 7f4b2b200640 1 -- 172.21.15.83:0/62019353 >> 172.21.15.83:0/62019353 conn(0x7f4b2c0d05c0 msgr2=0x7f4b2c06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:01.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.040+0000 7f4b2b200640 1 -- 172.21.15.83:0/62019353 shutdown_connections 2024-09-21T00:15:01.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.040+0000 7f4b2b200640 1 -- 172.21.15.83:0/62019353 wait complete. 2024-09-21T00:15:01.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.042+0000 7f4b2b200640 1 Processor -- start 2024-09-21T00:15:01.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.042+0000 7f4b2b200640 1 -- start start 2024-09-21T00:15:01.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b2b200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b2c152270 0x7f4b2c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:01.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b2b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b2c152680 0x7f4b2c146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:01.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b2b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2c15bcc0 0x7f4b2c143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:01.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b2b200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c073f10 con 0x7f4b2c152270 2024-09-21T00:15:01.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b2b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c073d90 con 0x7f4b2c152680 2024-09-21T00:15:01.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b2b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4b2c074090 con 0x7f4b2c15bcc0 2024-09-21T00:15:01.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b29e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b2c152270 0x7f4b2c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:01.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b29e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b2c152270 0x7f4b2c156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50972/0 (socket says 172.21.15.83:50972) 2024-09-21T00:15:01.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b29e00640 1 -- 172.21.15.83:0/918835007 learned_addr learned my addr 172.21.15.83:0/918835007 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:01.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b21400640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b2c152680 0x7f4b2c146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:01.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b2a800640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2c15bcc0 0x7f4b2c143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:01.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b29e00640 1 -- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2c15bcc0 msgr2=0x7f4b2c143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:01.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b29e00640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2c15bcc0 0x7f4b2c143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b29e00640 1 -- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b2c152680 msgr2=0x7f4b2c146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:01.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.044+0000 7f4b29e00640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b2c152680 0x7f4b2c146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.045+0000 7f4b29e00640 1 -- 172.21.15.83:0/918835007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c1440c0 con 0x7f4b2c152270 2024-09-21T00:15:01.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.045+0000 7f4b2a800640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2c15bcc0 0x7f4b2c143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:01.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.045+0000 7f4b29e00640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b2c152270 0x7f4b2c156d30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00d740 tx=0x7f4b1c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:01.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.045+0000 7f4b22a00640 1 -- 172.21.15.83:0/918835007 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c017070 con 0x7f4b2c152270 2024-09-21T00:15:01.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.045+0000 7f4b22a00640 1 -- 172.21.15.83:0/918835007 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b1c009d20 con 0x7f4b2c152270 2024-09-21T00:15:01.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.045+0000 7f4b2b200640 1 -- 172.21.15.83:0/918835007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2c156250 con 0x7f4b2c152270 2024-09-21T00:15:01.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.045+0000 7f4b22a00640 1 -- 172.21.15.83:0/918835007 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0106c0 con 0x7f4b2c152270 2024-09-21T00:15:01.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.045+0000 7f4b2b200640 1 -- 172.21.15.83:0/918835007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2c141e10 con 0x7f4b2c152270 2024-09-21T00:15:01.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.046+0000 7f4b2b200640 1 -- 172.21.15.83:0/918835007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2c0745b0 con 0x7f4b2c152270 2024-09-21T00:15:01.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.047+0000 7f4b22a00640 1 -- 172.21.15.83:0/918835007 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b1c01a070 con 0x7f4b2c152270 2024-09-21T00:15:01.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.048+0000 7f4b22a00640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4b08078bc0 0x7f4b0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:01.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.048+0000 7f4b22a00640 1 -- 172.21.15.83:0/918835007 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f4b1c09b0d0 con 0x7f4b2c152270 2024-09-21T00:15:01.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.049+0000 7f4b21400640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4b08078bc0 0x7f4b0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:01.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.050+0000 7f4b21400640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4b08078bc0 0x7f4b0807b0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b14033000 tx=0x7f4b14004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:01.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.053+0000 7f4b22a00640 1 -- 172.21.15.83:0/918835007 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4b1c062bd0 con 0x7f4b2c152270 2024-09-21T00:15:01.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.250+0000 7f4b2b200640 1 -- 172.21.15.83:0/918835007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4b2c155740 con 0x7f4b2c152270 2024-09-21T00:15:01.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.250+0000 7f4b22a00640 1 -- 172.21.15.83:0/918835007 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f4b1c067600 con 0x7f4b2c152270 2024-09-21T00:15:01.252 INFO:teuthology.orchestra.run.smithi083.stderr:listed 0 entries 2024-09-21T00:15:01.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 -- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4b08078bc0 msgr2=0x7f4b0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:01.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4b08078bc0 0x7f4b0807b0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b14033000 tx=0x7f4b14004730 comp rx=0 tx=0).stop 2024-09-21T00:15:01.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 -- 172.21.15.83:0/918835007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b2c152270 msgr2=0x7f4b2c156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:01.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b2c152270 0x7f4b2c156d30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00d740 tx=0x7f4b1c00dc00 comp rx=0 tx=0).stop 2024-09-21T00:15:01.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 -- 172.21.15.83:0/918835007 shutdown_connections 2024-09-21T00:15:01.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4b08078bc0 0x7f4b0807b0d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2c15bcc0 0x7f4b2c143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b2c152680 0x7f4b2c146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 --2- 172.21.15.83:0/918835007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b2c152270 0x7f4b2c156d30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 -- 172.21.15.83:0/918835007 >> 172.21.15.83:0/918835007 conn(0x7f4b2c0d05c0 msgr2=0x7f4b2c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:01.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 -- 172.21.15.83:0/918835007 shutdown_connections 2024-09-21T00:15:01.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.253+0000 7f4b2b200640 1 -- 172.21.15.83:0/918835007 wait complete. 2024-09-21T00:15:01.278 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-21T00:15:01.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:01.278 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-21T00:15:01.342 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:15:01.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:01.342 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-21T00:15:01.378 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T00:15:01.378 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:01.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.599+0000 7f37b9800640 1 -- 172.21.15.83:0/2948820668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3798003c60 msgr2=0x7f37980040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:01.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.599+0000 7f37b9800640 1 --2- 172.21.15.83:0/2948820668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3798003c60 0x7f37980040b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c2e0 tx=0x7f3798005830 comp rx=0 tx=0).stop 2024-09-21T00:15:01.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.599+0000 7f37b3400640 1 -- 172.21.15.83:0/2948820668 reap_dead start 2024-09-21T00:15:01.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.599+0000 7f37b9800640 1 -- 172.21.15.83:0/2948820668 shutdown_connections 2024-09-21T00:15:01.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.599+0000 7f37b9800640 1 -- 172.21.15.83:0/2948820668 >> 172.21.15.83:0/2948820668 conn(0x7f37b40cca40 msgr2=0x7f37b40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:01.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.599+0000 7f37b9800640 1 -- 172.21.15.83:0/2948820668 shutdown_connections 2024-09-21T00:15:01.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.599+0000 7f37b9800640 1 -- 172.21.15.83:0/2948820668 wait complete. 2024-09-21T00:15:01.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.602+0000 7f37b9800640 1 Processor -- start 2024-09-21T00:15:01.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.602+0000 7f37b9800640 1 -- start start 2024-09-21T00:15:01.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.603+0000 7f37b9800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3798003c60 0x7f37b41593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:01.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.603+0000 7f37b9800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b40c61b0 0x7f37b40c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:01.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.603+0000 7f37b9800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b40c65c0 0x7f37b40c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:01.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.603+0000 7f37b9800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f37b415ad10 con 0x7f3798003c60 2024-09-21T00:15:01.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.603+0000 7f37b9800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f37b406e710 con 0x7f37b40c61b0 2024-09-21T00:15:01.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.603+0000 7f37b9800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f37b4070e80 con 0x7f37b40c65c0 2024-09-21T00:15:01.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.604+0000 7f37b2a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3798003c60 0x7f37b41593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:01.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.604+0000 7f37b2a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3798003c60 0x7f37b41593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50994/0 (socket says 172.21.15.83:50994) 2024-09-21T00:15:01.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.604+0000 7f37b2a00640 1 -- 172.21.15.83:0/1396456763 learned_addr learned my addr 172.21.15.83:0/1396456763 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:01.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.604+0000 7f37b3400640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b40c65c0 0x7f37b40c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:01.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.604+0000 7f37b2000640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b40c61b0 0x7f37b40c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:01.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.604+0000 7f37b2a00640 1 -- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b40c65c0 msgr2=0x7f37b40c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:01.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.604+0000 7f37b2a00640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b40c65c0 0x7f37b40c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.604+0000 7f37b2a00640 1 -- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b40c61b0 msgr2=0x7f37b40c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:01.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.604+0000 7f37b2a00640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b40c61b0 0x7f37b40c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.604+0000 7f37b2a00640 1 -- 172.21.15.83:0/1396456763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b40b4ec0 con 0x7f3798003c60 2024-09-21T00:15:01.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.605+0000 7f37b2a00640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3798003c60 0x7f37b41593a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c340 tx=0x7f37a4006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:01.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.605+0000 7f37aaa00640 1 -- 172.21.15.83:0/1396456763 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4006bf0 con 0x7f3798003c60 2024-09-21T00:15:01.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.605+0000 7f37aaa00640 1 -- 172.21.15.83:0/1396456763 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37a403f070 con 0x7f3798003c60 2024-09-21T00:15:01.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.605+0000 7f37aaa00640 1 -- 172.21.15.83:0/1396456763 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4003bc0 con 0x7f3798003c60 2024-09-21T00:15:01.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.605+0000 7f37b9800640 1 -- 172.21.15.83:0/1396456763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b40b51a0 con 0x7f3798003c60 2024-09-21T00:15:01.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.605+0000 7f37b9800640 1 -- 172.21.15.83:0/1396456763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b40b5c80 con 0x7f3798003c60 2024-09-21T00:15:01.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.606+0000 7f37b9800640 1 -- 172.21.15.83:0/1396456763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b406ddf0 con 0x7f3798003c60 2024-09-21T00:15:01.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.607+0000 7f37aaa00640 1 -- 172.21.15.83:0/1396456763 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f37a402f450 con 0x7f3798003c60 2024-09-21T00:15:01.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.609+0000 7f37aaa00640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3794078bc0 0x7f379407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:01.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.609+0000 7f37aaa00640 1 -- 172.21.15.83:0/1396456763 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f37a40bc1d0 con 0x7f3798003c60 2024-09-21T00:15:01.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.609+0000 7f37b2000640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3794078bc0 0x7f379407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:01.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.610+0000 7f37b2000640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3794078bc0 0x7f379407b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f37b4069570 tx=0x7f37a0006ab0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:01.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.614+0000 7f37aaa00640 1 -- 172.21.15.83:0/1396456763 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f37a40842a0 con 0x7f3798003c60 2024-09-21T00:15:01.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.836+0000 7f37b9800640 1 -- 172.21.15.83:0/1396456763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37b40b5f40 con 0x7f3798003c60 2024-09-21T00:15:01.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.837+0000 7f37aaa00640 1 -- 172.21.15.83:0/1396456763 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5222 (secure 0 0 0) 0x7f37a4083ba0 con 0x7f3798003c60 2024-09-21T00:15:01.839 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:01.839 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"btime":"2024-09-21T00:14:27:026365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:14:09.437323+0000","modified":"2024-09-21T00:14:26.510440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-21T00:15:01.839 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-09-21T00:15:01.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 -- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3794078bc0 msgr2=0x7f379407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:01.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3794078bc0 0x7f379407b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f37b4069570 tx=0x7f37a0006ab0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 -- 172.21.15.83:0/1396456763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3798003c60 msgr2=0x7f37b41593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:01.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3798003c60 0x7f37b41593a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c340 tx=0x7f37a4006290 comp rx=0 tx=0).stop 2024-09-21T00:15:01.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 -- 172.21.15.83:0/1396456763 shutdown_connections 2024-09-21T00:15:01.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3794078bc0 0x7f379407b0d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b40c65c0 0x7f37b40c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b40c61b0 0x7f37b40c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 --2- 172.21.15.83:0/1396456763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3798003c60 0x7f37b41593a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:01.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 -- 172.21.15.83:0/1396456763 >> 172.21.15.83:0/1396456763 conn(0x7f37b40cca40 msgr2=0x7f37b4159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:01.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 -- 172.21.15.83:0/1396456763 shutdown_connections 2024-09-21T00:15:01.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:01.839+0000 7f37b9800640 1 -- 172.21.15.83:0/1396456763 wait complete. 2024-09-21T00:15:01.864 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:02.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.088+0000 7ff37ca00640 1 -- 172.21.15.83:0/4226650660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37806e330 msgr2=0x7ff37806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:02.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.088+0000 7ff37ca00640 1 --2- 172.21.15.83:0/4226650660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37806e330 0x7ff37806ede0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff370005fd0 tx=0x7ff37002aa90 comp rx=0 tx=0).stop 2024-09-21T00:15:02.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.088+0000 7ff37ca00640 1 -- 172.21.15.83:0/4226650660 shutdown_connections 2024-09-21T00:15:02.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.088+0000 7ff37ca00640 1 --2- 172.21.15.83:0/4226650660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37806e330 0x7ff37806ede0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.088+0000 7ff37ca00640 1 --2- 172.21.15.83:0/4226650660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff378073dd0 0x7ff37806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.088+0000 7ff37ca00640 1 -- 172.21.15.83:0/4226650660 >> 172.21.15.83:0/4226650660 conn(0x7ff3780cca40 msgr2=0x7ff3780cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:02.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.088+0000 7ff37ca00640 1 -- 172.21.15.83:0/4226650660 shutdown_connections 2024-09-21T00:15:02.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.088+0000 7ff37ca00640 1 -- 172.21.15.83:0/4226650660 wait complete. 2024-09-21T00:15:02.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.090+0000 7ff37ca00640 1 Processor -- start 2024-09-21T00:15:02.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.091+0000 7ff37ca00640 1 -- start start 2024-09-21T00:15:02.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.092+0000 7ff37ca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37806e330 0x7ff3781f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:02.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.092+0000 7ff37ca00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff378073dd0 0x7ff378158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:02.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.092+0000 7ff37ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff378074cb0 0x7ff3780c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:02.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.092+0000 7ff37ca00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff37806f4a0 con 0x7ff378073dd0 2024-09-21T00:15:02.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.092+0000 7ff37ca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff37806f320 con 0x7ff37806e330 2024-09-21T00:15:02.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.092+0000 7ff37ca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff37806f620 con 0x7ff378074cb0 2024-09-21T00:15:02.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.092+0000 7ff36d400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff378073dd0 0x7ff378158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:02.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.092+0000 7ff36d400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff378073dd0 0x7ff378158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56954/0 (socket says 172.21.15.83:56954) 2024-09-21T00:15:02.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.092+0000 7ff36d400640 1 -- 172.21.15.83:0/1002306307 learned_addr learned my addr 172.21.15.83:0/1002306307 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:02.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff376800640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff378074cb0 0x7ff3780c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:02.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff375e00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37806e330 0x7ff3781f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:02.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff36d400640 1 -- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff378074cb0 msgr2=0x7ff3780c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:02.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff36d400640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff378074cb0 0x7ff3780c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff36d400640 1 -- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37806e330 msgr2=0x7ff3781f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:02.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff36d400640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37806e330 0x7ff3781f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff36d400640 1 -- 172.21.15.83:0/1002306307 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3780b2e10 con 0x7ff378073dd0 2024-09-21T00:15:02.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff376800640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff378074cb0 0x7ff3780c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:02.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff375e00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37806e330 0x7ff3781f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:02.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff36d400640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff378073dd0 0x7ff378158c40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff36000e7c0 tx=0x7ff36000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:02.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff36ea00640 1 -- 172.21.15.83:0/1002306307 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36000ccc0 con 0x7ff378073dd0 2024-09-21T00:15:02.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff36ea00640 1 -- 172.21.15.83:0/1002306307 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff360010430 con 0x7ff378073dd0 2024-09-21T00:15:02.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff36ea00640 1 -- 172.21.15.83:0/1002306307 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360010860 con 0x7ff378073dd0 2024-09-21T00:15:02.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.093+0000 7ff37ca00640 1 -- 172.21.15.83:0/1002306307 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3780b5960 con 0x7ff378073dd0 2024-09-21T00:15:02.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.094+0000 7ff37ca00640 1 -- 172.21.15.83:0/1002306307 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3780c3c60 con 0x7ff378073dd0 2024-09-21T00:15:02.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.094+0000 7ff37ca00640 1 -- 172.21.15.83:0/1002306307 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3780b5e80 con 0x7ff378073dd0 2024-09-21T00:15:02.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.096+0000 7ff36ea00640 1 -- 172.21.15.83:0/1002306307 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff360010a00 con 0x7ff378073dd0 2024-09-21T00:15:02.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.097+0000 7ff36ea00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff354078b90 0x7ff35407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:02.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.097+0000 7ff36ea00640 1 -- 172.21.15.83:0/1002306307 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff36009bb60 con 0x7ff378073dd0 2024-09-21T00:15:02.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.097+0000 7ff375e00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff354078b90 0x7ff35407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:02.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.098+0000 7ff375e00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff354078b90 0x7ff35407b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff368007fd0 tx=0x7ff368009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:02.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.101+0000 7ff36ea00640 1 -- 172.21.15.83:0/1002306307 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff3780b5e80 con 0x7ff378073dd0 2024-09-21T00:15:02.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.326+0000 7ff37ca00640 1 -- 172.21.15.83:0/1002306307 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff378159e30 con 0x7ff378073dd0 2024-09-21T00:15:02.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.327+0000 7ff36ea00640 1 -- 172.21.15.83:0/1002306307 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5222 (secure 0 0 0) 0x7ff378159e30 con 0x7ff378073dd0 2024-09-21T00:15:02.328 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"btime":"2024-09-21T00:14:27:026365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:14:09.437323+0000","modified":"2024-09-21T00:14:26.510440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-21T00:15:02.329 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.329+0000 7ff37ca00640 1 -- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff354078b90 msgr2=0x7ff35407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.329+0000 7ff37ca00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff354078b90 0x7ff35407b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff368007fd0 tx=0x7ff368009040 comp rx=0 tx=0).stop 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.329+0000 7ff37ca00640 1 -- 172.21.15.83:0/1002306307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff378073dd0 msgr2=0x7ff378158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.329+0000 7ff37ca00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff378073dd0 0x7ff378158c40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff36000e7c0 tx=0x7ff36000ec80 comp rx=0 tx=0).stop 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.329+0000 7ff37ca00640 1 -- 172.21.15.83:0/1002306307 shutdown_connections 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.329+0000 7ff37ca00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7ff354078b90 0x7ff35407b0a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.329+0000 7ff37ca00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff378074cb0 0x7ff3780c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.329+0000 7ff37ca00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff378073dd0 0x7ff378158c40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.329+0000 7ff37ca00640 1 --2- 172.21.15.83:0/1002306307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37806e330 0x7ff3781f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.329+0000 7ff37ca00640 1 -- 172.21.15.83:0/1002306307 >> 172.21.15.83:0/1002306307 conn(0x7ff3780cca40 msgr2=0x7ff37809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:02.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.330+0000 7ff37ca00640 1 -- 172.21.15.83:0/1002306307 shutdown_connections 2024-09-21T00:15:02.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.330+0000 7ff37ca00640 1 -- 172.21.15.83:0/1002306307 wait complete. 2024-09-21T00:15:02.352 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:15:02.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.570+0000 7f93d3000640 1 -- 172.21.15.83:0/4235570165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93cc0cb750 msgr2=0x7f93cc0af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:02.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.570+0000 7f93d3000640 1 --2- 172.21.15.83:0/4235570165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93cc0cb750 0x7f93cc0af420 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f93bc005fd0 tx=0x7f93bc02a670 comp rx=0 tx=0).stop 2024-09-21T00:15:02.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.570+0000 7f93d3000640 1 -- 172.21.15.83:0/4235570165 shutdown_connections 2024-09-21T00:15:02.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.570+0000 7f93d3000640 1 --2- 172.21.15.83:0/4235570165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93cc0cb750 0x7f93cc0af420 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.570+0000 7f93d3000640 1 -- 172.21.15.83:0/4235570165 >> 172.21.15.83:0/4235570165 conn(0x7f93cc0cca40 msgr2=0x7f93cc0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:02.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.570+0000 7f93d3000640 1 -- 172.21.15.83:0/4235570165 shutdown_connections 2024-09-21T00:15:02.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.570+0000 7f93d3000640 1 -- 172.21.15.83:0/4235570165 wait complete. 2024-09-21T00:15:02.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.572+0000 7f93d3000640 1 Processor -- start 2024-09-21T00:15:02.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.573+0000 7f93d3000640 1 -- start start 2024-09-21T00:15:02.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93d3000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93cc15e7c0 0x7f93cc1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:02.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93d3000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93cc0c9d60 0x7f93cc1f8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:02.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93d3000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93cc074c50 0x7f93cc1f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:02.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93d3000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc0ce8a0 con 0x7f93cc074c50 2024-09-21T00:15:02.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93d3000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc0ce720 con 0x7f93cc15e7c0 2024-09-21T00:15:02.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93d3000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f93cc0cea20 con 0x7f93cc0c9d60 2024-09-21T00:15:02.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93d1000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93cc074c50 0x7f93cc1f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:02.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93d1000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93cc074c50 0x7f93cc1f8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56980/0 (socket says 172.21.15.83:56980) 2024-09-21T00:15:02.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93d1000640 1 -- 172.21.15.83:0/2538484071 learned_addr learned my addr 172.21.15.83:0/2538484071 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:02.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93cbe00640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93cc15e7c0 0x7f93cc1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:02.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.574+0000 7f93c3400640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93cc0c9d60 0x7f93cc1f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:02.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.575+0000 7f93d1000640 1 -- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93cc0c9d60 msgr2=0x7f93cc1f8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:02.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.575+0000 7f93d1000640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93cc0c9d60 0x7f93cc1f8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.575+0000 7f93d1000640 1 -- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93cc15e7c0 msgr2=0x7f93cc1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:02.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.575+0000 7f93d1000640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93cc15e7c0 0x7f93cc1599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.575+0000 7f93d1000640 1 -- 172.21.15.83:0/2538484071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc0b5640 con 0x7f93cc074c50 2024-09-21T00:15:02.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.575+0000 7f93d1000640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93cc074c50 0x7f93cc1f8cb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f93c400c730 tx=0x7f93c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:02.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.575+0000 7f93c8c00640 1 -- 172.21.15.83:0/2538484071 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4003b70 con 0x7f93cc074c50 2024-09-21T00:15:02.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.575+0000 7f93c8c00640 1 -- 172.21.15.83:0/2538484071 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93c4003d10 con 0x7f93cc074c50 2024-09-21T00:15:02.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.575+0000 7f93c8c00640 1 -- 172.21.15.83:0/2538484071 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c400aa50 con 0x7f93cc074c50 2024-09-21T00:15:02.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.575+0000 7f93d3000640 1 -- 172.21.15.83:0/2538484071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93cc1f9550 con 0x7f93cc074c50 2024-09-21T00:15:02.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.576+0000 7f93d3000640 1 -- 172.21.15.83:0/2538484071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93cc1600b0 con 0x7f93cc074c50 2024-09-21T00:15:02.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.577+0000 7f93d3000640 1 -- 172.21.15.83:0/2538484071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93cc160310 con 0x7f93cc074c50 2024-09-21T00:15:02.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.578+0000 7f93c8c00640 1 -- 172.21.15.83:0/2538484071 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f93c400abf0 con 0x7f93cc074c50 2024-09-21T00:15:02.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.579+0000 7f93c8c00640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f93a8078b90 0x7f93a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:02.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.579+0000 7f93c8c00640 1 -- 172.21.15.83:0/2538484071 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f93c409ae00 con 0x7f93cc074c50 2024-09-21T00:15:02.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.579+0000 7f93cbe00640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f93a8078b90 0x7f93a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:02.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.580+0000 7f93cbe00640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f93a8078b90 0x7f93a807b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f93bc033000 tx=0x7f93bc004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:02.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.583+0000 7f93c8c00640 1 -- 172.21.15.83:0/2538484071 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f93c4062ec0 con 0x7f93cc074c50 2024-09-21T00:15:02.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.768+0000 7f93d3000640 1 -- 172.21.15.83:0/2538484071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93cc0cb750 con 0x7f93cc074c50 2024-09-21T00:15:02.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.769+0000 7f93c8c00640 1 -- 172.21.15.83:0/2538484071 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18721 (secure 0 0 0) 0x7f93c40627c0 con 0x7f93cc074c50 2024-09-21T00:15:02.771 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:02.771 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":29,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:48.133505+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:15:02.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.771+0000 7f93d3000640 1 -- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f93a8078b90 msgr2=0x7f93a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:02.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.771+0000 7f93d3000640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f93a8078b90 0x7f93a807b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f93bc033000 tx=0x7f93bc004730 comp rx=0 tx=0).stop 2024-09-21T00:15:02.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.771+0000 7f93d3000640 1 -- 172.21.15.83:0/2538484071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93cc074c50 msgr2=0x7f93cc1f8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:02.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.771+0000 7f93d3000640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93cc074c50 0x7f93cc1f8cb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f93c400c730 tx=0x7f93c400cbf0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.772+0000 7f93d3000640 1 -- 172.21.15.83:0/2538484071 shutdown_connections 2024-09-21T00:15:02.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.772+0000 7f93d3000640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f93a8078b90 0x7f93a807b0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.772+0000 7f93d3000640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93cc074c50 0x7f93cc1f8cb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.772+0000 7f93d3000640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93cc0c9d60 0x7f93cc1f8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.772+0000 7f93d3000640 1 --2- 172.21.15.83:0/2538484071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93cc15e7c0 0x7f93cc1599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:02.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.772+0000 7f93d3000640 1 -- 172.21.15.83:0/2538484071 >> 172.21.15.83:0/2538484071 conn(0x7f93cc0cca40 msgr2=0x7f93cc15cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:02.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.772+0000 7f93d3000640 1 -- 172.21.15.83:0/2538484071 shutdown_connections 2024-09-21T00:15:02.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:02.772+0000 7f93d3000640 1 -- 172.21.15.83:0/2538484071 wait complete. 2024-09-21T00:15:02.795 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T00:15:02.796 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:03.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.018+0000 7fe761400640 1 -- 172.21.15.83:0/2510761540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe75c074cb0 msgr2=0x7fe75c073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.018+0000 7fe761400640 1 --2- 172.21.15.83:0/2510761540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe75c074cb0 0x7fe75c073dd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe74c005fd0 tx=0x7fe74c02ab30 comp rx=0 tx=0).stop 2024-09-21T00:15:03.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.018+0000 7fe761400640 1 -- 172.21.15.83:0/2510761540 shutdown_connections 2024-09-21T00:15:03.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.018+0000 7fe761400640 1 --2- 172.21.15.83:0/2510761540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe75c074cb0 0x7fe75c073dd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.018+0000 7fe761400640 1 -- 172.21.15.83:0/2510761540 >> 172.21.15.83:0/2510761540 conn(0x7fe75c0cca40 msgr2=0x7fe75c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:03.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.018+0000 7fe761400640 1 -- 172.21.15.83:0/2510761540 shutdown_connections 2024-09-21T00:15:03.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.018+0000 7fe761400640 1 -- 172.21.15.83:0/2510761540 wait complete. 2024-09-21T00:15:03.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.020+0000 7fe761400640 1 Processor -- start 2024-09-21T00:15:03.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.021+0000 7fe761400640 1 -- start start 2024-09-21T00:15:03.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.022+0000 7fe761400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75c074cb0 0x7fe75c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.022+0000 7fe761400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe75c0cbc10 0x7fe75c1f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.022+0000 7fe761400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c06e110 0x7fe75c0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.022+0000 7fe761400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c06f670 con 0x7fe75c0cbc10 2024-09-21T00:15:03.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.022+0000 7fe761400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c06f4f0 con 0x7fe75c074cb0 2024-09-21T00:15:03.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.022+0000 7fe761400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c06f7f0 con 0x7fe75c06e110 2024-09-21T00:15:03.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.022+0000 7fe751e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe75c0cbc10 0x7fe75c1f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.022+0000 7fe751e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe75c0cbc10 0x7fe75c1f4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56992/0 (socket says 172.21.15.83:56992) 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.022+0000 7fe751e00640 1 -- 172.21.15.83:0/4110838414 learned_addr learned my addr 172.21.15.83:0/4110838414 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe75a800640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75c074cb0 0x7fe75c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe75b200640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c06e110 0x7fe75c0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe751e00640 1 -- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c06e110 msgr2=0x7fe75c0c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe751e00640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c06e110 0x7fe75c0c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe751e00640 1 -- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75c074cb0 msgr2=0x7fe75c0b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe751e00640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75c074cb0 0x7fe75c0b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe751e00640 1 -- 172.21.15.83:0/4110838414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c1f52d0 con 0x7fe75c0cbc10 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe75b200640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c06e110 0x7fe75c0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:03.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe751e00640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe75c0cbc10 0x7fe75c1f4d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe74400c3d0 tx=0x7fe74400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:03.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe753400640 1 -- 172.21.15.83:0/4110838414 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe744017070 con 0x7fe75c0cbc10 2024-09-21T00:15:03.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe753400640 1 -- 172.21.15.83:0/4110838414 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7440053c0 con 0x7fe75c0cbc10 2024-09-21T00:15:03.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe761400640 1 -- 172.21.15.83:0/4110838414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe75c0b5660 con 0x7fe75c0cbc10 2024-09-21T00:15:03.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.023+0000 7fe753400640 1 -- 172.21.15.83:0/4110838414 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe744003850 con 0x7fe75c0cbc10 2024-09-21T00:15:03.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.024+0000 7fe761400640 1 -- 172.21.15.83:0/4110838414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe75c0b5c20 con 0x7fe75c0cbc10 2024-09-21T00:15:03.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.025+0000 7fe761400640 1 -- 172.21.15.83:0/4110838414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe75c073dd0 con 0x7fe75c0cbc10 2024-09-21T00:15:03.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.026+0000 7fe753400640 1 -- 172.21.15.83:0/4110838414 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe74401a070 con 0x7fe75c0cbc10 2024-09-21T00:15:03.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.027+0000 7fe753400640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe738078bc0 0x7fe73807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.028+0000 7fe753400640 1 -- 172.21.15.83:0/4110838414 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe74409a380 con 0x7fe75c0cbc10 2024-09-21T00:15:03.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.028+0000 7fe75a800640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe738078bc0 0x7fe73807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.029+0000 7fe75a800640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe738078bc0 0x7fe73807b0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe74c035000 tx=0x7fe74c038040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:03.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.032+0000 7fe753400640 1 -- 172.21.15.83:0/4110838414 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe75c1f52d0 con 0x7fe75c0cbc10 2024-09-21T00:15:03.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.255+0000 7fe761400640 1 -- 172.21.15.83:0/4110838414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe75c0b53f0 con 0x7fe75c0cbc10 2024-09-21T00:15:03.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.255+0000 7fe753400640 1 -- 172.21.15.83:0/4110838414 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5222 (secure 0 0 0) 0x7fe744061df0 con 0x7fe75c0cbc10 2024-09-21T00:15:03.257 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:03.257 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"btime":"2024-09-21T00:14:27:026365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:14:09.437323+0000","modified":"2024-09-21T00:14:26.510440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-21T00:15:03.257 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-09-21T00:15:03.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 -- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe738078bc0 msgr2=0x7fe73807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe738078bc0 0x7fe73807b0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe74c035000 tx=0x7fe74c038040 comp rx=0 tx=0).stop 2024-09-21T00:15:03.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 -- 172.21.15.83:0/4110838414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe75c0cbc10 msgr2=0x7fe75c1f4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe75c0cbc10 0x7fe75c1f4d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe74400c3d0 tx=0x7fe74400c890 comp rx=0 tx=0).stop 2024-09-21T00:15:03.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 -- 172.21.15.83:0/4110838414 shutdown_connections 2024-09-21T00:15:03.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe738078bc0 0x7fe73807b0d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c06e110 0x7fe75c0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe75c0cbc10 0x7fe75c1f4d90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 --2- 172.21.15.83:0/4110838414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75c074cb0 0x7fe75c0b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 -- 172.21.15.83:0/4110838414 >> 172.21.15.83:0/4110838414 conn(0x7fe75c0cca40 msgr2=0x7fe75c15ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:03.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 -- 172.21.15.83:0/4110838414 shutdown_connections 2024-09-21T00:15:03.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.258+0000 7fe761400640 1 -- 172.21.15.83:0/4110838414 wait complete. 2024-09-21T00:15:03.283 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:03.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.501+0000 7fb056e00640 1 -- 172.21.15.83:0/3237617954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb050073dd0 msgr2=0x7fb05006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.501+0000 7fb056e00640 1 --2- 172.21.15.83:0/3237617954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb050073dd0 0x7fb05006ddf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb038005fd0 tx=0x7fb03802a5d0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.501+0000 7fb056e00640 1 -- 172.21.15.83:0/3237617954 shutdown_connections 2024-09-21T00:15:03.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.501+0000 7fb056e00640 1 --2- 172.21.15.83:0/3237617954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb050073dd0 0x7fb05006ddf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.501+0000 7fb056e00640 1 -- 172.21.15.83:0/3237617954 >> 172.21.15.83:0/3237617954 conn(0x7fb0500cca40 msgr2=0x7fb0500cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:03.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.501+0000 7fb056e00640 1 -- 172.21.15.83:0/3237617954 shutdown_connections 2024-09-21T00:15:03.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.501+0000 7fb056e00640 1 -- 172.21.15.83:0/3237617954 wait complete. 2024-09-21T00:15:03.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.503+0000 7fb056e00640 1 Processor -- start 2024-09-21T00:15:03.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.503+0000 7fb056e00640 1 -- start start 2024-09-21T00:15:03.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.505+0000 7fb056e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb05006e330 0x7fb0501f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.505+0000 7fb056e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb050073dd0 0x7fb0501f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.505+0000 7fb056e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb050074cb0 0x7fb0501f95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.505+0000 7fb056e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb05006f670 con 0x7fb050073dd0 2024-09-21T00:15:03.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.505+0000 7fb056e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb05006f4f0 con 0x7fb05006e330 2024-09-21T00:15:03.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.505+0000 7fb056e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb05006f7f0 con 0x7fb050074cb0 2024-09-21T00:15:03.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.505+0000 7fb047400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb050073dd0 0x7fb0501f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.505+0000 7fb047400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb050073dd0 0x7fb0501f9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57010/0 (socket says 172.21.15.83:57010) 2024-09-21T00:15:03.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.505+0000 7fb047400640 1 -- 172.21.15.83:0/4171517991 learned_addr learned my addr 172.21.15.83:0/4171517991 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:03.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.505+0000 7fb04fe00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb05006e330 0x7fb0501f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb054e00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb050074cb0 0x7fb0501f95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb047400640 1 -- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb050074cb0 msgr2=0x7fb0501f95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb047400640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb050074cb0 0x7fb0501f95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb047400640 1 -- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb05006e330 msgr2=0x7fb0501f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb047400640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb05006e330 0x7fb0501f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb047400640 1 -- 172.21.15.83:0/4171517991 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb050154aa0 con 0x7fb050073dd0 2024-09-21T00:15:03.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb047400640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb050073dd0 0x7fb0501f9090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb038006010 tx=0x7fb0380038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:03.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb04cc00640 1 -- 172.21.15.83:0/4171517991 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03803e030 con 0x7fb050073dd0 2024-09-21T00:15:03.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb04cc00640 1 -- 172.21.15.83:0/4171517991 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb038003ca0 con 0x7fb050073dd0 2024-09-21T00:15:03.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb056e00640 1 -- 172.21.15.83:0/4171517991 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb050156ae0 con 0x7fb050073dd0 2024-09-21T00:15:03.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.506+0000 7fb04cc00640 1 -- 172.21.15.83:0/4171517991 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038035040 con 0x7fb050073dd0 2024-09-21T00:15:03.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.507+0000 7fb056e00640 1 -- 172.21.15.83:0/4171517991 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0500cf060 con 0x7fb050073dd0 2024-09-21T00:15:03.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.507+0000 7fb056e00640 1 -- 172.21.15.83:0/4171517991 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb05015c1b0 con 0x7fb050073dd0 2024-09-21T00:15:03.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.509+0000 7fb04cc00640 1 -- 172.21.15.83:0/4171517991 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb038041030 con 0x7fb050073dd0 2024-09-21T00:15:03.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.509+0000 7fb04cc00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb02c078bc0 0x7fb02c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.510+0000 7fb04cc00640 1 -- 172.21.15.83:0/4171517991 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fb0380bb760 con 0x7fb050073dd0 2024-09-21T00:15:03.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.510+0000 7fb04fe00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb02c078bc0 0x7fb02c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.511+0000 7fb04fe00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb02c078bc0 0x7fb02c07b0d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb040006fd0 tx=0x7fb040008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:03.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.514+0000 7fb04cc00640 1 -- 172.21.15.83:0/4171517991 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb05006e740 con 0x7fb050073dd0 2024-09-21T00:15:03.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.734+0000 7fb056e00640 1 -- 172.21.15.83:0/4171517991 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb05015bed0 con 0x7fb050073dd0 2024-09-21T00:15:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.735+0000 7fb04cc00640 1 -- 172.21.15.83:0/4171517991 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5222 (secure 0 0 0) 0x7fb038088e20 con 0x7fb050073dd0 2024-09-21T00:15:03.736 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:03.736 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"btime":"2024-09-21T00:14:27:026365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1858712341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":1858712341},{"type":"v1","addr":"172.21.15.83:6835","nonce":1858712341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4328,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1279904064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1279904064},{"type":"v1","addr":"172.21.15.142:6836","nonce":1279904064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4331,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4270384350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4270384350},{"type":"v1","addr":"172.21.15.142:6837","nonce":4270384350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:14:09.437323+0000","modified":"2024-09-21T00:14:26.510440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6834/176272161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":176272161},{"type":"v1","addr":"172.21.15.83:6834","nonce":176272161}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-21T00:15:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-09-21T00:15:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 -- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb02c078bc0 msgr2=0x7fb02c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb02c078bc0 0x7fb02c07b0d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb040006fd0 tx=0x7fb040008040 comp rx=0 tx=0).stop 2024-09-21T00:15:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 -- 172.21.15.83:0/4171517991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb050073dd0 msgr2=0x7fb0501f9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb050073dd0 0x7fb0501f9090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb038006010 tx=0x7fb0380038a0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 -- 172.21.15.83:0/4171517991 shutdown_connections 2024-09-21T00:15:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb02c078bc0 0x7fb02c07b0d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb050074cb0 0x7fb0501f95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb050073dd0 0x7fb0501f9090 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 --2- 172.21.15.83:0/4171517991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb05006e330 0x7fb0501f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 -- 172.21.15.83:0/4171517991 >> 172.21.15.83:0/4171517991 conn(0x7fb0500cca40 msgr2=0x7fb050158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 -- 172.21.15.83:0/4171517991 shutdown_connections 2024-09-21T00:15:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.737+0000 7fb056e00640 1 -- 172.21.15.83:0/4171517991 wait complete. 2024-09-21T00:15:03.765 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:15:03.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.984+0000 7fb27fc00640 1 -- 172.21.15.83:0/522623866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27806e500 msgr2=0x7fb27806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.984+0000 7fb27fc00640 1 --2- 172.21.15.83:0/522623866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27806e500 0x7fb27806ede0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb270005fd0 tx=0x7fb27002a940 comp rx=0 tx=0).stop 2024-09-21T00:15:03.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.984+0000 7fb27fc00640 1 -- 172.21.15.83:0/522623866 shutdown_connections 2024-09-21T00:15:03.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.984+0000 7fb27fc00640 1 --2- 172.21.15.83:0/522623866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27806e500 0x7fb27806ede0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.984+0000 7fb27fc00640 1 -- 172.21.15.83:0/522623866 >> 172.21.15.83:0/522623866 conn(0x7fb2780cca40 msgr2=0x7fb2780cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:03.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.984+0000 7fb27fc00640 1 -- 172.21.15.83:0/522623866 shutdown_connections 2024-09-21T00:15:03.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.984+0000 7fb27fc00640 1 -- 172.21.15.83:0/522623866 wait complete. 2024-09-21T00:15:03.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.986+0000 7fb27fc00640 1 Processor -- start 2024-09-21T00:15:03.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.986+0000 7fb27fc00640 1 -- start start 2024-09-21T00:15:03.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27fc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278073dd0 0x7fb2781579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27fc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb278074cb0 0x7fb2781f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27fc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27815b930 0x7fb27815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27fc00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb27806f6b0 con 0x7fb27815b930 2024-09-21T00:15:03.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27fc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb27806f530 con 0x7fb278073dd0 2024-09-21T00:15:03.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27fc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb27806f830 con 0x7fb278074cb0 2024-09-21T00:15:03.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27dc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27815b930 0x7fb27815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27dc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27815b930 0x7fb27815bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57026/0 (socket says 172.21.15.83:57026) 2024-09-21T00:15:03.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27dc00640 1 -- 172.21.15.83:0/2457866395 learned_addr learned my addr 172.21.15.83:0/2457866395 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:03.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27d200640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278073dd0 0x7fb2781579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb277e00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb278074cb0 0x7fb2781f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.988+0000 7fb27dc00640 1 -- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb278074cb0 msgr2=0x7fb2781f84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb27dc00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb278074cb0 0x7fb2781f84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb27dc00640 1 -- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278073dd0 msgr2=0x7fb2781579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:03.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb27dc00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278073dd0 0x7fb2781579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:03.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb27dc00640 1 -- 172.21.15.83:0/2457866395 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27815c280 con 0x7fb27815b930 2024-09-21T00:15:03.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb277e00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb278074cb0 0x7fb2781f84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:03.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb27dc00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27815b930 0x7fb27815bd40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb270009cd0 tx=0x7fb270031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:03.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb274c00640 1 -- 172.21.15.83:0/2457866395 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27003e070 con 0x7fb27815b930 2024-09-21T00:15:03.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb274c00640 1 -- 172.21.15.83:0/2457866395 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb270004540 con 0x7fb27815b930 2024-09-21T00:15:03.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb274c00640 1 -- 172.21.15.83:0/2457866395 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270043460 con 0x7fb27815b930 2024-09-21T00:15:03.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb27fc00640 1 -- 172.21.15.83:0/2457866395 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb278157490 con 0x7fb27815b930 2024-09-21T00:15:03.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.989+0000 7fb27fc00640 1 -- 172.21.15.83:0/2457866395 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb278159760 con 0x7fb27815b930 2024-09-21T00:15:03.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.990+0000 7fb27fc00640 1 -- 172.21.15.83:0/2457866395 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb27806ede0 con 0x7fb27815b930 2024-09-21T00:15:03.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.991+0000 7fb274c00640 1 -- 172.21.15.83:0/2457866395 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb270043600 con 0x7fb27815b930 2024-09-21T00:15:03.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.993+0000 7fb274c00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb258078b90 0x7fb25807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:03.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.993+0000 7fb274c00640 1 -- 172.21.15.83:0/2457866395 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fb2700bcb30 con 0x7fb27815b930 2024-09-21T00:15:03.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.993+0000 7fb27d200640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb258078b90 0x7fb25807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:03.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.994+0000 7fb27d200640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb258078b90 0x7fb25807b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0046b0 tx=0x7fb26c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:03.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:03.997+0000 7fb274c00640 1 -- 172.21.15.83:0/2457866395 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb27004a030 con 0x7fb27815b930 2024-09-21T00:15:04.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.182+0000 7fb27fc00640 1 -- 172.21.15.83:0/2457866395 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb27806e700 con 0x7fb27815b930 2024-09-21T00:15:04.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.183+0000 7fb274c00640 1 -- 172.21.15.83:0/2457866395 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18721 (secure 0 0 0) 0x7fb27815c280 con 0x7fb27815b930 2024-09-21T00:15:04.184 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:04.184 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":29,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:14:48.133505+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:14:07.577195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:14:08.392531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T00:14:11.967856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:15:04.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 -- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb258078b90 msgr2=0x7fb25807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:04.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb258078b90 0x7fb25807b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0046b0 tx=0x7fb26c009040 comp rx=0 tx=0).stop 2024-09-21T00:15:04.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 -- 172.21.15.83:0/2457866395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27815b930 msgr2=0x7fb27815bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:04.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27815b930 0x7fb27815bd40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb270009cd0 tx=0x7fb270031e20 comp rx=0 tx=0).stop 2024-09-21T00:15:04.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 -- 172.21.15.83:0/2457866395 shutdown_connections 2024-09-21T00:15:04.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb258078b90 0x7fb25807b0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb27815b930 0x7fb27815bd40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb278074cb0 0x7fb2781f84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 --2- 172.21.15.83:0/2457866395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278073dd0 0x7fb2781579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 -- 172.21.15.83:0/2457866395 >> 172.21.15.83:0/2457866395 conn(0x7fb2780cca40 msgr2=0x7fb27806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:04.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.185+0000 7fb27fc00640 1 -- 172.21.15.83:0/2457866395 shutdown_connections 2024-09-21T00:15:04.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.186+0000 7fb27fc00640 1 -- 172.21.15.83:0/2457866395 wait complete. 2024-09-21T00:15:04.209 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T00:15:04.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.431+0000 7f0526e00640 1 -- 172.21.15.83:0/662809379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05200cf9a0 msgr2=0x7f0520072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:04.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.431+0000 7f0526e00640 1 --2- 172.21.15.83:0/662809379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05200cf9a0 0x7f0520072d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0518005fd0 tx=0x7f051802a8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.431+0000 7f0526e00640 1 -- 172.21.15.83:0/662809379 shutdown_connections 2024-09-21T00:15:04.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.431+0000 7f0526e00640 1 --2- 172.21.15.83:0/662809379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05200cf9a0 0x7f0520072d90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.431+0000 7f0526e00640 1 --2- 172.21.15.83:0/662809379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f052015fc50 0x7f052006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.431+0000 7f0526e00640 1 -- 172.21.15.83:0/662809379 >> 172.21.15.83:0/662809379 conn(0x7f05200b1b90 msgr2=0x7f05200b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:04.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.431+0000 7f0526e00640 1 -- 172.21.15.83:0/662809379 shutdown_connections 2024-09-21T00:15:04.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.431+0000 7f0526e00640 1 -- 172.21.15.83:0/662809379 wait complete. 2024-09-21T00:15:04.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.433+0000 7f0526e00640 1 Processor -- start 2024-09-21T00:15:04.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.433+0000 7f0526e00640 1 -- start start 2024-09-21T00:15:04.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f0526e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052006e330 0x7f05200a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:04.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f0526e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05200cf9a0 0x7f05200c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:04.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f0526e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f052015fc50 0x7f052015e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:04.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f0526e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f05200732d0 con 0x7f05200cf9a0 2024-09-21T00:15:04.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f0526e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f05200ca9a0 con 0x7f052006e330 2024-09-21T00:15:04.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f0526e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0520073450 con 0x7f052015fc50 2024-09-21T00:15:04.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f0517e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05200cf9a0 0x7f05200c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:04.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f0517e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05200cf9a0 0x7f05200c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57034/0 (socket says 172.21.15.83:57034) 2024-09-21T00:15:04.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f0517e00640 1 -- 172.21.15.83:0/1326242033 learned_addr learned my addr 172.21.15.83:0/1326242033 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:04.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f051fe00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052006e330 0x7f05200a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:04.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.435+0000 7f0524e00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f052015fc50 0x7f052015e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:04.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f051fe00640 1 -- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f052015fc50 msgr2=0x7f052015e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:04.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f051fe00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f052015fc50 0x7f052015e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f051fe00640 1 -- 172.21.15.83:0/1326242033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05200cf9a0 msgr2=0x7f05200c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:04.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f051fe00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05200cf9a0 0x7f05200c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f051fe00640 1 -- 172.21.15.83:0/1326242033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052009f950 con 0x7f052006e330 2024-09-21T00:15:04.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f0517e00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05200cf9a0 0x7f05200c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:15:04.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f051fe00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052006e330 0x7f05200a09b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0510005fd0 tx=0x7f051000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:04.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f051cc00640 1 -- 172.21.15.83:0/1326242033 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051000cc40 con 0x7f052006e330 2024-09-21T00:15:04.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f051cc00640 1 -- 172.21.15.83:0/1326242033 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f051000cde0 con 0x7f052006e330 2024-09-21T00:15:04.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f0526e00640 1 -- 172.21.15.83:0/1326242033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052009fbf0 con 0x7f052006e330 2024-09-21T00:15:04.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.436+0000 7f051cc00640 1 -- 172.21.15.83:0/1326242033 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510004220 con 0x7f052006e330 2024-09-21T00:15:04.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.437+0000 7f0526e00640 1 -- 172.21.15.83:0/1326242033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05200a01b0 con 0x7f052006e330 2024-09-21T00:15:04.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.437+0000 7f0526e00640 1 -- 172.21.15.83:0/1326242033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0520073990 con 0x7f052006e330 2024-09-21T00:15:04.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.439+0000 7f051cc00640 1 -- 172.21.15.83:0/1326242033 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f05100035f0 con 0x7f052006e330 2024-09-21T00:15:04.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.440+0000 7f051cc00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f04fc078bc0 0x7f04fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:04.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.440+0000 7f051cc00640 1 -- 172.21.15.83:0/1326242033 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f051009b9b0 con 0x7f052006e330 2024-09-21T00:15:04.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.440+0000 7f0517e00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f04fc078bc0 0x7f04fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:04.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.441+0000 7f0517e00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f04fc078bc0 0x7f04fc07b0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f05200af6a0 tx=0x7f0508009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:04.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.444+0000 7f051cc00640 1 -- 172.21.15.83:0/1326242033 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0510063530 con 0x7f052006e330 2024-09-21T00:15:04.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.663+0000 7f0526e00640 1 -- 172.21.15.83:0/1326242033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0520069450 con 0x7f052006e330 2024-09-21T00:15:04.667 INFO:tasks.ceph.mon.a.smithi083.stderr:2024-09-21T00:15:04.666+0000 7f6fcde00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:15:04.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.673+0000 7f051cc00640 1 -- 172.21.15.83:0/1326242033 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f0510067f60 con 0x7f052006e330 2024-09-21T00:15:04.675 INFO:teuthology.orchestra.run.smithi083.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T00:15:04.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 -- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f04fc078bc0 msgr2=0x7f04fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:04.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f04fc078bc0 0x7f04fc07b0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f05200af6a0 tx=0x7f0508009040 comp rx=0 tx=0).stop 2024-09-21T00:15:04.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 -- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052006e330 msgr2=0x7f05200a09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:04.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052006e330 0x7f05200a09b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0510005fd0 tx=0x7f051000ee50 comp rx=0 tx=0).stop 2024-09-21T00:15:04.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 -- 172.21.15.83:0/1326242033 shutdown_connections 2024-09-21T00:15:04.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f04fc078bc0 0x7f04fc07b0d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f052015fc50 0x7f052015e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05200cf9a0 0x7f05200c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 --2- 172.21.15.83:0/1326242033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052006e330 0x7f05200a09b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 -- 172.21.15.83:0/1326242033 >> 172.21.15.83:0/1326242033 conn(0x7f05200b1b90 msgr2=0x7f05200b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:04.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 -- 172.21.15.83:0/1326242033 shutdown_connections 2024-09-21T00:15:04.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.676+0000 7f0526e00640 1 -- 172.21.15.83:0/1326242033 wait complete. 2024-09-21T00:15:04.681 INFO:tasks.ceph.mds.a.smithi083.stderr: -5200> 2024-09-21T00:14:13.909+0000 7f1d82800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T00:15:04.703 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T00:15:04.801 INFO:tasks.ceph.mds.a.smithi083.stdout:starting mds.a at 2024-09-21T00:15:04.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.930+0000 7fcac3000640 1 -- 172.21.15.83:0/3702132251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcabc15a270 msgr2=0x7fcabc0ae970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:04.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.930+0000 7fcac3000640 1 --2- 172.21.15.83:0/3702132251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcabc15a270 0x7fcabc0ae970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0c4d20 tx=0x7fcaac02a560 comp rx=0 tx=0).stop 2024-09-21T00:15:04.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.931+0000 7fcac3000640 1 -- 172.21.15.83:0/3702132251 shutdown_connections 2024-09-21T00:15:04.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.931+0000 7fcac3000640 1 --2- 172.21.15.83:0/3702132251 >> v2:172.21.15.142:3300/0 conn(0x7fcabc0b2ca0 0x7fcabc0b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.931+0000 7fcac3000640 1 --2- 172.21.15.83:0/3702132251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcabc15a270 0x7fcabc0ae970 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.931+0000 7fcac3000640 1 -- 172.21.15.83:0/3702132251 >> 172.21.15.83:0/3702132251 conn(0x7fcabc0cdca0 msgr2=0x7fcabc0ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:04.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.931+0000 7fcac3000640 1 -- 172.21.15.83:0/3702132251 shutdown_connections 2024-09-21T00:15:04.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.931+0000 7fcac3000640 1 -- 172.21.15.83:0/3702132251 wait complete. 2024-09-21T00:15:04.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.933+0000 7fcac3000640 1 Processor -- start 2024-09-21T00:15:04.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.933+0000 7fcac3000640 1 -- start start 2024-09-21T00:15:04.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.934+0000 7fcac3000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcabc06f450 0x7fcabc152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:04.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.934+0000 7fcac3000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcabc0b2ca0 0x7fcabc0c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:04.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.934+0000 7fcac3000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcabc15a270 0x7fcabc0c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:04.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.934+0000 7fcac3000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcabc160530 con 0x7fcabc06f450 2024-09-21T00:15:04.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.934+0000 7fcac3000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcabc1603b0 con 0x7fcabc15a270 2024-09-21T00:15:04.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.934+0000 7fcac3000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcabc1606b0 con 0x7fcabc0b2ca0 2024-09-21T00:15:04.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcabbe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcabc06f450 0x7fcabc152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:04.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcabbe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcabc06f450 0x7fcabc152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57050/0 (socket says 172.21.15.83:57050) 2024-09-21T00:15:04.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcabbe00640 1 -- 172.21.15.83:0/973068788 learned_addr learned my addr 172.21.15.83:0/973068788 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:04.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcabbe00640 1 -- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcabc0b2ca0 msgr2=0x7fcabc0c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:04.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcabbe00640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcabc0b2ca0 0x7fcabc0c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcabbe00640 1 -- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcabc15a270 msgr2=0x7fcabc0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcac1000640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcabc15a270 0x7fcabc0c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcabbe00640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcabc15a270 0x7fcabc0c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcabbe00640 1 -- 172.21.15.83:0/973068788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcabc1f8bd0 con 0x7fcabc06f450 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcac1000640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcabc15a270 0x7fcabc0c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.935+0000 7fcabbe00640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcabc06f450 0x7fcabc152480 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcaac034040 tx=0x7fcaac003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.936+0000 7fcab8c00640 1 -- 172.21.15.83:0/973068788 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac03e030 con 0x7fcabc06f450 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.936+0000 7fcab8c00640 1 -- 172.21.15.83:0/973068788 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcaac003e00 con 0x7fcabc06f450 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.936+0000 7fcac3000640 1 -- 172.21.15.83:0/973068788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcabc1f8eb0 con 0x7fcabc06f450 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.936+0000 7fcab8c00640 1 -- 172.21.15.83:0/973068788 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac035040 con 0x7fcabc06f450 2024-09-21T00:15:04.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.936+0000 7fcac3000640 1 -- 172.21.15.83:0/973068788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcabc1f9990 con 0x7fcabc06f450 2024-09-21T00:15:04.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.937+0000 7fcac3000640 1 -- 172.21.15.83:0/973068788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcabc050f60 con 0x7fcabc06f450 2024-09-21T00:15:04.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.938+0000 7fcab8c00640 1 -- 172.21.15.83:0/973068788 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcaac041030 con 0x7fcabc06f450 2024-09-21T00:15:04.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.939+0000 7fcab8c00640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fca98078b90 0x7fca9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:04.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.939+0000 7fcab8c00640 1 -- 172.21.15.83:0/973068788 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6676+0+0 (secure 0 0 0) 0x7fcaac0bb950 con 0x7fcabc06f450 2024-09-21T00:15:04.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.939+0000 7fcab3400640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fca98078b90 0x7fca9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:04.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.940+0000 7fcab3400640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fca98078b90 0x7fca9807b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4006fd0 tx=0x7fcaa4006bc0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:04.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:04.943+0000 7fcab8c00640 1 -- 172.21.15.83:0/973068788 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcabc050f60 con 0x7fcabc06f450 2024-09-21T00:15:05.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.172+0000 7fcac3000640 1 -- 172.21.15.83:0/973068788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcabc160bc0 con 0x7fcabc06f450 2024-09-21T00:15:05.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.674+0000 7fcab8c00640 1 -- 172.21.15.83:0/973068788 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fcabc0b35f0 con 0x7fcabc06f450 2024-09-21T00:15:05.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 -- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fca98078b90 msgr2=0x7fca9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:05.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fca98078b90 0x7fca9807b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4006fd0 tx=0x7fcaa4006bc0 comp rx=0 tx=0).stop 2024-09-21T00:15:05.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 -- 172.21.15.83:0/973068788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcabc06f450 msgr2=0x7fcabc152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:05.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcabc06f450 0x7fcabc152480 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcaac034040 tx=0x7fcaac003910 comp rx=0 tx=0).stop 2024-09-21T00:15:05.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 -- 172.21.15.83:0/973068788 shutdown_connections 2024-09-21T00:15:05.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fca98078b90 0x7fca9807b0a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:05.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcabc15a270 0x7fcabc0c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:05.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcabc0b2ca0 0x7fcabc0c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:05.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 --2- 172.21.15.83:0/973068788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcabc06f450 0x7fcabc152480 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:05.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 -- 172.21.15.83:0/973068788 >> 172.21.15.83:0/973068788 conn(0x7fcabc0cdca0 msgr2=0x7fcabc06ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:05.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 -- 172.21.15.83:0/973068788 shutdown_connections 2024-09-21T00:15:05.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.677+0000 7fcac3000640 1 -- 172.21.15.83:0/973068788 wait complete. 2024-09-21T00:15:05.701 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T00:15:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.925+0000 7fdc84c00640 1 -- 172.21.15.83:0/225794822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc80145cc0 msgr2=0x7fdc800cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.925+0000 7fdc84c00640 1 --2- 172.21.15.83:0/225794822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc80145cc0 0x7fdc800cf200 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdc78005fd0 tx=0x7fdc7802a8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.926+0000 7fdc84c00640 1 -- 172.21.15.83:0/225794822 shutdown_connections 2024-09-21T00:15:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.926+0000 7fdc84c00640 1 --2- 172.21.15.83:0/225794822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc80145cc0 0x7fdc800cf200 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:05.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.926+0000 7fdc84c00640 1 -- 172.21.15.83:0/225794822 >> 172.21.15.83:0/225794822 conn(0x7fdc800d0460 msgr2=0x7fdc8006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:05.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.926+0000 7fdc84c00640 1 -- 172.21.15.83:0/225794822 shutdown_connections 2024-09-21T00:15:05.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.926+0000 7fdc84c00640 1 -- 172.21.15.83:0/225794822 wait complete. 2024-09-21T00:15:05.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.928+0000 7fdc84c00640 1 Processor -- start 2024-09-21T00:15:05.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.928+0000 7fdc84c00640 1 -- start start 2024-09-21T00:15:05.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.929+0000 7fdc84c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc800b2e60 0x7fdc8013ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc84c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc80145cc0 0x7fdc800b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc84c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc8013f680 0x7fdc800b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc84c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdc80070080 con 0x7fdc80145cc0 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc84c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8006ff00 con 0x7fdc800b2e60 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc84c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdc80070200 con 0x7fdc8013f680 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7ea00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc80145cc0 0x7fdc800b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7ea00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc80145cc0 0x7fdc800b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57066/0 (socket says 172.21.15.83:57066) 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7ea00640 1 -- 172.21.15.83:0/2882586782 learned_addr learned my addr 172.21.15.83:0/2882586782 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7f400640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc800b2e60 0x7fdc8013ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7fe00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc8013f680 0x7fdc800b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7ea00640 1 -- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc8013f680 msgr2=0x7fdc800b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7ea00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc8013f680 0x7fdc800b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7ea00640 1 -- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc800b2e60 msgr2=0x7fdc8013ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7ea00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc800b2e60 0x7fdc8013ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:05.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7ea00640 1 -- 172.21.15.83:0/2882586782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8015eb20 con 0x7fdc80145cc0 2024-09-21T00:15:05.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.930+0000 7fdc7fe00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc8013f680 0x7fdc800b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:05.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.931+0000 7fdc7ea00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc80145cc0 0x7fdc800b0c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00b420 tx=0x7fdc6c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:05.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.931+0000 7fdc77400640 1 -- 172.21.15.83:0/2882586782 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c011830 con 0x7fdc80145cc0 2024-09-21T00:15:05.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.931+0000 7fdc77400640 1 -- 172.21.15.83:0/2882586782 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc6c016070 con 0x7fdc80145cc0 2024-09-21T00:15:05.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.931+0000 7fdc84c00640 1 -- 172.21.15.83:0/2882586782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8015ee00 con 0x7fdc80145cc0 2024-09-21T00:15:05.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.931+0000 7fdc77400640 1 -- 172.21.15.83:0/2882586782 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c011d60 con 0x7fdc80145cc0 2024-09-21T00:15:05.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.931+0000 7fdc84c00640 1 -- 172.21.15.83:0/2882586782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc80140620 con 0x7fdc80145cc0 2024-09-21T00:15:05.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.932+0000 7fdc84c00640 1 -- 172.21.15.83:0/2882586782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc8015e890 con 0x7fdc80145cc0 2024-09-21T00:15:05.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.933+0000 7fdc77400640 1 -- 172.21.15.83:0/2882586782 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc6c01b460 con 0x7fdc80145cc0 2024-09-21T00:15:05.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.934+0000 7fdc77400640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdc60078bc0 0x7fdc6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:05.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.934+0000 7fdc77400640 1 -- 172.21.15.83:0/2882586782 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6676+0+0 (secure 0 0 0) 0x7fdc6c09ab70 con 0x7fdc80145cc0 2024-09-21T00:15:05.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.935+0000 7fdc7f400640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdc60078bc0 0x7fdc6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:05.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.936+0000 7fdc7f400640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdc60078bc0 0x7fdc6007b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc70000f60 tx=0x7fdc70009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:05.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:05.939+0000 7fdc77400640 1 -- 172.21.15.83:0/2882586782 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdc6c020020 con 0x7fdc80145cc0 2024-09-21T00:15:06.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.129+0000 7fdc84c00640 1 -- 172.21.15.83:0/2882586782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdc8015ff60 con 0x7fdc80145cc0 2024-09-21T00:15:06.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.676+0000 7fdc77400640 1 -- 172.21.15.83:0/2882586782 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7fdc6c062bd0 con 0x7fdc80145cc0 2024-09-21T00:15:06.678 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' removed 2024-09-21T00:15:06.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.680+0000 7fdc84c00640 1 -- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdc60078bc0 msgr2=0x7fdc6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:06.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.680+0000 7fdc84c00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdc60078bc0 0x7fdc6007b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc70000f60 tx=0x7fdc70009040 comp rx=0 tx=0).stop 2024-09-21T00:15:06.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.680+0000 7fdc84c00640 1 -- 172.21.15.83:0/2882586782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc80145cc0 msgr2=0x7fdc800b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:06.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.680+0000 7fdc84c00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc80145cc0 0x7fdc800b0c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00b420 tx=0x7fdc6c00b8e0 comp rx=0 tx=0).stop 2024-09-21T00:15:06.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.682+0000 7fdc84c00640 1 -- 172.21.15.83:0/2882586782 shutdown_connections 2024-09-21T00:15:06.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.682+0000 7fdc84c00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdc60078bc0 0x7fdc6007b0d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:06.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.682+0000 7fdc84c00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc8013f680 0x7fdc800b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:06.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.682+0000 7fdc84c00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc80145cc0 0x7fdc800b0c50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:06.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.682+0000 7fdc84c00640 1 --2- 172.21.15.83:0/2882586782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc800b2e60 0x7fdc8013ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:06.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.682+0000 7fdc84c00640 1 -- 172.21.15.83:0/2882586782 >> 172.21.15.83:0/2882586782 conn(0x7fdc800d0460 msgr2=0x7fdc8006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:06.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.683+0000 7fdc84c00640 1 -- 172.21.15.83:0/2882586782 shutdown_connections 2024-09-21T00:15:06.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.683+0000 7fdc84c00640 1 -- 172.21.15.83:0/2882586782 wait complete. 2024-09-21T00:15:06.713 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T00:15:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.939+0000 7f017aa00640 1 -- 172.21.15.83:0/1881502100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01740b2e60 msgr2=0x7f017415ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.939+0000 7f017aa00640 1 --2- 172.21.15.83:0/1881502100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01740b2e60 0x7f017415ff60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f01740cfa70 tx=0x7f016802a560 comp rx=0 tx=0).stop 2024-09-21T00:15:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.939+0000 7f017aa00640 1 -- 172.21.15.83:0/1881502100 shutdown_connections 2024-09-21T00:15:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.939+0000 7f017aa00640 1 --2- 172.21.15.83:0/1881502100 >> v2:172.21.15.142:3300/0 conn(0x7f01740ceaf0 0x7f01740cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.939+0000 7f017aa00640 1 --2- 172.21.15.83:0/1881502100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0174145cc0 0x7f01741604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.939+0000 7f017aa00640 1 --2- 172.21.15.83:0/1881502100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01740b2e60 0x7f017415ff60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.939+0000 7f017aa00640 1 -- 172.21.15.83:0/1881502100 >> 172.21.15.83:0/1881502100 conn(0x7f01740d0460 msgr2=0x7f017406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.939+0000 7f017aa00640 1 -- 172.21.15.83:0/1881502100 shutdown_connections 2024-09-21T00:15:06.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.940+0000 7f017aa00640 1 -- 172.21.15.83:0/1881502100 wait complete. 2024-09-21T00:15:06.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.942+0000 7f017aa00640 1 Processor -- start 2024-09-21T00:15:06.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.942+0000 7f017aa00640 1 -- start start 2024-09-21T00:15:06.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.943+0000 7f017aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01740b2e60 0x7f01741423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:06.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.943+0000 7f017aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01740ceaf0 0x7f01740aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:06.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.943+0000 7f017aa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0174145cc0 0x7f01741f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:06.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.943+0000 7f017aa00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f017406fdf0 con 0x7f0174145cc0 2024-09-21T00:15:06.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.943+0000 7f017aa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f017406fc70 con 0x7f01740b2e60 2024-09-21T00:15:06.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.943+0000 7f017aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f017406ff70 con 0x7f01740ceaf0 2024-09-21T00:15:06.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f017a000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0174145cc0 0x7f01741f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:06.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f017a000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0174145cc0 0x7f01741f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57072/0 (socket says 172.21.15.83:57072) 2024-09-21T00:15:06.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f017a000640 1 -- 172.21.15.83:0/363940682 learned_addr learned my addr 172.21.15.83:0/363940682 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:06.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f0179600640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01740b2e60 0x7f01741423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:06.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f0178c00640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01740ceaf0 0x7f01740aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:06.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f017a000640 1 -- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01740ceaf0 msgr2=0x7f01740aa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:06.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f017a000640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01740ceaf0 0x7f01740aa170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:06.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f017a000640 1 -- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01740b2e60 msgr2=0x7f01741423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f017a000640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01740b2e60 0x7f01741423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f017a000640 1 -- 172.21.15.83:0/363940682 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01740abfc0 con 0x7f0174145cc0 2024-09-21T00:15:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.944+0000 7f017a000640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0174145cc0 0x7f01741f6ac0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f016c00b9e0 tx=0x7f016c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.945+0000 7f0171600640 1 -- 172.21.15.83:0/363940682 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c019070 con 0x7f0174145cc0 2024-09-21T00:15:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.945+0000 7f0171600640 1 -- 172.21.15.83:0/363940682 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f016c00cc10 con 0x7f0174145cc0 2024-09-21T00:15:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.945+0000 7f0171600640 1 -- 172.21.15.83:0/363940682 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0146a0 con 0x7f0174145cc0 2024-09-21T00:15:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.945+0000 7f017aa00640 1 -- 172.21.15.83:0/363940682 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01740a9690 con 0x7f0174145cc0 2024-09-21T00:15:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.945+0000 7f017aa00640 1 -- 172.21.15.83:0/363940682 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01740a9c50 con 0x7f0174145cc0 2024-09-21T00:15:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.946+0000 7f017aa00640 1 -- 172.21.15.83:0/363940682 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0174070510 con 0x7f0174145cc0 2024-09-21T00:15:06.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.947+0000 7f0171600640 1 -- 172.21.15.83:0/363940682 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f016c01c070 con 0x7f0174145cc0 2024-09-21T00:15:06.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.948+0000 7f0171600640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0154078b90 0x7f015407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:06.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.948+0000 7f0171600640 1 -- 172.21.15.83:0/363940682 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6238+0+0 (secure 0 0 0) 0x7f016c09ac70 con 0x7f0174145cc0 2024-09-21T00:15:06.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.949+0000 7f0179600640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0154078b90 0x7f015407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:06.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.949+0000 7f0179600640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0154078b90 0x7f015407b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0168033000 tx=0x7f0168004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:06.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:06.952+0000 7f0171600640 1 -- 172.21.15.83:0/363940682 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f016c0627b0 con 0x7f0174145cc0 2024-09-21T00:15:07.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.142+0000 7f017aa00640 1 -- 172.21.15.83:0/363940682 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f01740af3c0 con 0x7f0174145cc0 2024-09-21T00:15:07.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.685+0000 7f0171600640 1 -- 172.21.15.83:0/363940682 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f016c0671e0 con 0x7f0174145cc0 2024-09-21T00:15:07.687 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' removed 2024-09-21T00:15:07.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.688+0000 7f017aa00640 1 -- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0154078b90 msgr2=0x7f015407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:07.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.688+0000 7f017aa00640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0154078b90 0x7f015407b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0168033000 tx=0x7f0168004730 comp rx=0 tx=0).stop 2024-09-21T00:15:07.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.688+0000 7f017aa00640 1 -- 172.21.15.83:0/363940682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0174145cc0 msgr2=0x7f01741f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:07.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.688+0000 7f017aa00640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0174145cc0 0x7f01741f6ac0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f016c00b9e0 tx=0x7f016c00bea0 comp rx=0 tx=0).stop 2024-09-21T00:15:07.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.690+0000 7f017aa00640 1 -- 172.21.15.83:0/363940682 shutdown_connections 2024-09-21T00:15:07.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.690+0000 7f017aa00640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0154078b90 0x7f015407b0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:07.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.690+0000 7f017aa00640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0174145cc0 0x7f01741f6ac0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:07.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.690+0000 7f017aa00640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01740ceaf0 0x7f01740aa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:07.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.690+0000 7f017aa00640 1 --2- 172.21.15.83:0/363940682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01740b2e60 0x7f01741423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:07.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.690+0000 7f017aa00640 1 -- 172.21.15.83:0/363940682 >> 172.21.15.83:0/363940682 conn(0x7f01740d0460 msgr2=0x7f017413eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:07.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.690+0000 7f017aa00640 1 -- 172.21.15.83:0/363940682 shutdown_connections 2024-09-21T00:15:07.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.690+0000 7f017aa00640 1 -- 172.21.15.83:0/363940682 wait complete. 2024-09-21T00:15:07.716 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T00:15:07.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.943+0000 7f88cc600640 1 -- 172.21.15.83:0/2173739275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88ac005250 msgr2=0x7f88ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:07.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.943+0000 7f88cc600640 1 --2- 172.21.15.83:0/2173739275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88ac005250 0x7f88ac00b9c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f88c40cca00 tx=0x7f88ac005830 comp rx=0 tx=0).stop 2024-09-21T00:15:07.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.943+0000 7f88cc600640 1 -- 172.21.15.83:0/2173739275 shutdown_connections 2024-09-21T00:15:07.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.943+0000 7f88cc600640 1 --2- 172.21.15.83:0/2173739275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88ac005250 0x7f88ac00b9c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:07.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.943+0000 7f88cc600640 1 -- 172.21.15.83:0/2173739275 >> 172.21.15.83:0/2173739275 conn(0x7f88c40ccac0 msgr2=0x7f88c40cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:07.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.943+0000 7f88cc600640 1 -- 172.21.15.83:0/2173739275 shutdown_connections 2024-09-21T00:15:07.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.943+0000 7f88cc600640 1 -- 172.21.15.83:0/2173739275 wait complete. 2024-09-21T00:15:07.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.945+0000 7f88cc600640 1 Processor -- start 2024-09-21T00:15:07.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.945+0000 7f88cc600640 1 -- start start 2024-09-21T00:15:07.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88cc600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88ac005250 0x7f88c40c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:07.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88cc600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415d3b0 0x7f88c40741d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:07.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88cc600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c415d7c0 0x7f88c4074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:07.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88cc600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f88c4160490 con 0x7f88c415d7c0 2024-09-21T00:15:07.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88cc600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f88c4160310 con 0x7f88ac005250 2024-09-21T00:15:07.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88cc600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f88c4160610 con 0x7f88c415d3b0 2024-09-21T00:15:07.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88ca600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c415d7c0 0x7f88c4074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88ca600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c415d7c0 0x7f88c4074710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57080/0 (socket says 172.21.15.83:57080) 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88ca600640 1 -- 172.21.15.83:0/4123798040 learned_addr learned my addr 172.21.15.83:0/4123798040 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88c9c00640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88ac005250 0x7f88c40c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88c9200640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415d3b0 0x7f88c40741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88ca600640 1 -- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415d3b0 msgr2=0x7f88c40741d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88ca600640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415d3b0 0x7f88c40741d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88ca600640 1 -- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88ac005250 msgr2=0x7f88c40c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88ca600640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88ac005250 0x7f88c40c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88ca600640 1 -- 172.21.15.83:0/4123798040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c41f6780 con 0x7f88c415d7c0 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.947+0000 7f88c9200640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415d3b0 0x7f88c40741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.948+0000 7f88ca600640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c415d7c0 0x7f88c4074710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009f90 tx=0x7f88bc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.948+0000 7f88c1600640 1 -- 172.21.15.83:0/4123798040 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc038040 con 0x7f88c415d7c0 2024-09-21T00:15:07.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.948+0000 7f88c1600640 1 -- 172.21.15.83:0/4123798040 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88bc004b20 con 0x7f88c415d7c0 2024-09-21T00:15:07.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.948+0000 7f88c1600640 1 -- 172.21.15.83:0/4123798040 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc009200 con 0x7f88c415d7c0 2024-09-21T00:15:07.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.948+0000 7f88cc600640 1 -- 172.21.15.83:0/4123798040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c41f6a60 con 0x7f88c415d7c0 2024-09-21T00:15:07.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.948+0000 7f88cc600640 1 -- 172.21.15.83:0/4123798040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c41f7020 con 0x7f88c415d7c0 2024-09-21T00:15:07.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.949+0000 7f88cc600640 1 -- 172.21.15.83:0/4123798040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c406f1b0 con 0x7f88c415d7c0 2024-09-21T00:15:07.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.950+0000 7f88c1600640 1 -- 172.21.15.83:0/4123798040 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f88bc03b390 con 0x7f88c415d7c0 2024-09-21T00:15:07.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.951+0000 7f88c1600640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f88a4078bc0 0x7f88a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:07.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.951+0000 7f88c1600640 1 -- 172.21.15.83:0/4123798040 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f88bc0bb200 con 0x7f88c415d7c0 2024-09-21T00:15:07.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.952+0000 7f88c9c00640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f88a4078bc0 0x7f88a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:07.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.952+0000 7f88c9c00640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f88a4078bc0 0x7f88a407b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f88b8006680 tx=0x7f88b8006b70 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:07.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:07.956+0000 7f88c1600640 1 -- 172.21.15.83:0/4123798040 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f88bc082ef0 con 0x7f88c415d7c0 2024-09-21T00:15:08.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.154+0000 7f88cc600640 1 -- 172.21.15.83:0/4123798040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f88c41f64d0 con 0x7f88c415d7c0 2024-09-21T00:15:08.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.687+0000 7f88c1600640 1 -- 172.21.15.83:0/4123798040 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f88bc087920 con 0x7f88c415d7c0 2024-09-21T00:15:08.689 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data_ec' removed 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.691+0000 7f88cc600640 1 -- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f88a4078bc0 msgr2=0x7f88a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.691+0000 7f88cc600640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f88a4078bc0 0x7f88a407b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f88b8006680 tx=0x7f88b8006b70 comp rx=0 tx=0).stop 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.691+0000 7f88cc600640 1 -- 172.21.15.83:0/4123798040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c415d7c0 msgr2=0x7f88c4074710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.691+0000 7f88cc600640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c415d7c0 0x7f88c4074710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009f90 tx=0x7f88bc033c20 comp rx=0 tx=0).stop 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.691+0000 7f88cc600640 1 -- 172.21.15.83:0/4123798040 shutdown_connections 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.691+0000 7f88cc600640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f88a4078bc0 0x7f88a407b0d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.691+0000 7f88cc600640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c415d7c0 0x7f88c4074710 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.691+0000 7f88cc600640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415d3b0 0x7f88c40741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.691+0000 7f88cc600640 1 --2- 172.21.15.83:0/4123798040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88ac005250 0x7f88c40c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.691+0000 7f88cc600640 1 -- 172.21.15.83:0/4123798040 >> 172.21.15.83:0/4123798040 conn(0x7f88c40ccac0 msgr2=0x7f88c4073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:08.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.692+0000 7f88cc600640 1 -- 172.21.15.83:0/4123798040 shutdown_connections 2024-09-21T00:15:08.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:08.692+0000 7f88cc600640 1 -- 172.21.15.83:0/4123798040 wait complete. 2024-09-21T00:15:08.719 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T00:15:08.719 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T00:15:08.719 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T00:15:08.719 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:15:08.720 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T00:15:08.720 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T00:15:08.720 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T00:15:08.720 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:15:08.720 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T00:15:08.720 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T00:15:08.720 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T00:15:08.720 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:15:08.721 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T00:15:08.721 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T00:15:08.721 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T00:15:08.721 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:15:08.743 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T00:15:08.743 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T00:15:08.744 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T00:15:08.744 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T00:15:08.745 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T00:15:08.746 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T00:15:08.746 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T00:15:08.746 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T00:15:08.788 INFO:tasks.ceph.mds.c:Started 2024-09-21T00:15:08.788 DEBUG:teuthology.parallel:result is None 2024-09-21T00:15:08.790 INFO:tasks.ceph.mds.b:Started 2024-09-21T00:15:08.790 DEBUG:teuthology.parallel:result is None 2024-09-21T00:15:08.790 INFO:tasks.ceph.mds.a:Started 2024-09-21T00:15:08.791 DEBUG:teuthology.parallel:result is None 2024-09-21T00:15:08.792 INFO:tasks.ceph.mds.d:Started 2024-09-21T00:15:08.792 DEBUG:teuthology.parallel:result is None 2024-09-21T00:15:08.793 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T00:15:08.995 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-09-21T00:15:08.996 INFO:tasks.ceph.mds.c.smithi083.stdout:starting mds.c at 2024-09-21T00:15:08.996 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-09-21T00:15:08.998 INFO:tasks.ceph.mds.a.smithi083.stdout:starting mds.a at 2024-09-21T00:15:09.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.036+0000 7f8bcc200640 1 -- 172.21.15.83:0/3987046660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bc415ac20 msgr2=0x7f8bc4070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:09.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.036+0000 7f8bcc200640 1 --2- 172.21.15.83:0/3987046660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bc415ac20 0x7f8bc4070070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80097e0 tx=0x7f8bb802a440 comp rx=0 tx=0).stop 2024-09-21T00:15:09.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.036+0000 7f8bcc200640 1 -- 172.21.15.83:0/3987046660 shutdown_connections 2024-09-21T00:15:09.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.036+0000 7f8bcc200640 1 --2- 172.21.15.83:0/3987046660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bc415ac20 0x7f8bc4070070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.036+0000 7f8bcc200640 1 -- 172.21.15.83:0/3987046660 >> 172.21.15.83:0/3987046660 conn(0x7f8bc40b1b90 msgr2=0x7f8bc40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:09.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.036+0000 7f8bcc200640 1 -- 172.21.15.83:0/3987046660 shutdown_connections 2024-09-21T00:15:09.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.036+0000 7f8bcc200640 1 -- 172.21.15.83:0/3987046660 wait complete. 2024-09-21T00:15:09.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.038+0000 7f8bcc200640 1 Processor -- start 2024-09-21T00:15:09.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.038+0000 7f8bcc200640 1 -- start start 2024-09-21T00:15:09.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.039+0000 7f8bcc200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc406ddf0 0x7f8bc409fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:09.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.039+0000 7f8bcc200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bc4072d90 0x7f8bc409d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:09.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.039+0000 7f8bcc200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bc415ac20 0x7f8bc409de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:09.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.039+0000 7f8bcc200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc40738b0 con 0x7f8bc406ddf0 2024-09-21T00:15:09.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.039+0000 7f8bcc200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4071090 con 0x7f8bc4072d90 2024-09-21T00:15:09.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.039+0000 7f8bcc200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc4073a30 con 0x7f8bc415ac20 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bc9800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc406ddf0 0x7f8bc409fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bc9800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc406ddf0 0x7f8bc409fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57112/0 (socket says 172.21.15.83:57112) 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bc9800640 1 -- 172.21.15.83:0/3869446136 learned_addr learned my addr 172.21.15.83:0/3869446136 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bc8e00640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bc4072d90 0x7f8bc409d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bca200640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bc415ac20 0x7f8bc409de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bc9800640 1 -- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bc415ac20 msgr2=0x7f8bc409de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bc9800640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bc415ac20 0x7f8bc409de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bc9800640 1 -- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bc4072d90 msgr2=0x7f8bc409d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bc9800640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bc4072d90 0x7f8bc409d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bc9800640 1 -- 172.21.15.83:0/3869446136 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc4169950 con 0x7f8bc406ddf0 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bca200640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bc415ac20 0x7f8bc409de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.040+0000 7f8bc9800640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc406ddf0 0x7f8bc409fe80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009900 tx=0x7f8bb8033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:09.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.041+0000 7f8bc1600640 1 -- 172.21.15.83:0/3869446136 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8031d60 con 0x7f8bc406ddf0 2024-09-21T00:15:09.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.041+0000 7f8bc1600640 1 -- 172.21.15.83:0/3869446136 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bb8005020 con 0x7f8bc406ddf0 2024-09-21T00:15:09.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.041+0000 7f8bc1600640 1 -- 172.21.15.83:0/3869446136 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8005490 con 0x7f8bc406ddf0 2024-09-21T00:15:09.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.041+0000 7f8bcc200640 1 -- 172.21.15.83:0/3869446136 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc4169c30 con 0x7f8bc406ddf0 2024-09-21T00:15:09.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.041+0000 7f8bcc200640 1 -- 172.21.15.83:0/3869446136 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc415a560 con 0x7f8bc406ddf0 2024-09-21T00:15:09.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.042+0000 7f8bcc200640 1 -- 172.21.15.83:0/3869446136 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc4070070 con 0x7f8bc406ddf0 2024-09-21T00:15:09.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.043+0000 7f8bc1600640 1 -- 172.21.15.83:0/3869446136 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8bb80047a0 con 0x7f8bc406ddf0 2024-09-21T00:15:09.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.044+0000 7f8bc1600640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ba4078be0 0x7f8ba407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:09.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.044+0000 7f8bc1600640 1 -- 172.21.15.83:0/3869446136 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5335+0+0 (secure 0 0 0) 0x7f8bb80bbd70 con 0x7f8bc406ddf0 2024-09-21T00:15:09.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.045+0000 7f8bc8e00640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ba4078be0 0x7f8ba407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:09.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.045+0000 7f8bc8e00640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ba4078be0 0x7f8ba407b0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0007fd0 tx=0x7f8bb0009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:09.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.049+0000 7f8bc1600640 1 -- 172.21.15.83:0/3869446136 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8bb803f030 con 0x7f8bc406ddf0 2024-09-21T00:15:09.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.248+0000 7f8bcc200640 1 -- 172.21.15.83:0/3869446136 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8bc409cc90 con 0x7f8bc406ddf0 2024-09-21T00:15:09.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.706+0000 7f8bc1600640 1 -- 172.21.15.83:0/3869446136 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) ==== 97+0+0 (secure 0 0 0) 0x7f8bb8084300 con 0x7f8bc406ddf0 2024-09-21T00:15:09.707 INFO:teuthology.orchestra.run.smithi083.stderr: removed all blocklist entries 2024-09-21T00:15:09.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 -- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ba4078be0 msgr2=0x7f8ba407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:09.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ba4078be0 0x7f8ba407b0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0007fd0 tx=0x7f8bb0009040 comp rx=0 tx=0).stop 2024-09-21T00:15:09.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 -- 172.21.15.83:0/3869446136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc406ddf0 msgr2=0x7f8bc409fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:09.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc406ddf0 0x7f8bc409fe80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009900 tx=0x7f8bb8033ce0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 -- 172.21.15.83:0/3869446136 shutdown_connections 2024-09-21T00:15:09.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ba4078be0 0x7f8ba407b0f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bc415ac20 0x7f8bc409de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bc4072d90 0x7f8bc409d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 --2- 172.21.15.83:0/3869446136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc406ddf0 0x7f8bc409fe80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 -- 172.21.15.83:0/3869446136 >> 172.21.15.83:0/3869446136 conn(0x7f8bc40b1b90 msgr2=0x7f8bc4073f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:09.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 -- 172.21.15.83:0/3869446136 shutdown_connections 2024-09-21T00:15:09.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.709+0000 7f8bcc200640 1 -- 172.21.15.83:0/3869446136 wait complete. 2024-09-21T00:15:09.735 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T00:15:09.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.958+0000 7f7fe4e00640 1 -- 172.21.15.83:0/1331600908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fe01629c0 msgr2=0x7f7fe006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:09.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.958+0000 7f7fe4e00640 1 --2- 172.21.15.83:0/1331600908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fe01629c0 0x7f7fe006d2b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00c7db0 tx=0x7f7fc802a5f0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.958+0000 7f7fe4e00640 1 -- 172.21.15.83:0/1331600908 shutdown_connections 2024-09-21T00:15:09.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.958+0000 7f7fe4e00640 1 --2- 172.21.15.83:0/1331600908 >> v2:172.21.15.142:3300/0 conn(0x7f7fe006d7f0 0x7f7fe0154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.958+0000 7f7fe4e00640 1 --2- 172.21.15.83:0/1331600908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fe01629c0 0x7f7fe006d2b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.958+0000 7f7fe4e00640 1 -- 172.21.15.83:0/1331600908 >> 172.21.15.83:0/1331600908 conn(0x7f7fe00d1930 msgr2=0x7f7fe00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.958+0000 7f7fe4e00640 1 -- 172.21.15.83:0/1331600908 shutdown_connections 2024-09-21T00:15:09.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.958+0000 7f7fe4e00640 1 -- 172.21.15.83:0/1331600908 wait complete. 2024-09-21T00:15:09.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.960+0000 7f7fe4e00640 1 Processor -- start 2024-09-21T00:15:09.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.960+0000 7f7fe4e00640 1 -- start start 2024-09-21T00:15:09.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fe4e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fe006d7f0 0x7f7fe00c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:09.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fe4e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fe00b9e40 0x7f7fe00d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:09.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fe4e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fe00ca1b0 0x7f7fe00d2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:09.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fe4e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe0155770 con 0x7f7fe00ca1b0 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fe4e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01555f0 con 0x7f7fe006d7f0 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fe4e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe01558f0 con 0x7f7fe00b9e40 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fdfe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fe00ca1b0 0x7f7fe00d2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fdfe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fe00ca1b0 0x7f7fe00d2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57132/0 (socket says 172.21.15.83:57132) 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fdfe00640 1 -- 172.21.15.83:0/2641955710 learned_addr learned my addr 172.21.15.83:0/2641955710 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fdf400640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fe006d7f0 0x7f7fe00c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fd6a00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fe00b9e40 0x7f7fe00d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fdfe00640 1 -- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fe00b9e40 msgr2=0x7f7fe00d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fdfe00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fe00b9e40 0x7f7fe00d2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fdfe00640 1 -- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fe006d7f0 msgr2=0x7f7fe00c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fdfe00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fe006d7f0 0x7f7fe00c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:09.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.962+0000 7f7fdfe00640 1 -- 172.21.15.83:0/2641955710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe01e87f0 con 0x7f7fe00ca1b0 2024-09-21T00:15:09.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.963+0000 7f7fdfe00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fe00ca1b0 0x7f7fe00d2f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800ea40 tx=0x7f7fd800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:09.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.963+0000 7f7fd7e00640 1 -- 172.21.15.83:0/2641955710 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800ce40 con 0x7f7fe00ca1b0 2024-09-21T00:15:09.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.963+0000 7f7fd7e00640 1 -- 172.21.15.83:0/2641955710 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fd8004c10 con 0x7f7fe00ca1b0 2024-09-21T00:15:09.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.963+0000 7f7fe4e00640 1 -- 172.21.15.83:0/2641955710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe01e8ad0 con 0x7f7fe00ca1b0 2024-09-21T00:15:09.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.963+0000 7f7fd7e00640 1 -- 172.21.15.83:0/2641955710 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8005020 con 0x7f7fe00ca1b0 2024-09-21T00:15:09.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.963+0000 7f7fe4e00640 1 -- 172.21.15.83:0/2641955710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe01e9090 con 0x7f7fe00ca1b0 2024-09-21T00:15:09.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.964+0000 7f7fe4e00640 1 -- 172.21.15.83:0/2641955710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe01e8560 con 0x7f7fe00ca1b0 2024-09-21T00:15:09.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.965+0000 7f7fd7e00640 1 -- 172.21.15.83:0/2641955710 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fd80051c0 con 0x7f7fe00ca1b0 2024-09-21T00:15:09.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.966+0000 7f7fd7e00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fbc078b90 0x7f7fbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:09.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.966+0000 7f7fd7e00640 1 -- 172.21.15.83:0/2641955710 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f7fd809b8e0 con 0x7f7fe00ca1b0 2024-09-21T00:15:09.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.967+0000 7f7fdf400640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fbc078b90 0x7f7fbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:09.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.967+0000 7f7fdf400640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fbc078b90 0x7f7fbc07b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000f60 tx=0x7f7fd0009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:09.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:09.971+0000 7f7fd7e00640 1 -- 172.21.15.83:0/2641955710 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7fd8063880 con 0x7f7fe00ca1b0 2024-09-21T00:15:10.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.231+0000 7f7fe4e00640 1 -- 172.21.15.83:0/2641955710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7fe0150b80 con 0x7f7fe00ca1b0 2024-09-21T00:15:10.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.231+0000 7f7fd7e00640 1 -- 172.21.15.83:0/2641955710 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f7fd80682b0 con 0x7f7fe00ca1b0 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: "auth_dump": [ 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mds.a", 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCOD+5mExeVEhAAJ0iLestg/L0Bib9lwUH24w==", 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow *", 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow *", 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.233 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mds.b", 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCOD+5mTOI9LhAA7A8BMfTgq3PIkGMqHVwybw==", 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow *", 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow *", 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mds.c", 2024-09-21T00:15:10.234 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCOD+5mHWpbIBAAdSilqp128yDhCNuyzCvnXw==", 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow *", 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow *", 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mds.d", 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPD+5m/O54ABAA6NBFQRXdTc0JRxe/mFvJDA==", 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow *", 2024-09-21T00:15:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow *", 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.0", 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCSD+5miVogKhAA06kRAaDzFMcXZM4Vhsma3g==", 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.236 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.1", 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCVD+5mf6v5NxAArD4h726rUnz5HARwEOQR3g==", 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.2", 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCZD+5mO/szFxAAeNIB5Sarus2uwIhImdJGEw==", 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-09-21T00:15:10.237 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.3", 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCcD+5mchg5JRAA9FArVM2ewxn/vI7C4NNj4g==", 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.238 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.4", 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCiD+5mU6AwKBAAaLyaTasM/iHTD7jtPxWY0g==", 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.5", 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQClD+5m0JiSNxAApNM2e3ipmXOP3qCiAojn7w==", 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.239 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.6", 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCpD+5m8yN5GhAA5Fu+YIBbECGHXB5T2KJbRg==", 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "osd.7", 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCsD+5mqVrkKBAAdCi/KbLE9zPn+gbjsHBZKw==", 2024-09-21T00:15:10.240 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow profile osd", 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile osd", 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.0", 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPD+5mV1rxDBAAkcsI2sXp787CjEVP5Ncm1g==", 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow r", 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow rw", 2024-09-21T00:15:10.241 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow rwx" 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.1", 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPD+5m77beIRAABZoupjF+AI2eZzvL8RVSdA==", 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow r", 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow rw", 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow rwx" 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.242 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.2", 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPD+5mUjBnFxAAzIWgv6WSifHvfdrq6ygbNw==", 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow r", 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow rw", 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow rwx" 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.3", 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCPD+5mhDBwLBAAnfSvKwitJgk/F7004NzHEg==", 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow", 2024-09-21T00:15:10.243 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow r", 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow rw", 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow rwx" 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.admin", 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCND+5mecxlEhAAluHahiG0kqR+I3PDtX1eCw==", 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow *", 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr": "allow *", 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow *", 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.244 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-mds", 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQC1D+5mbiM9KBAA0xrzbJZLLJD2GN5egd1rWA==", 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-mds" 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-mgr", 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQC1D+5mhzQ9KBAAQpLNpK4tPaNgpzv9655x4Q==", 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.245 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-osd", 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQC1D+5m30U9KBAAF3nJRssdd2xJTyyRVinCYw==", 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-osd" 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-rbd", 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQC1D+5m21U9KBAAB1E6QxIktK6Z6L7Nx+w3ug==", 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.246 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQC1D+5myWU9KBAAFqaGhhotVJXb4UshDoiCuQ==", 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "client.bootstrap-rgw", 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQC1D+5mX389KBAAetxVBNBr3qoCMp9zCc2PbQ==", 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.247 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mgr.x", 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCOD+5muywJCBAAQSPUQ+xJ+FcRzBhpyeeyGg==", 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow *", 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile mgr", 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: "entity": "mgr.y", 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: "key": "AQCND+5m4BEbOBAAnYu83HMncFLmEGsIFY7png==", 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": { 2024-09-21T00:15:10.248 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": "allow *", 2024-09-21T00:15:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "mon": "allow profile mgr", 2024-09-21T00:15:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: "osd": "allow *" 2024-09-21T00:15:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:10.249 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T00:15:10.249 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:10.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 -- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fbc078b90 msgr2=0x7f7fbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:10.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fbc078b90 0x7f7fbc07b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000f60 tx=0x7f7fd0009040 comp rx=0 tx=0).stop 2024-09-21T00:15:10.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 -- 172.21.15.83:0/2641955710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fe00ca1b0 msgr2=0x7f7fe00d2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:10.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fe00ca1b0 0x7f7fe00d2f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800ea40 tx=0x7f7fd800ef00 comp rx=0 tx=0).stop 2024-09-21T00:15:10.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 -- 172.21.15.83:0/2641955710 shutdown_connections 2024-09-21T00:15:10.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fbc078b90 0x7f7fbc07b0a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fe00ca1b0 0x7f7fe00d2f90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fe00b9e40 0x7f7fe00d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 --2- 172.21.15.83:0/2641955710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fe006d7f0 0x7f7fe00c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 -- 172.21.15.83:0/2641955710 >> 172.21.15.83:0/2641955710 conn(0x7f7fe00d1930 msgr2=0x7f7fe015fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:10.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.234+0000 7f7fe4e00640 1 -- 172.21.15.83:0/2641955710 shutdown_connections 2024-09-21T00:15:10.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.235+0000 7f7fe4e00640 1 -- 172.21.15.83:0/2641955710 wait complete. 2024-09-21T00:15:10.257 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-21T00:15:10.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.477+0000 7f335c000640 1 -- 172.21.15.83:0/3528371770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3354156a50 msgr2=0x7f3354074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:10.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.477+0000 7f335c000640 1 --2- 172.21.15.83:0/3528371770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3354156a50 0x7f3354074620 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f335406fe40 tx=0x7f334802a5f0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.477+0000 7f335c000640 1 -- 172.21.15.83:0/3528371770 shutdown_connections 2024-09-21T00:15:10.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.477+0000 7f335c000640 1 --2- 172.21.15.83:0/3528371770 >> v2:172.21.15.142:3300/0 conn(0x7f335406e500 0x7f33540cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.477+0000 7f335c000640 1 --2- 172.21.15.83:0/3528371770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3354156a50 0x7f3354074620 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.477+0000 7f335c000640 1 -- 172.21.15.83:0/3528371770 >> 172.21.15.83:0/3528371770 conn(0x7f33540b1b90 msgr2=0x7f33540b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:10.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.477+0000 7f335c000640 1 -- 172.21.15.83:0/3528371770 shutdown_connections 2024-09-21T00:15:10.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.477+0000 7f335c000640 1 -- 172.21.15.83:0/3528371770 wait complete. 2024-09-21T00:15:10.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.479+0000 7f335c000640 1 Processor -- start 2024-09-21T00:15:10.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.480+0000 7f335c000640 1 -- start start 2024-09-21T00:15:10.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f335c000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3354074b60 0x7f33540c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:10.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f335c000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3354156a50 0x7f33540afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:10.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f335c000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33540c9e30 0x7f33540b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:10.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f335c000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f33540cf7d0 con 0x7f33540c9e30 2024-09-21T00:15:10.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f335c000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f33540cf650 con 0x7f3354156a50 2024-09-21T00:15:10.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f335c000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f33540cf950 con 0x7f3354074b60 2024-09-21T00:15:10.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f335a000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33540c9e30 0x7f33540b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:10.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f335a000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33540c9e30 0x7f33540b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57164/0 (socket says 172.21.15.83:57164) 2024-09-21T00:15:10.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f335a000640 1 -- 172.21.15.83:0/1204905284 learned_addr learned my addr 172.21.15.83:0/1204905284 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:10.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f3359600640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3354074b60 0x7f33540c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:10.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.481+0000 7f3358c00640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3354156a50 0x7f33540afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:10.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f335a000640 1 -- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3354074b60 msgr2=0x7f33540c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:10.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f335a000640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3354074b60 0x7f33540c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f335a000640 1 -- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3354156a50 msgr2=0x7f33540afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:10.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f335a000640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3354156a50 0x7f33540afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f335a000640 1 -- 172.21.15.83:0/1204905284 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335409edf0 con 0x7f33540c9e30 2024-09-21T00:15:10.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f3358c00640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3354156a50 0x7f33540afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:10.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f335a000640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33540c9e30 0x7f33540b0180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f334c00d9d0 tx=0x7f334c00de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:10.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f3351600640 1 -- 172.21.15.83:0/1204905284 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c017070 con 0x7f33540c9e30 2024-09-21T00:15:10.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f3351600640 1 -- 172.21.15.83:0/1204905284 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f334c003970 con 0x7f33540c9e30 2024-09-21T00:15:10.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f335c000640 1 -- 172.21.15.83:0/1204905284 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33540c9750 con 0x7f33540c9e30 2024-09-21T00:15:10.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f3351600640 1 -- 172.21.15.83:0/1204905284 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c00be60 con 0x7f33540c9e30 2024-09-21T00:15:10.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.482+0000 7f335c000640 1 -- 172.21.15.83:0/1204905284 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33540b5310 con 0x7f33540c9e30 2024-09-21T00:15:10.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.483+0000 7f335c000640 1 -- 172.21.15.83:0/1204905284 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3354050f60 con 0x7f33540c9e30 2024-09-21T00:15:10.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.485+0000 7f3351600640 1 -- 172.21.15.83:0/1204905284 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f334c010460 con 0x7f33540c9e30 2024-09-21T00:15:10.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.486+0000 7f3351600640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3334078bc0 0x7f333407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:10.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.486+0000 7f3351600640 1 -- 172.21.15.83:0/1204905284 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f334c09aec0 con 0x7f33540c9e30 2024-09-21T00:15:10.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.487+0000 7f3359600640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3334078bc0 0x7f333407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:10.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.487+0000 7f3359600640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3334078bc0 0x7f333407b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3348033000 tx=0x7f3348004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:10.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.491+0000 7f3351600640 1 -- 172.21.15.83:0/1204905284 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f334c062e60 con 0x7f33540c9e30 2024-09-21T00:15:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.750+0000 7f335c000640 1 -- 172.21.15.83:0/1204905284 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f33540c99e0 con 0x7f33540c9e30 2024-09-21T00:15:10.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.754+0000 7f3351600640 1 -- 172.21.15.83:0/1204905284 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f334c067890 con 0x7f33540c9e30 2024-09-21T00:15:10.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 -- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3334078bc0 msgr2=0x7f333407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:10.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3334078bc0 0x7f333407b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3348033000 tx=0x7f3348004730 comp rx=0 tx=0).stop 2024-09-21T00:15:10.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 -- 172.21.15.83:0/1204905284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33540c9e30 msgr2=0x7f33540b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:10.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33540c9e30 0x7f33540b0180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f334c00d9d0 tx=0x7f334c00de90 comp rx=0 tx=0).stop 2024-09-21T00:15:10.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 -- 172.21.15.83:0/1204905284 shutdown_connections 2024-09-21T00:15:10.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3334078bc0 0x7f333407b0d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33540c9e30 0x7f33540b0180 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3354156a50 0x7f33540afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 --2- 172.21.15.83:0/1204905284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3354074b60 0x7f33540c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:10.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 -- 172.21.15.83:0/1204905284 >> 172.21.15.83:0/1204905284 conn(0x7f33540b1b90 msgr2=0x7f335406d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:10.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 -- 172.21.15.83:0/1204905284 shutdown_connections 2024-09-21T00:15:10.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:10.757+0000 7f335c000640 1 -- 172.21.15.83:0/1204905284 wait complete. 2024-09-21T00:15:10.781 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-21T00:15:11.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.003+0000 7f2692a00640 1 -- 172.21.15.83:0/768144381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268c06e500 msgr2=0x7f268c0cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:11.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.003+0000 7f2692a00640 1 --2- 172.21.15.83:0/768144381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268c06e500 0x7f268c0cef00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2684005fd0 tx=0x7f268402a8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.003+0000 7f2692a00640 1 -- 172.21.15.83:0/768144381 shutdown_connections 2024-09-21T00:15:11.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.003+0000 7f2692a00640 1 --2- 172.21.15.83:0/768144381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268c06e500 0x7f268c0cef00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.003+0000 7f2692a00640 1 --2- 172.21.15.83:0/768144381 >> v2:172.21.15.142:3300/0 conn(0x7f268c156a50 0x7f268c074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.003+0000 7f2692a00640 1 -- 172.21.15.83:0/768144381 >> 172.21.15.83:0/768144381 conn(0x7f268c0b1b90 msgr2=0x7f268c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:11.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.004+0000 7f2692a00640 1 -- 172.21.15.83:0/768144381 shutdown_connections 2024-09-21T00:15:11.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.004+0000 7f2692a00640 1 -- 172.21.15.83:0/768144381 wait complete. 2024-09-21T00:15:11.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.006+0000 7f2692a00640 1 Processor -- start 2024-09-21T00:15:11.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.006+0000 7f2692a00640 1 -- start start 2024-09-21T00:15:11.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.007+0000 7f2692a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f268c074b60 0x7f268c0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:11.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.007+0000 7f2692a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f268c156a50 0x7f268c09f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:11.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.007+0000 7f2692a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268c155e30 0x7f268c09fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:11.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.007+0000 7f2692a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0cf7d0 con 0x7f268c156a50 2024-09-21T00:15:11.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.007+0000 7f2692a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0cf650 con 0x7f268c074b60 2024-09-21T00:15:11.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.007+0000 7f2692a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f268c0cf950 con 0x7f268c155e30 2024-09-21T00:15:11.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f2683400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f268c156a50 0x7f268c09f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:11.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f2683400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f268c156a50 0x7f268c09f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57178/0 (socket says 172.21.15.83:57178) 2024-09-21T00:15:11.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f2683400640 1 -- 172.21.15.83:0/1593871047 learned_addr learned my addr 172.21.15.83:0/1593871047 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:11.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f2690a00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268c155e30 0x7f268c09fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:11.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f268be00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f268c074b60 0x7f268c0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:11.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f2683400640 1 -- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268c155e30 msgr2=0x7f268c09fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:11.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f2683400640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268c155e30 0x7f268c09fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f2683400640 1 -- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f268c074b60 msgr2=0x7f268c0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:11.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f2683400640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f268c074b60 0x7f268c0c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f2683400640 1 -- 172.21.15.83:0/1593871047 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c0b4770 con 0x7f268c156a50 2024-09-21T00:15:11.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.008+0000 7f2690a00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268c155e30 0x7f268c09fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:15:11.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.009+0000 7f2683400640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f268c156a50 0x7f268c09f720 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f267400c3c0 tx=0x7f267400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:11.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.009+0000 7f2688c00640 1 -- 172.21.15.83:0/1593871047 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674011790 con 0x7f268c156a50 2024-09-21T00:15:11.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.009+0000 7f2688c00640 1 -- 172.21.15.83:0/1593871047 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2674017070 con 0x7f268c156a50 2024-09-21T00:15:11.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.009+0000 7f2688c00640 1 -- 172.21.15.83:0/1593871047 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674011ce0 con 0x7f268c156a50 2024-09-21T00:15:11.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.009+0000 7f2692a00640 1 -- 172.21.15.83:0/1593871047 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268c0b4a50 con 0x7f268c156a50 2024-09-21T00:15:11.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.009+0000 7f2692a00640 1 -- 172.21.15.83:0/1593871047 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268c0c6370 con 0x7f268c156a50 2024-09-21T00:15:11.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.010+0000 7f2692a00640 1 -- 172.21.15.83:0/1593871047 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f268c0b2950 con 0x7f268c156a50 2024-09-21T00:15:11.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.011+0000 7f2688c00640 1 -- 172.21.15.83:0/1593871047 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f267401c460 con 0x7f268c156a50 2024-09-21T00:15:11.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.012+0000 7f2688c00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2668078b90 0x7f266807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:11.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.012+0000 7f2688c00640 1 -- 172.21.15.83:0/1593871047 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f267409a7e0 con 0x7f268c156a50 2024-09-21T00:15:11.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.013+0000 7f268be00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2668078b90 0x7f266807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:11.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.013+0000 7f268be00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2668078b90 0x7f266807b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f267c0095f0 tx=0x7f267c005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:11.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.017+0000 7f2688c00640 1 -- 172.21.15.83:0/1593871047 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f268c0b2950 con 0x7f268c156a50 2024-09-21T00:15:11.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.269+0000 7f2692a00640 1 -- 172.21.15.83:0/1593871047 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f268c0cef00 con 0x7f268c156a50 2024-09-21T00:15:11.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.272+0000 7f2688c00640 1 -- 172.21.15.83:0/1593871047 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f2674062780 con 0x7f268c156a50 2024-09-21T00:15:11.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.274+0000 7f2692a00640 1 -- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2668078b90 msgr2=0x7f266807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:11.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.274+0000 7f2692a00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2668078b90 0x7f266807b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f267c0095f0 tx=0x7f267c005f90 comp rx=0 tx=0).stop 2024-09-21T00:15:11.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.274+0000 7f2692a00640 1 -- 172.21.15.83:0/1593871047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f268c156a50 msgr2=0x7f268c09f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:11.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.274+0000 7f2692a00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f268c156a50 0x7f268c09f720 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f267400c3c0 tx=0x7f267400c880 comp rx=0 tx=0).stop 2024-09-21T00:15:11.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.275+0000 7f2692a00640 1 -- 172.21.15.83:0/1593871047 shutdown_connections 2024-09-21T00:15:11.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.275+0000 7f2692a00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2668078b90 0x7f266807b0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.275+0000 7f2692a00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268c155e30 0x7f268c09fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.275+0000 7f2692a00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f268c156a50 0x7f268c09f720 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.275+0000 7f2692a00640 1 --2- 172.21.15.83:0/1593871047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f268c074b60 0x7f268c0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.275+0000 7f2692a00640 1 -- 172.21.15.83:0/1593871047 >> 172.21.15.83:0/1593871047 conn(0x7f268c0b1b90 msgr2=0x7f268c06d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:11.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.275+0000 7f2692a00640 1 -- 172.21.15.83:0/1593871047 shutdown_connections 2024-09-21T00:15:11.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.275+0000 7f2692a00640 1 -- 172.21.15.83:0/1593871047 wait complete. 2024-09-21T00:15:11.298 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-21T00:15:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.519+0000 7f8182600640 1 -- 172.21.15.83:0/1365735465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c06f450 msgr2=0x7f817c0b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.519+0000 7f8182600640 1 --2- 172.21.15.83:0/1365735465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c06f450 0x7f817c0b5a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8164005fd0 tx=0x7f816402aaa0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.519+0000 7f8182600640 1 -- 172.21.15.83:0/1365735465 shutdown_connections 2024-09-21T00:15:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.519+0000 7f8182600640 1 --2- 172.21.15.83:0/1365735465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c06f450 0x7f817c0b5a40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.519+0000 7f8182600640 1 --2- 172.21.15.83:0/1365735465 >> v2:172.21.15.142:3300/0 conn(0x7f817c15a270 0x7f817c0ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.519+0000 7f8182600640 1 -- 172.21.15.83:0/1365735465 >> 172.21.15.83:0/1365735465 conn(0x7f817c0cdca0 msgr2=0x7f817c0ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.519+0000 7f8182600640 1 -- 172.21.15.83:0/1365735465 shutdown_connections 2024-09-21T00:15:11.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.519+0000 7f8182600640 1 -- 172.21.15.83:0/1365735465 wait complete. 2024-09-21T00:15:11.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.522+0000 7f8182600640 1 Processor -- start 2024-09-21T00:15:11.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.522+0000 7f8182600640 1 -- start start 2024-09-21T00:15:11.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.523+0000 7f8182600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f817c06f450 0x7f817c1f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:11.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.523+0000 7f8182600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c0b2ca0 0x7f817c09db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:11.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.523+0000 7f8182600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c15a270 0x7f817c15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:11.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.523+0000 7f8182600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f817c160530 con 0x7f817c06f450 2024-09-21T00:15:11.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.523+0000 7f8182600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f817c1603b0 con 0x7f817c15a270 2024-09-21T00:15:11.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.523+0000 7f8182600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f817c1606b0 con 0x7f817c0b2ca0 2024-09-21T00:15:11.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.523+0000 7f817b400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f817c06f450 0x7f817c1f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:11.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f817b400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f817c06f450 0x7f817c1f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57180/0 (socket says 172.21.15.83:57180) 2024-09-21T00:15:11.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f817b400640 1 -- 172.21.15.83:0/3335681808 learned_addr learned my addr 172.21.15.83:0/3335681808 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:11.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f817be00640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c15a270 0x7f817c15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:11.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f8172a00640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c0b2ca0 0x7f817c09db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:11.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f817b400640 1 -- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c0b2ca0 msgr2=0x7f817c09db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:11.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f817b400640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c0b2ca0 0x7f817c09db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f817b400640 1 -- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c15a270 msgr2=0x7f817c15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:11.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f817b400640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c15a270 0x7f817c15ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f817b400640 1 -- 172.21.15.83:0/3335681808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c1e5a80 con 0x7f817c06f450 2024-09-21T00:15:11.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f817be00640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c15a270 0x7f817c15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:15:11.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.524+0000 7f817b400640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f817c06f450 0x7f817c1f40b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f816c00e7c0 tx=0x7f816c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:11.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.525+0000 7f8173e00640 1 -- 172.21.15.83:0/3335681808 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c00ccc0 con 0x7f817c06f450 2024-09-21T00:15:11.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.525+0000 7f8173e00640 1 -- 172.21.15.83:0/3335681808 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f816c010430 con 0x7f817c06f450 2024-09-21T00:15:11.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.525+0000 7f8182600640 1 -- 172.21.15.83:0/3335681808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817c1f45f0 con 0x7f817c06f450 2024-09-21T00:15:11.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.525+0000 7f8173e00640 1 -- 172.21.15.83:0/3335681808 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c010860 con 0x7f817c06f450 2024-09-21T00:15:11.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.525+0000 7f8182600640 1 -- 172.21.15.83:0/3335681808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817c1e5d20 con 0x7f817c06f450 2024-09-21T00:15:11.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.526+0000 7f8182600640 1 -- 172.21.15.83:0/3335681808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f817c160b60 con 0x7f817c06f450 2024-09-21T00:15:11.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.527+0000 7f8173e00640 1 -- 172.21.15.83:0/3335681808 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f816c010a00 con 0x7f817c06f450 2024-09-21T00:15:11.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.529+0000 7f8173e00640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8158078b90 0x7f815807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:11.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.529+0000 7f8173e00640 1 -- 172.21.15.83:0/3335681808 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f816c09b580 con 0x7f817c06f450 2024-09-21T00:15:11.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.529+0000 7f8172a00640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8158078b90 0x7f815807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:11.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.530+0000 7f8172a00640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8158078b90 0x7f815807b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8164035000 tx=0x7f8164038040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:11.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.533+0000 7f8173e00640 1 -- 172.21.15.83:0/3335681808 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f816c063520 con 0x7f817c06f450 2024-09-21T00:15:11.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.795+0000 7f8182600640 1 -- 172.21.15.83:0/3335681808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f817c0cda80 con 0x7f817c06f450 2024-09-21T00:15:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.798+0000 7f8173e00640 1 -- 172.21.15.83:0/3335681808 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f816c067f50 con 0x7f817c06f450 2024-09-21T00:15:11.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.800+0000 7f8182600640 1 -- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8158078b90 msgr2=0x7f815807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:11.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.800+0000 7f8182600640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8158078b90 0x7f815807b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8164035000 tx=0x7f8164038040 comp rx=0 tx=0).stop 2024-09-21T00:15:11.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.800+0000 7f8182600640 1 -- 172.21.15.83:0/3335681808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f817c06f450 msgr2=0x7f817c1f40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:11.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.800+0000 7f8182600640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f817c06f450 0x7f817c1f40b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f816c00e7c0 tx=0x7f816c00ec80 comp rx=0 tx=0).stop 2024-09-21T00:15:11.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.800+0000 7f8182600640 1 -- 172.21.15.83:0/3335681808 shutdown_connections 2024-09-21T00:15:11.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.801+0000 7f8182600640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8158078b90 0x7f815807b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.801+0000 7f8182600640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f817c15a270 0x7f817c15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.801+0000 7f8182600640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f817c0b2ca0 0x7f817c09db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.801+0000 7f8182600640 1 --2- 172.21.15.83:0/3335681808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f817c06f450 0x7f817c1f40b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:11.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.801+0000 7f8182600640 1 -- 172.21.15.83:0/3335681808 >> 172.21.15.83:0/3335681808 conn(0x7f817c0cdca0 msgr2=0x7f817c0d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:11.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.801+0000 7f8182600640 1 -- 172.21.15.83:0/3335681808 shutdown_connections 2024-09-21T00:15:11.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:11.801+0000 7f8182600640 1 -- 172.21.15.83:0/3335681808 wait complete. 2024-09-21T00:15:11.823 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-21T00:15:12.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.045+0000 7fa542000640 1 -- 172.21.15.83:0/2932099013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa520003c30 msgr2=0x7fa520004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:12.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.045+0000 7fa542000640 1 --2- 172.21.15.83:0/2932099013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa520003c30 0x7fa520004080 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa52c001830 tx=0x7fa520005830 comp rx=0 tx=0).stop 2024-09-21T00:15:12.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.045+0000 7fa542000640 1 -- 172.21.15.83:0/2932099013 shutdown_connections 2024-09-21T00:15:12.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.045+0000 7fa542000640 1 --2- 172.21.15.83:0/2932099013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa520003c30 0x7fa520004080 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.045+0000 7fa542000640 1 -- 172.21.15.83:0/2932099013 >> 172.21.15.83:0/2932099013 conn(0x7fa53c0b46e0 msgr2=0x7fa53c0d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:12.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.045+0000 7fa542000640 1 -- 172.21.15.83:0/2932099013 shutdown_connections 2024-09-21T00:15:12.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.045+0000 7fa542000640 1 -- 172.21.15.83:0/2932099013 wait complete. 2024-09-21T00:15:12.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.047+0000 7fa542000640 1 Processor -- start 2024-09-21T00:15:12.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.047+0000 7fa542000640 1 -- start start 2024-09-21T00:15:12.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa542000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa520003c30 0x7fa53c1f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:12.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa542000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa53c1e7700 0x7fa53c1f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:12.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa542000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa53c1f6ec0 0x7fa53c0cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:12.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa542000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c0cd5c0 con 0x7fa520003c30 2024-09-21T00:15:12.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa542000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c0cd440 con 0x7fa53c1e7700 2024-09-21T00:15:12.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa542000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa53c0cd740 con 0x7fa53c1f6ec0 2024-09-21T00:15:12.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa53b400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa520003c30 0x7fa53c1f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:12.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa53b400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa520003c30 0x7fa53c1f6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44110/0 (socket says 172.21.15.83:44110) 2024-09-21T00:15:12.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa53b400640 1 -- 172.21.15.83:0/3013311762 learned_addr learned my addr 172.21.15.83:0/3013311762 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:12.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa532a00640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa53c1e7700 0x7fa53c1f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:12.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa53be00640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa53c1f6ec0 0x7fa53c0cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa53b400640 1 -- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa53c1f6ec0 msgr2=0x7fa53c0cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa53b400640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa53c1f6ec0 0x7fa53c0cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa53b400640 1 -- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa53c1e7700 msgr2=0x7fa53c1f6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa53b400640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa53c1e7700 0x7fa53c1f6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.049+0000 7fa53b400640 1 -- 172.21.15.83:0/3013311762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53c1f72d0 con 0x7fa520003c30 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.050+0000 7fa53b400640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa520003c30 0x7fa53c1f6420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa52c001830 tx=0x7fa52c006170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.050+0000 7fa533e00640 1 -- 172.21.15.83:0/3013311762 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c043070 con 0x7fa520003c30 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.050+0000 7fa533e00640 1 -- 172.21.15.83:0/3013311762 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa52c003af0 con 0x7fa520003c30 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.050+0000 7fa533e00640 1 -- 172.21.15.83:0/3013311762 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c033480 con 0x7fa520003c30 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.050+0000 7fa542000640 1 -- 172.21.15.83:0/3013311762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53c1e7d10 con 0x7fa520003c30 2024-09-21T00:15:12.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.050+0000 7fa542000640 1 -- 172.21.15.83:0/3013311762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53c1f5c20 con 0x7fa520003c30 2024-09-21T00:15:12.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.051+0000 7fa542000640 1 -- 172.21.15.83:0/3013311762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa53c070100 con 0x7fa520003c30 2024-09-21T00:15:12.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.052+0000 7fa533e00640 1 -- 172.21.15.83:0/3013311762 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa52c046070 con 0x7fa520003c30 2024-09-21T00:15:12.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.053+0000 7fa533e00640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa518078b90 0x7fa51807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:12.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.053+0000 7fa533e00640 1 -- 172.21.15.83:0/3013311762 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fa52c0ba9e0 con 0x7fa520003c30 2024-09-21T00:15:12.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.054+0000 7fa532a00640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa518078b90 0x7fa51807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:12.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.054+0000 7fa532a00640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa518078b90 0x7fa51807b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa53c1e84a0 tx=0x7fa524005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:12.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.058+0000 7fa533e00640 1 -- 172.21.15.83:0/3013311762 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa52c006260 con 0x7fa520003c30 2024-09-21T00:15:12.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.313+0000 7fa542000640 1 -- 172.21.15.83:0/3013311762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fa53c06a580 con 0x7fa520003c30 2024-09-21T00:15:12.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.316+0000 7fa533e00640 1 -- 172.21.15.83:0/3013311762 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fa52c082a10 con 0x7fa520003c30 2024-09-21T00:15:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.318+0000 7fa542000640 1 -- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa518078b90 msgr2=0x7fa51807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.318+0000 7fa542000640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa518078b90 0x7fa51807b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa53c1e84a0 tx=0x7fa524005f90 comp rx=0 tx=0).stop 2024-09-21T00:15:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.318+0000 7fa542000640 1 -- 172.21.15.83:0/3013311762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa520003c30 msgr2=0x7fa53c1f6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.318+0000 7fa542000640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa520003c30 0x7fa53c1f6420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa52c001830 tx=0x7fa52c006170 comp rx=0 tx=0).stop 2024-09-21T00:15:12.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.319+0000 7fa542000640 1 -- 172.21.15.83:0/3013311762 shutdown_connections 2024-09-21T00:15:12.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.319+0000 7fa542000640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa518078b90 0x7fa51807b0a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.319+0000 7fa542000640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa53c1f6ec0 0x7fa53c0cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.319+0000 7fa542000640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa53c1e7700 0x7fa53c1f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.319+0000 7fa542000640 1 --2- 172.21.15.83:0/3013311762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa520003c30 0x7fa53c1f6420 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.319+0000 7fa542000640 1 -- 172.21.15.83:0/3013311762 >> 172.21.15.83:0/3013311762 conn(0x7fa53c0b46e0 msgr2=0x7fa53c071460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:12.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.319+0000 7fa542000640 1 -- 172.21.15.83:0/3013311762 shutdown_connections 2024-09-21T00:15:12.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.319+0000 7fa542000640 1 -- 172.21.15.83:0/3013311762 wait complete. 2024-09-21T00:15:12.340 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-21T00:15:12.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.560+0000 7f8b37200640 1 -- 172.21.15.83:0/2771172765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b380d0600 msgr2=0x7f8b38071160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:12.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.560+0000 7f8b37200640 1 --2- 172.21.15.83:0/2771172765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b380d0600 0x7f8b38071160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009860 tx=0x7f8b2002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.560+0000 7f8b37200640 1 -- 172.21.15.83:0/2771172765 shutdown_connections 2024-09-21T00:15:12.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.560+0000 7f8b37200640 1 --2- 172.21.15.83:0/2771172765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b380d0600 0x7f8b38071160 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.560+0000 7f8b37200640 1 -- 172.21.15.83:0/2771172765 >> 172.21.15.83:0/2771172765 conn(0x7f8b3806fc80 msgr2=0x7f8b38070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:12.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.560+0000 7f8b37200640 1 -- 172.21.15.83:0/2771172765 shutdown_connections 2024-09-21T00:15:12.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.560+0000 7f8b37200640 1 -- 172.21.15.83:0/2771172765 wait complete. 2024-09-21T00:15:12.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.562+0000 7f8b37200640 1 Processor -- start 2024-09-21T00:15:12.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.562+0000 7f8b37200640 1 -- start start 2024-09-21T00:15:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b37200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b380d0600 0x7f8b3806eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b37200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b380d0a10 0x7f8b3806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b37200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3815d360 0x7f8b3815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b37200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8b38071820 con 0x7f8b380d0600 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b37200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8b380716a0 con 0x7f8b380d0a10 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b37200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8b380719a0 con 0x7f8b3815d360 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b35e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b380d0600 0x7f8b3806eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b35e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b380d0600 0x7f8b3806eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44120/0 (socket says 172.21.15.83:44120) 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b35e00640 1 -- 172.21.15.83:0/2586190948 learned_addr learned my addr 172.21.15.83:0/2586190948 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b2d400640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b380d0a10 0x7f8b3806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b35e00640 1 -- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3815d360 msgr2=0x7f8b3815d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b36800640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3815d360 0x7f8b3815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b35e00640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3815d360 0x7f8b3815d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b35e00640 1 -- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b380d0a10 msgr2=0x7f8b3806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b35e00640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b380d0a10 0x7f8b3806f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b35e00640 1 -- 172.21.15.83:0/2586190948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3814db70 con 0x7f8b380d0600 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.564+0000 7f8b36800640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3815d360 0x7f8b3815d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:12.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.565+0000 7f8b35e00640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b380d0600 0x7f8b3806eb90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800c430 tx=0x7f8b2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:12.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.565+0000 7f8b2ea00640 1 -- 172.21.15.83:0/2586190948 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28017070 con 0x7f8b380d0600 2024-09-21T00:15:12.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.565+0000 7f8b2ea00640 1 -- 172.21.15.83:0/2586190948 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b280053c0 con 0x7f8b380d0600 2024-09-21T00:15:12.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.565+0000 7f8b37200640 1 -- 172.21.15.83:0/2586190948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3814f2e0 con 0x7f8b380d0600 2024-09-21T00:15:12.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.565+0000 7f8b2ea00640 1 -- 172.21.15.83:0/2586190948 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28003850 con 0x7f8b380d0600 2024-09-21T00:15:12.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.565+0000 7f8b37200640 1 -- 172.21.15.83:0/2586190948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3814f8a0 con 0x7f8b380d0600 2024-09-21T00:15:12.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.566+0000 7f8b37200640 1 -- 172.21.15.83:0/2586190948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b3806e0a0 con 0x7f8b380d0600 2024-09-21T00:15:12.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.567+0000 7f8b2ea00640 1 -- 172.21.15.83:0/2586190948 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b2801a070 con 0x7f8b380d0600 2024-09-21T00:15:12.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.569+0000 7f8b2ea00640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8b14078bc0 0x7f8b1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:12.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.569+0000 7f8b2ea00640 1 -- 172.21.15.83:0/2586190948 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f8b28099f50 con 0x7f8b380d0600 2024-09-21T00:15:12.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.569+0000 7f8b2d400640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8b14078bc0 0x7f8b1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:12.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.570+0000 7f8b2d400640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8b14078bc0 0x7f8b1407b0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b20034000 tx=0x7f8b20004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:12.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.574+0000 7f8b2ea00640 1 -- 172.21.15.83:0/2586190948 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8b3814db70 con 0x7f8b380d0600 2024-09-21T00:15:12.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.829+0000 7f8b37200640 1 -- 172.21.15.83:0/2586190948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f8b38072200 con 0x7f8b380d0600 2024-09-21T00:15:12.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.832+0000 7f8b2ea00640 1 -- 172.21.15.83:0/2586190948 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f8b28062550 con 0x7f8b380d0600 2024-09-21T00:15:12.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 -- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8b14078bc0 msgr2=0x7f8b1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:12.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8b14078bc0 0x7f8b1407b0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b20034000 tx=0x7f8b20004730 comp rx=0 tx=0).stop 2024-09-21T00:15:12.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 -- 172.21.15.83:0/2586190948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b380d0600 msgr2=0x7f8b3806eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:12.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b380d0600 0x7f8b3806eb90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800c430 tx=0x7f8b2800c8f0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 -- 172.21.15.83:0/2586190948 shutdown_connections 2024-09-21T00:15:12.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8b14078bc0 0x7f8b1407b0d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3815d360 0x7f8b3815d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b380d0a10 0x7f8b3806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 --2- 172.21.15.83:0/2586190948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b380d0600 0x7f8b3806eb90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:12.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 -- 172.21.15.83:0/2586190948 >> 172.21.15.83:0/2586190948 conn(0x7f8b3806fc80 msgr2=0x7f8b380b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:12.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 -- 172.21.15.83:0/2586190948 shutdown_connections 2024-09-21T00:15:12.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:12.835+0000 7f8b37200640 1 -- 172.21.15.83:0/2586190948 wait complete. 2024-09-21T00:15:12.857 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-21T00:15:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.081+0000 7f2a95800640 1 -- 172.21.15.83:0/3433169785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a740052d0 msgr2=0x7f2a7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:13.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.081+0000 7f2a95800640 1 --2- 172.21.15.83:0/3433169785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a740052d0 0x7f2a7400b9c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2a900733d0 tx=0x7f2a74005830 comp rx=0 tx=0).stop 2024-09-21T00:15:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.081+0000 7f2a8f400640 1 -- 172.21.15.83:0/3433169785 reap_dead start 2024-09-21T00:15:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.081+0000 7f2a95800640 1 -- 172.21.15.83:0/3433169785 shutdown_connections 2024-09-21T00:15:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.081+0000 7f2a95800640 1 -- 172.21.15.83:0/3433169785 >> 172.21.15.83:0/3433169785 conn(0x7f2a900735d0 msgr2=0x7f2a900739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.081+0000 7f2a95800640 1 -- 172.21.15.83:0/3433169785 shutdown_connections 2024-09-21T00:15:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.081+0000 7f2a95800640 1 -- 172.21.15.83:0/3433169785 wait complete. 2024-09-21T00:15:13.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.083+0000 7f2a95800640 1 Processor -- start 2024-09-21T00:15:13.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.083+0000 7f2a95800640 1 -- start start 2024-09-21T00:15:13.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.085+0000 7f2a95800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a740052d0 0x7f2a900aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.085+0000 7f2a95800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a9014fc90 0x7f2a900ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.085+0000 7f2a95800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900b4770 0x7f2a900b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.085+0000 7f2a95800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2a900b5ea0 con 0x7f2a9014fc90 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.085+0000 7f2a95800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2a900b5d20 con 0x7f2a740052d0 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.085+0000 7f2a95800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2a900b6020 con 0x7f2a900b4770 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.085+0000 7f2a8e000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a9014fc90 0x7f2a900ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.085+0000 7f2a8e000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a9014fc90 0x7f2a900ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44140/0 (socket says 172.21.15.83:44140) 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.085+0000 7f2a8e000640 1 -- 172.21.15.83:0/3270095042 learned_addr learned my addr 172.21.15.83:0/3270095042 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a8e000640 1 -- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900b4770 msgr2=0x7f2a900b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a8e000640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900b4770 0x7f2a900b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a8e000640 1 -- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a740052d0 msgr2=0x7f2a900aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:13.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a8e000640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a740052d0 0x7f2a900aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a8e000640 1 -- 172.21.15.83:0/3270095042 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a900cac00 con 0x7f2a9014fc90 2024-09-21T00:15:13.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a8e000640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a9014fc90 0x7f2a900ca6c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c006400 tx=0x7f2a7c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a86a00640 1 -- 172.21.15.83:0/3270095042 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c015070 con 0x7f2a9014fc90 2024-09-21T00:15:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a86a00640 1 -- 172.21.15.83:0/3270095042 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a7c011860 con 0x7f2a9014fc90 2024-09-21T00:15:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a95800640 1 -- 172.21.15.83:0/3270095042 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a900b50c0 con 0x7f2a9014fc90 2024-09-21T00:15:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a86a00640 1 -- 172.21.15.83:0/3270095042 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c011cb0 con 0x7f2a9014fc90 2024-09-21T00:15:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.086+0000 7f2a95800640 1 -- 172.21.15.83:0/3270095042 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a901f8f50 con 0x7f2a9014fc90 2024-09-21T00:15:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.087+0000 7f2a95800640 1 -- 172.21.15.83:0/3270095042 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9006ddf0 con 0x7f2a9014fc90 2024-09-21T00:15:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.088+0000 7f2a86a00640 1 -- 172.21.15.83:0/3270095042 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2a7c018070 con 0x7f2a9014fc90 2024-09-21T00:15:13.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.090+0000 7f2a86a00640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2a70078b90 0x7f2a7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:13.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.090+0000 7f2a86a00640 1 -- 172.21.15.83:0/3270095042 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f2a7c09b900 con 0x7f2a9014fc90 2024-09-21T00:15:13.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.090+0000 7f2a8ea00640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2a70078b90 0x7f2a7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:13.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.091+0000 7f2a8ea00640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2a70078b90 0x7f2a7007b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a800067f0 tx=0x7f2a80006780 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:13.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.095+0000 7f2a86a00640 1 -- 172.21.15.83:0/3270095042 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2a900b50c0 con 0x7f2a9014fc90 2024-09-21T00:15:13.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.362+0000 7f2a95800640 1 -- 172.21.15.83:0/3270095042 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f2a900afc30 con 0x7f2a9014fc90 2024-09-21T00:15:13.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.366+0000 7f2a86a00640 1 -- 172.21.15.83:0/3270095042 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f2a900cac00 con 0x7f2a9014fc90 2024-09-21T00:15:13.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 -- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2a70078b90 msgr2=0x7f2a7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2a70078b90 0x7f2a7007b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a800067f0 tx=0x7f2a80006780 comp rx=0 tx=0).stop 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 -- 172.21.15.83:0/3270095042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a9014fc90 msgr2=0x7f2a900ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a9014fc90 0x7f2a900ca6c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c006400 tx=0x7f2a7c0039c0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 -- 172.21.15.83:0/3270095042 shutdown_connections 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2a70078b90 0x7f2a7007b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900b4770 0x7f2a900b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a9014fc90 0x7f2a900ca6c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 --2- 172.21.15.83:0/3270095042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a740052d0 0x7f2a900aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 -- 172.21.15.83:0/3270095042 >> 172.21.15.83:0/3270095042 conn(0x7f2a900735d0 msgr2=0x7f2a900ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 -- 172.21.15.83:0/3270095042 shutdown_connections 2024-09-21T00:15:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.368+0000 7f2a95800640 1 -- 172.21.15.83:0/3270095042 wait complete. 2024-09-21T00:15:13.394 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T00:15:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.619+0000 7f989b200640 1 -- 172.21.15.83:0/1276778527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9880003a50 msgr2=0x7f9880003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.619+0000 7f989b200640 1 --2- 172.21.15.83:0/1276778527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9880003a50 0x7f9880003ec0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f988c009b50 tx=0x7f9880005830 comp rx=0 tx=0).stop 2024-09-21T00:15:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.619+0000 7f989a800640 1 -- 172.21.15.83:0/1276778527 reap_dead start 2024-09-21T00:15:13.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.620+0000 7f989b200640 1 -- 172.21.15.83:0/1276778527 shutdown_connections 2024-09-21T00:15:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.620+0000 7f989b200640 1 -- 172.21.15.83:0/1276778527 >> 172.21.15.83:0/1276778527 conn(0x7f989c0d1930 msgr2=0x7f989c0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.620+0000 7f989b200640 1 -- 172.21.15.83:0/1276778527 shutdown_connections 2024-09-21T00:15:13.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.620+0000 7f989b200640 1 -- 172.21.15.83:0/1276778527 wait complete. 2024-09-21T00:15:13.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.623+0000 7f989b200640 1 Processor -- start 2024-09-21T00:15:13.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.624+0000 7f989b200640 1 -- start start 2024-09-21T00:15:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.626+0000 7f989b200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9880003a50 0x7f989c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.626+0000 7f989b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f989c146a20 0x7f989c146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.626+0000 7f989b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f989c0c9220 0x7f989c0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.626+0000 7f989b200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f989c162640 con 0x7f9880003a50 2024-09-21T00:15:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.626+0000 7f989b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1624c0 con 0x7f989c146a20 2024-09-21T00:15:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.626+0000 7f989b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f989c147370 con 0x7f989c0c9220 2024-09-21T00:15:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.626+0000 7f9899e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9880003a50 0x7f989c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.626+0000 7f9899e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9880003a50 0x7f989c1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44164/0 (socket says 172.21.15.83:44164) 2024-09-21T00:15:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.626+0000 7f9899e00640 1 -- 172.21.15.83:0/1523600381 learned_addr learned my addr 172.21.15.83:0/1523600381 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.627+0000 7f989a800640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f989c0c9220 0x7f989c0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.627+0000 7f9899400640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f989c146a20 0x7f989c146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.627+0000 7f9899e00640 1 -- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f989c0c9220 msgr2=0x7f989c0c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.627+0000 7f9899e00640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f989c0c9220 0x7f989c0c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.627+0000 7f9899e00640 1 -- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f989c146a20 msgr2=0x7f989c146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.627+0000 7f9899e00640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f989c146a20 0x7f989c146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.627+0000 7f9899e00640 1 -- 172.21.15.83:0/1523600381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c1f8a10 con 0x7f9880003a50 2024-09-21T00:15:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.627+0000 7f9899e00640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9880003a50 0x7f989c1464e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f988c009c70 tx=0x7f988c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.627+0000 7f9892000640 1 -- 172.21.15.83:0/1523600381 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c038040 con 0x7f9880003a50 2024-09-21T00:15:13.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.628+0000 7f9892000640 1 -- 172.21.15.83:0/1523600381 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f988c004020 con 0x7f9880003a50 2024-09-21T00:15:13.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.628+0000 7f9892000640 1 -- 172.21.15.83:0/1523600381 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c004470 con 0x7f9880003a50 2024-09-21T00:15:13.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.628+0000 7f989b200640 1 -- 172.21.15.83:0/1523600381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c1f8ef0 con 0x7f9880003a50 2024-09-21T00:15:13.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.628+0000 7f989b200640 1 -- 172.21.15.83:0/1523600381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c1f94b0 con 0x7f9880003a50 2024-09-21T00:15:13.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.629+0000 7f989b200640 1 -- 172.21.15.83:0/1523600381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c0c8e60 con 0x7f9880003a50 2024-09-21T00:15:13.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.630+0000 7f9892000640 1 -- 172.21.15.83:0/1523600381 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f988c045020 con 0x7f9880003a50 2024-09-21T00:15:13.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.632+0000 7f9892000640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f987c078b90 0x7f987c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:13.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.632+0000 7f9892000640 1 -- 172.21.15.83:0/1523600381 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f988c0bb490 con 0x7f9880003a50 2024-09-21T00:15:13.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.632+0000 7f9899400640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f987c078b90 0x7f987c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:13.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.633+0000 7f9899400640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f987c078b90 0x7f987c07b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f989c15a240 tx=0x7f9888005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:13.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.635+0000 7f9892000640 1 -- 172.21.15.83:0/1523600381 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f989c1f8a10 con 0x7f9880003a50 2024-09-21T00:15:13.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.833+0000 7f989b200640 1 -- 172.21.15.83:0/1523600381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f989c155990 con 0x7f9880003a50 2024-09-21T00:15:13.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.834+0000 7f9892000640 1 -- 172.21.15.83:0/1523600381 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) ==== 84+0+65 (secure 0 0 0) 0x7f988c0834c0 con 0x7f9880003a50 2024-09-21T00:15:13.835 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:13.835 INFO:teuthology.orchestra.run.smithi083.stdout:[ 2024-09-21T00:15:13.835 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T00:15:13.836 INFO:teuthology.orchestra.run.smithi083.stdout: "poolnum": 1, 2024-09-21T00:15:13.836 INFO:teuthology.orchestra.run.smithi083.stdout: "poolname": ".mgr" 2024-09-21T00:15:13.836 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T00:15:13.836 INFO:teuthology.orchestra.run.smithi083.stdout:] 2024-09-21T00:15:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.836+0000 7f989b200640 1 -- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f987c078b90 msgr2=0x7f987c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.836+0000 7f989b200640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f987c078b90 0x7f987c07b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f989c15a240 tx=0x7f9888005f90 comp rx=0 tx=0).stop 2024-09-21T00:15:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.836+0000 7f989b200640 1 -- 172.21.15.83:0/1523600381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9880003a50 msgr2=0x7f989c1464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.836+0000 7f989b200640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9880003a50 0x7f989c1464e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f988c009c70 tx=0x7f988c033670 comp rx=0 tx=0).stop 2024-09-21T00:15:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.837+0000 7f989b200640 1 -- 172.21.15.83:0/1523600381 shutdown_connections 2024-09-21T00:15:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.837+0000 7f989b200640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f987c078b90 0x7f987c07b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.837+0000 7f989b200640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f989c0c9220 0x7f989c0c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.837+0000 7f989b200640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f989c146a20 0x7f989c146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.837+0000 7f989b200640 1 --2- 172.21.15.83:0/1523600381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9880003a50 0x7f989c1464e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.837+0000 7f989b200640 1 -- 172.21.15.83:0/1523600381 >> 172.21.15.83:0/1523600381 conn(0x7f989c0d1930 msgr2=0x7f989c0b8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.837+0000 7f989b200640 1 -- 172.21.15.83:0/1523600381 shutdown_connections 2024-09-21T00:15:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:13.837+0000 7f989b200640 1 -- 172.21.15.83:0/1523600381 wait complete. 2024-09-21T00:15:13.859 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T00:15:13.859 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T00:15:14.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.090+0000 7f581ba00640 1 -- 172.21.15.83:0/3202479617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58140d1910 msgr2=0x7f58140b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:14.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.090+0000 7f581ba00640 1 --2- 172.21.15.83:0/3202479617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58140d1910 0x7f58140b6240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f580c005fd0 tx=0x7f580c02a8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:14.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.090+0000 7f581ba00640 1 -- 172.21.15.83:0/3202479617 shutdown_connections 2024-09-21T00:15:14.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.090+0000 7f581ba00640 1 --2- 172.21.15.83:0/3202479617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58140d1910 0x7f58140b6240 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:14.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.090+0000 7f581ba00640 1 --2- 172.21.15.83:0/3202479617 >> v2:172.21.15.142:3300/0 conn(0x7f5814145e40 0x7f581415cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:14.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.090+0000 7f581ba00640 1 -- 172.21.15.83:0/3202479617 >> 172.21.15.83:0/3202479617 conn(0x7f58140d22e0 msgr2=0x7f58140d26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:14.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.090+0000 7f581ba00640 1 -- 172.21.15.83:0/3202479617 shutdown_connections 2024-09-21T00:15:14.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.090+0000 7f581ba00640 1 -- 172.21.15.83:0/3202479617 wait complete. 2024-09-21T00:15:14.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.093+0000 7f581ba00640 1 Processor -- start 2024-09-21T00:15:14.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.093+0000 7f581ba00640 1 -- start start 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.094+0000 7f581ba00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58140d1910 0x7f58141532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.094+0000 7f581ba00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5814145e40 0x7f58141f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.094+0000 7f581ba00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f581415d040 0x7f58141f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.094+0000 7f581ba00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f58140b6b50 con 0x7f58140d1910 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.094+0000 7f581ba00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f58140b69d0 con 0x7f5814145e40 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.094+0000 7f581ba00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f58140b6cd0 con 0x7f581415d040 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.094+0000 7f5819000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58140d1910 0x7f58141532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5819000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58140d1910 0x7f58141532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44180/0 (socket says 172.21.15.83:44180) 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5819000640 1 -- 172.21.15.83:0/3204543342 learned_addr learned my addr 172.21.15.83:0/3204543342 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5819a00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f581415d040 0x7f58141f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:14.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5813e00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5814145e40 0x7f58141f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:14.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5819000640 1 -- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f581415d040 msgr2=0x7f58141f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5819000640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f581415d040 0x7f58141f3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5819000640 1 -- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5814145e40 msgr2=0x7f58141f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5819000640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5814145e40 0x7f58141f32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5819000640 1 -- 172.21.15.83:0/3204543342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58141537f0 con 0x7f58140d1910 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5819a00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f581415d040 0x7f58141f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.095+0000 7f5819000640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58140d1910 0x7f58141532b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f580800ea20 tx=0x7f580800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.096+0000 7f5810c00640 1 -- 172.21.15.83:0/3204543342 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580800ce40 con 0x7f58140d1910 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.096+0000 7f5810c00640 1 -- 172.21.15.83:0/3204543342 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5808004020 con 0x7f58140d1910 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.096+0000 7f5810c00640 1 -- 172.21.15.83:0/3204543342 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808004470 con 0x7f58140d1910 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.096+0000 7f581ba00640 1 -- 172.21.15.83:0/3204543342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58141f4090 con 0x7f58140d1910 2024-09-21T00:15:14.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.096+0000 7f581ba00640 1 -- 172.21.15.83:0/3204543342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5814140780 con 0x7f58140d1910 2024-09-21T00:15:14.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.097+0000 7f581ba00640 1 -- 172.21.15.83:0/3204543342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58140b71f0 con 0x7f58140d1910 2024-09-21T00:15:14.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.098+0000 7f5810c00640 1 -- 172.21.15.83:0/3204543342 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58080035f0 con 0x7f58140d1910 2024-09-21T00:15:14.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.099+0000 7f5810c00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f57f4078bc0 0x7f57f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:14.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.099+0000 7f5810c00640 1 -- 172.21.15.83:0/3204543342 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f580809b490 con 0x7f58140d1910 2024-09-21T00:15:14.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.100+0000 7f5813e00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f57f4078bc0 0x7f57f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:14.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.100+0000 7f5813e00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f57f4078bc0 0x7f57f407b0d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f581415e4e0 tx=0x7f5800009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:14.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.104+0000 7f5810c00640 1 -- 172.21.15.83:0/3204543342 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5808063a90 con 0x7f58140d1910 2024-09-21T00:15:14.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.299+0000 7f581ba00640 1 -- 172.21.15.83:0/3204543342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f58140b55d0 con 0x7f58140d1910 2024-09-21T00:15:14.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.837+0000 7f5810c00640 1 -- 172.21.15.83:0/3204543342 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) ==== 138+0+0 (secure 0 0 0) 0x7f5808063390 con 0x7f58140d1910 2024-09-21T00:15:14.838 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' created 2024-09-21T00:15:14.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.840+0000 7f581ba00640 1 -- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f57f4078bc0 msgr2=0x7f57f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:14.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.840+0000 7f581ba00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f57f4078bc0 0x7f57f407b0d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f581415e4e0 tx=0x7f5800009040 comp rx=0 tx=0).stop 2024-09-21T00:15:14.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.840+0000 7f581ba00640 1 -- 172.21.15.83:0/3204543342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58140d1910 msgr2=0x7f58141532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:14.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.840+0000 7f581ba00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58140d1910 0x7f58141532b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f580800ea20 tx=0x7f580800eee0 comp rx=0 tx=0).stop 2024-09-21T00:15:14.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.840+0000 7f581ba00640 1 -- 172.21.15.83:0/3204543342 shutdown_connections 2024-09-21T00:15:14.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.840+0000 7f581ba00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f57f4078bc0 0x7f57f407b0d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:14.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.840+0000 7f581ba00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f581415d040 0x7f58141f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:14.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.840+0000 7f581ba00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5814145e40 0x7f58141f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:14.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.840+0000 7f581ba00640 1 --2- 172.21.15.83:0/3204543342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58140d1910 0x7f58141532b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:14.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.840+0000 7f581ba00640 1 -- 172.21.15.83:0/3204543342 >> 172.21.15.83:0/3204543342 conn(0x7f58140d22e0 msgr2=0x7f58141453f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:14.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.841+0000 7f581ba00640 1 -- 172.21.15.83:0/3204543342 shutdown_connections 2024-09-21T00:15:14.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:14.841+0000 7f581ba00640 1 -- 172.21.15.83:0/3204543342 wait complete. 2024-09-21T00:15:14.867 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T00:15:15.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.095+0000 7f560a400640 1 -- 172.21.15.83:0/2981682602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56040cefa0 msgr2=0x7f56040ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:15.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.095+0000 7f560a400640 1 --2- 172.21.15.83:0/2981682602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56040cefa0 0x7f56040ce320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5604159530 tx=0x7f55ec02a560 comp rx=0 tx=0).stop 2024-09-21T00:15:15.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.095+0000 7f560a400640 1 -- 172.21.15.83:0/2981682602 shutdown_connections 2024-09-21T00:15:15.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.095+0000 7f560a400640 1 --2- 172.21.15.83:0/2981682602 >> v2:172.21.15.142:3300/0 conn(0x7f56040ce860 0x7f560415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:15.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.095+0000 7f560a400640 1 --2- 172.21.15.83:0/2981682602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56040cefa0 0x7f56040ce320 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:15.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.095+0000 7f560a400640 1 --2- 172.21.15.83:0/2981682602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f560415b9f0 0x7f56040cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:15.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.095+0000 7f560a400640 1 -- 172.21.15.83:0/2981682602 >> 172.21.15.83:0/2981682602 conn(0x7f56040cca40 msgr2=0x7f56040cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:15.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.095+0000 7f560a400640 1 -- 172.21.15.83:0/2981682602 shutdown_connections 2024-09-21T00:15:15.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.095+0000 7f560a400640 1 -- 172.21.15.83:0/2981682602 wait complete. 2024-09-21T00:15:15.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.097+0000 7f560a400640 1 Processor -- start 2024-09-21T00:15:15.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.097+0000 7f560a400640 1 -- start start 2024-09-21T00:15:15.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f560a400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56040ce860 0x7f5604158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:15.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f560a400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56040cefa0 0x7f56041f8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:15.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f560a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f560415b9f0 0x7f56041e9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:15.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f560a400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f560415fe70 con 0x7f56040cefa0 2024-09-21T00:15:15.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f560a400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f560415fcf0 con 0x7f56040ce860 2024-09-21T00:15:15.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f560a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f560406ddf0 con 0x7f560415b9f0 2024-09-21T00:15:15.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f55faa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56040cefa0 0x7f56041f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:15.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f55faa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56040cefa0 0x7f56041f8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44200/0 (socket says 172.21.15.83:44200) 2024-09-21T00:15:15.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f55faa00640 1 -- 172.21.15.83:0/1837980751 learned_addr learned my addr 172.21.15.83:0/1837980751 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:15.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f5603400640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56040ce860 0x7f5604158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:15.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.099+0000 7f5603e00640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f560415b9f0 0x7f56041e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:15.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.100+0000 7f55faa00640 1 -- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f560415b9f0 msgr2=0x7f56041e9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:15.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.100+0000 7f55faa00640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f560415b9f0 0x7f56041e9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:15.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.100+0000 7f55faa00640 1 -- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56040ce860 msgr2=0x7f5604158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:15.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.100+0000 7f55faa00640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56040ce860 0x7f5604158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:15.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.100+0000 7f55faa00640 1 -- 172.21.15.83:0/1837980751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560415dd50 con 0x7f56040cefa0 2024-09-21T00:15:15.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.100+0000 7f55faa00640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56040cefa0 0x7f56041f8760 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55ec000c00 tx=0x7f55ec003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:15.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.100+0000 7f55fbe00640 1 -- 172.21.15.83:0/1837980751 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec03e030 con 0x7f56040cefa0 2024-09-21T00:15:15.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.101+0000 7f560a400640 1 -- 172.21.15.83:0/1837980751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56040b5330 con 0x7f56040cefa0 2024-09-21T00:15:15.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.101+0000 7f55fbe00640 1 -- 172.21.15.83:0/1837980751 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55ec003e00 con 0x7f56040cefa0 2024-09-21T00:15:15.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.101+0000 7f55fbe00640 1 -- 172.21.15.83:0/1837980751 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec035040 con 0x7f56040cefa0 2024-09-21T00:15:15.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.101+0000 7f560a400640 1 -- 172.21.15.83:0/1837980751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56041f8ca0 con 0x7f56040cefa0 2024-09-21T00:15:15.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.102+0000 7f560a400640 1 -- 172.21.15.83:0/1837980751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560415df20 con 0x7f56040cefa0 2024-09-21T00:15:15.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.103+0000 7f55fbe00640 1 -- 172.21.15.83:0/1837980751 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55ec041030 con 0x7f56040cefa0 2024-09-21T00:15:15.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.104+0000 7f55fbe00640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f55e0078bc0 0x7f55e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:15.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.104+0000 7f55fbe00640 1 -- 172.21.15.83:0/1837980751 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5619+0+0 (secure 0 0 0) 0x7f55ec0bb550 con 0x7f56040cefa0 2024-09-21T00:15:15.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.105+0000 7f5603400640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f55e0078bc0 0x7f55e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:15.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.105+0000 7f5603400640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f55e0078bc0 0x7f55e007b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f55f4005fd0 tx=0x7f55f40095e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:15.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.109+0000 7f55fbe00640 1 -- 172.21.15.83:0/1837980751 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f560415df20 con 0x7f56040cefa0 2024-09-21T00:15:15.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.295+0000 7f560a400640 1 -- 172.21.15.83:0/1837980751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f56040a13c0 con 0x7f56040cefa0 2024-09-21T00:15:15.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.843+0000 7f55fbe00640 1 -- 172.21.15.83:0/1837980751 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) ==== 170+0+0 (secure 0 0 0) 0x7f55ec083300 con 0x7f56040cefa0 2024-09-21T00:15:15.844 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' created 2024-09-21T00:15:15.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 -- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f55e0078bc0 msgr2=0x7f55e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f55e0078bc0 0x7f55e007b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f55f4005fd0 tx=0x7f55f40095e0 comp rx=0 tx=0).stop 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 -- 172.21.15.83:0/1837980751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56040cefa0 msgr2=0x7f56041f8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56040cefa0 0x7f56041f8760 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55ec000c00 tx=0x7f55ec003910 comp rx=0 tx=0).stop 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 -- 172.21.15.83:0/1837980751 shutdown_connections 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f55e0078bc0 0x7f55e007b0d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f560415b9f0 0x7f56041e9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56040cefa0 0x7f56041f8760 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 --2- 172.21.15.83:0/1837980751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56040ce860 0x7f5604158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 -- 172.21.15.83:0/1837980751 >> 172.21.15.83:0/1837980751 conn(0x7f56040cca40 msgr2=0x7f56040ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 -- 172.21.15.83:0/1837980751 shutdown_connections 2024-09-21T00:15:15.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:15.846+0000 7f560a400640 1 -- 172.21.15.83:0/1837980751 wait complete. 2024-09-21T00:15:15.885 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T00:15:16.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.107+0000 7f30bf200640 1 -- 172.21.15.83:0/1946899843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b8156a50 msgr2=0x7f30b8074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:16.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.107+0000 7f30bf200640 1 --2- 172.21.15.83:0/1946899843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b8156a50 0x7f30b8074620 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f30a8005fd0 tx=0x7f30a802a5d0 comp rx=0 tx=0).stop 2024-09-21T00:15:16.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.107+0000 7f30bf200640 1 -- 172.21.15.83:0/1946899843 shutdown_connections 2024-09-21T00:15:16.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.107+0000 7f30bf200640 1 --2- 172.21.15.83:0/1946899843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b806e500 0x7f30b80cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:16.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.107+0000 7f30bf200640 1 --2- 172.21.15.83:0/1946899843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b8156a50 0x7f30b8074620 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:16.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.107+0000 7f30bf200640 1 -- 172.21.15.83:0/1946899843 >> 172.21.15.83:0/1946899843 conn(0x7f30b80b1b90 msgr2=0x7f30b80b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:16.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.107+0000 7f30bf200640 1 -- 172.21.15.83:0/1946899843 shutdown_connections 2024-09-21T00:15:16.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.107+0000 7f30bf200640 1 -- 172.21.15.83:0/1946899843 wait complete. 2024-09-21T00:15:16.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.109+0000 7f30bf200640 1 Processor -- start 2024-09-21T00:15:16.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.110+0000 7f30bf200640 1 -- start start 2024-09-21T00:15:16.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.111+0000 7f30bf200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b8074b60 0x7f30b80cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:16.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.111+0000 7f30bf200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b8156a50 0x7f30b809edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:16.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.111+0000 7f30bf200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80a0b70 0x7f30b80cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:16.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.111+0000 7f30bf200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f30b80cf7d0 con 0x7f30b8156a50 2024-09-21T00:15:16.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.111+0000 7f30bf200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f30b80cf650 con 0x7f30b8074b60 2024-09-21T00:15:16.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.111+0000 7f30bf200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f30b80cf950 con 0x7f30b80a0b70 2024-09-21T00:15:16.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.111+0000 7f30b7400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b8156a50 0x7f30b809edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:16.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.111+0000 7f30b7400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b8156a50 0x7f30b809edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44206/0 (socket says 172.21.15.83:44206) 2024-09-21T00:15:16.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.111+0000 7f30b7400640 1 -- 172.21.15.83:0/1374956392 learned_addr learned my addr 172.21.15.83:0/1374956392 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:16.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30b7e00640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b8074b60 0x7f30b80cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:16.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30bd200640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80a0b70 0x7f30b80cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:16.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30b7400640 1 -- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80a0b70 msgr2=0x7f30b80cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:16.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30b7400640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80a0b70 0x7f30b80cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:16.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30b7400640 1 -- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b8074b60 msgr2=0x7f30b80cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:16.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30b7400640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b8074b60 0x7f30b80cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:16.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30b7400640 1 -- 172.21.15.83:0/1374956392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b81f54d0 con 0x7f30b8156a50 2024-09-21T00:15:16.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30b7400640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b8156a50 0x7f30b809edf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f30a400c3a0 tx=0x7f30a400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:16.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30afe00640 1 -- 172.21.15.83:0/1374956392 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4017070 con 0x7f30b8156a50 2024-09-21T00:15:16.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30afe00640 1 -- 172.21.15.83:0/1374956392 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30a40053c0 con 0x7f30b8156a50 2024-09-21T00:15:16.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30bf200640 1 -- 172.21.15.83:0/1374956392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b81f57b0 con 0x7f30b8156a50 2024-09-21T00:15:16.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.112+0000 7f30afe00640 1 -- 172.21.15.83:0/1374956392 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4003850 con 0x7f30b8156a50 2024-09-21T00:15:16.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.113+0000 7f30bf200640 1 -- 172.21.15.83:0/1374956392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b80ca790 con 0x7f30b8156a50 2024-09-21T00:15:16.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.114+0000 7f30bf200640 1 -- 172.21.15.83:0/1374956392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b81f5240 con 0x7f30b8156a50 2024-09-21T00:15:16.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.115+0000 7f30afe00640 1 -- 172.21.15.83:0/1374956392 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30a401a070 con 0x7f30b8156a50 2024-09-21T00:15:16.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.116+0000 7f30afe00640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3098078b90 0x7f309807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:16.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.116+0000 7f30afe00640 1 -- 172.21.15.83:0/1374956392 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6001+0+0 (secure 0 0 0) 0x7f30a409a090 con 0x7f30b8156a50 2024-09-21T00:15:16.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.116+0000 7f30b7e00640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3098078b90 0x7f309807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:16.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.117+0000 7f30b7e00640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3098078b90 0x7f309807b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f30a8033000 tx=0x7f30a8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:16.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.121+0000 7f30afe00640 1 -- 172.21.15.83:0/1374956392 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f30a4061dd0 con 0x7f30b8156a50 2024-09-21T00:15:16.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.341+0000 7f30bf200640 1 -- 172.21.15.83:0/1374956392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f30b80cef00 con 0x7f30b8156a50 2024-09-21T00:15:16.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.846+0000 7f30afe00640 1 -- 172.21.15.83:0/1374956392 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f30a4066800 con 0x7f30b8156a50 2024-09-21T00:15:16.847 INFO:teuthology.orchestra.run.smithi083.stderr:new fs with metadata pool 5 and data pool 6 2024-09-21T00:15:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.849+0000 7f30bf200640 1 -- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3098078b90 msgr2=0x7f309807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.849+0000 7f30bf200640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3098078b90 0x7f309807b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f30a8033000 tx=0x7f30a8004730 comp rx=0 tx=0).stop 2024-09-21T00:15:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.849+0000 7f30bf200640 1 -- 172.21.15.83:0/1374956392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b8156a50 msgr2=0x7f30b809edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.849+0000 7f30bf200640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b8156a50 0x7f30b809edf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f30a400c3a0 tx=0x7f30a400c860 comp rx=0 tx=0).stop 2024-09-21T00:15:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.850+0000 7f30bf200640 1 -- 172.21.15.83:0/1374956392 shutdown_connections 2024-09-21T00:15:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.850+0000 7f30bf200640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3098078b90 0x7f309807b0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.850+0000 7f30bf200640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b80a0b70 0x7f30b80cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.850+0000 7f30bf200640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b8156a50 0x7f30b809edf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.850+0000 7f30bf200640 1 --2- 172.21.15.83:0/1374956392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b8074b60 0x7f30b80cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.850+0000 7f30bf200640 1 -- 172.21.15.83:0/1374956392 >> 172.21.15.83:0/1374956392 conn(0x7f30b80b1b90 msgr2=0x7f30b80b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.852+0000 7f30bf200640 1 -- 172.21.15.83:0/1374956392 shutdown_connections 2024-09-21T00:15:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:16.852+0000 7f30bf200640 1 -- 172.21.15.83:0/1374956392 wait complete. 2024-09-21T00:15:16.903 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:15:17.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.123+0000 7f8716000640 1 -- 172.21.15.83:0/2637853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8710074cb0 msgr2=0x7f8710073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:17.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.123+0000 7f8716000640 1 --2- 172.21.15.83:0/2637853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8710074cb0 0x7f8710073dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f871015d980 tx=0x7f870002a5f0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.123+0000 7f8716000640 1 -- 172.21.15.83:0/2637853 shutdown_connections 2024-09-21T00:15:17.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.123+0000 7f8716000640 1 --2- 172.21.15.83:0/2637853 >> v2:172.21.15.142:3300/0 conn(0x7f871006e500 0x7f87100cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.123+0000 7f8716000640 1 --2- 172.21.15.83:0/2637853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8710074cb0 0x7f8710073dd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.123+0000 7f8716000640 1 -- 172.21.15.83:0/2637853 >> 172.21.15.83:0/2637853 conn(0x7f87100cca40 msgr2=0x7f87100cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:17.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.123+0000 7f8716000640 1 -- 172.21.15.83:0/2637853 shutdown_connections 2024-09-21T00:15:17.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.123+0000 7f8716000640 1 -- 172.21.15.83:0/2637853 wait complete. 2024-09-21T00:15:17.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.125+0000 7f8716000640 1 Processor -- start 2024-09-21T00:15:17.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.125+0000 7f8716000640 1 -- start start 2024-09-21T00:15:17.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.127+0000 7f8716000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8710074cb0 0x7f8710155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:17.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.127+0000 7f8716000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87100cbc10 0x7f87101f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:17.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.127+0000 7f8716000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87100c7ed0 0x7f87101f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:17.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.127+0000 7f8716000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f871006f360 con 0x7f87100c7ed0 2024-09-21T00:15:17.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.127+0000 7f8716000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f871006f1e0 con 0x7f87100cbc10 2024-09-21T00:15:17.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.127+0000 7f8716000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f871006f4e0 con 0x7f8710074cb0 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.127+0000 7f870fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87100c7ed0 0x7f87101f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.127+0000 7f870fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87100c7ed0 0x7f87101f6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44216/0 (socket says 172.21.15.83:44216) 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.127+0000 7f870fe00640 1 -- 172.21.15.83:0/450788854 learned_addr learned my addr 172.21.15.83:0/450788854 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.127+0000 7f870f400640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8710074cb0 0x7f8710155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.128+0000 7f8706a00640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87100cbc10 0x7f87101f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.128+0000 7f870fe00640 1 -- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8710074cb0 msgr2=0x7f8710155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.128+0000 7f870fe00640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8710074cb0 0x7f8710155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.128+0000 7f870fe00640 1 -- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87100cbc10 msgr2=0x7f87101f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.128+0000 7f870fe00640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87100cbc10 0x7f87101f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.128+0000 7f870fe00640 1 -- 172.21.15.83:0/450788854 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87100c8640 con 0x7f87100c7ed0 2024-09-21T00:15:17.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.128+0000 7f870fe00640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87100c7ed0 0x7f87101f6a50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f870800e990 tx=0x7f870800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:17.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.128+0000 7f8707e00640 1 -- 172.21.15.83:0/450788854 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708004d20 con 0x7f87100c7ed0 2024-09-21T00:15:17.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.129+0000 7f8707e00640 1 -- 172.21.15.83:0/450788854 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f870800caa0 con 0x7f87100c7ed0 2024-09-21T00:15:17.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.129+0000 7f8716000640 1 -- 172.21.15.83:0/450788854 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87100c8920 con 0x7f87100c7ed0 2024-09-21T00:15:17.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.129+0000 7f8707e00640 1 -- 172.21.15.83:0/450788854 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708005020 con 0x7f87100c7ed0 2024-09-21T00:15:17.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.129+0000 7f8716000640 1 -- 172.21.15.83:0/450788854 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87100c8ee0 con 0x7f87100c7ed0 2024-09-21T00:15:17.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.130+0000 7f8716000640 1 -- 172.21.15.83:0/450788854 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8710073110 con 0x7f87100c7ed0 2024-09-21T00:15:17.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.131+0000 7f8707e00640 1 -- 172.21.15.83:0/450788854 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f87080051c0 con 0x7f87100c7ed0 2024-09-21T00:15:17.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.132+0000 7f8707e00640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f86ec078b90 0x7f86ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:17.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.132+0000 7f8707e00640 1 -- 172.21.15.83:0/450788854 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f870809b710 con 0x7f87100c7ed0 2024-09-21T00:15:17.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.132+0000 7f870f400640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f86ec078b90 0x7f86ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:17.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.133+0000 7f870f400640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f86ec078b90 0x7f86ec07b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8700033000 tx=0x7f8700004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:17.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.136+0000 7f8707e00640 1 -- 172.21.15.83:0/450788854 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8710073110 con 0x7f87100c7ed0 2024-09-21T00:15:17.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.323+0000 7f8716000640 1 -- 172.21.15.83:0/450788854 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f871006f990 con 0x7f87100c7ed0 2024-09-21T00:15:17.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.325+0000 7f8707e00640 1 -- 172.21.15.83:0/450788854 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17039 (secure 0 0 0) 0x7f8708016030 con 0x7f87100c7ed0 2024-09-21T00:15:17.326 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:17.326 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":40,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:15:16.342761+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:15:14.312079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T00:15:15.307562+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 -- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f86ec078b90 msgr2=0x7f86ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f86ec078b90 0x7f86ec07b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8700033000 tx=0x7f8700004730 comp rx=0 tx=0).stop 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 -- 172.21.15.83:0/450788854 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87100c7ed0 msgr2=0x7f87101f6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87100c7ed0 0x7f87101f6a50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f870800e990 tx=0x7f870800ee50 comp rx=0 tx=0).stop 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 -- 172.21.15.83:0/450788854 shutdown_connections 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f86ec078b90 0x7f86ec07b0a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87100c7ed0 0x7f87101f6a50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87100cbc10 0x7f87101f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 --2- 172.21.15.83:0/450788854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8710074cb0 0x7f8710155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 -- 172.21.15.83:0/450788854 >> 172.21.15.83:0/450788854 conn(0x7f87100cca40 msgr2=0x7f871015a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 -- 172.21.15.83:0/450788854 shutdown_connections 2024-09-21T00:15:17.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.327+0000 7f8716000640 1 -- 172.21.15.83:0/450788854 wait complete. 2024-09-21T00:15:17.350 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:15:17.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.569+0000 7fefcd200640 1 -- 172.21.15.83:0/4123690041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefc8073dd0 msgr2=0x7fefc815c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:17.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.569+0000 7fefcd200640 1 --2- 172.21.15.83:0/4123690041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefc8073dd0 0x7fefc815c3b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fefc8070ff0 tx=0x7fefb802a5f0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.569+0000 7fefcd200640 1 -- 172.21.15.83:0/4123690041 shutdown_connections 2024-09-21T00:15:17.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.569+0000 7fefcd200640 1 --2- 172.21.15.83:0/4123690041 >> v2:172.21.15.142:3300/0 conn(0x7fefc806def0 0x7fefc806e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.569+0000 7fefcd200640 1 --2- 172.21.15.83:0/4123690041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefc8073dd0 0x7fefc815c3b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.569+0000 7fefcd200640 1 -- 172.21.15.83:0/4123690041 >> 172.21.15.83:0/4123690041 conn(0x7fefc806f940 msgr2=0x7fefc80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:17.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.569+0000 7fefcd200640 1 -- 172.21.15.83:0/4123690041 shutdown_connections 2024-09-21T00:15:17.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.569+0000 7fefcd200640 1 -- 172.21.15.83:0/4123690041 wait complete. 2024-09-21T00:15:17.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.571+0000 7fefcd200640 1 Processor -- start 2024-09-21T00:15:17.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.571+0000 7fefcd200640 1 -- start start 2024-09-21T00:15:17.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefcd200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefc806def0 0x7fefc813f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:17.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefcd200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefc8073dd0 0x7fefc80afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:17.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefcd200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefc8152530 0x7fefc815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:17.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefcd200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fefc80cf5b0 con 0x7fefc806def0 2024-09-21T00:15:17.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefcd200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fefc80cf430 con 0x7fefc8073dd0 2024-09-21T00:15:17.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefcd200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fefc80cf730 con 0x7fefc8152530 2024-09-21T00:15:17.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefc7400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefc806def0 0x7fefc813f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:17.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefc7400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefc806def0 0x7fefc813f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44232/0 (socket says 172.21.15.83:44232) 2024-09-21T00:15:17.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefc7400640 1 -- 172.21.15.83:0/3759376802 learned_addr learned my addr 172.21.15.83:0/3759376802 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:17.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefc7e00640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefc8152530 0x7fefc815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:17.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefbea00640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefc8073dd0 0x7fefc80afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:17.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefc7400640 1 -- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefc8152530 msgr2=0x7fefc815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:17.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefc7400640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefc8152530 0x7fefc815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefc7400640 1 -- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefc8073dd0 msgr2=0x7fefc80afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:17.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefc7400640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefc8073dd0 0x7fefc80afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefc7400640 1 -- 172.21.15.83:0/3759376802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc813fe90 con 0x7fefc806def0 2024-09-21T00:15:17.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.573+0000 7fefc7e00640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefc8152530 0x7fefc815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:17.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.574+0000 7fefc7400640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefc806def0 0x7fefc813f950 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fefb80099c0 tx=0x7fefb80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:17.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.574+0000 7fefbfe00640 1 -- 172.21.15.83:0/3759376802 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb803e030 con 0x7fefc806def0 2024-09-21T00:15:17.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.574+0000 7fefbfe00640 1 -- 172.21.15.83:0/3759376802 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefb80047a0 con 0x7fefc806def0 2024-09-21T00:15:17.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.574+0000 7fefbfe00640 1 -- 172.21.15.83:0/3759376802 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8035040 con 0x7fefc806def0 2024-09-21T00:15:17.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.574+0000 7fefcd200640 1 -- 172.21.15.83:0/3759376802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc80b0920 con 0x7fefc806def0 2024-09-21T00:15:17.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.574+0000 7fefcd200640 1 -- 172.21.15.83:0/3759376802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc80b0ee0 con 0x7fefc806def0 2024-09-21T00:15:17.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.575+0000 7fefcd200640 1 -- 172.21.15.83:0/3759376802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc80cd3f0 con 0x7fefc806def0 2024-09-21T00:15:17.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.576+0000 7fefbfe00640 1 -- 172.21.15.83:0/3759376802 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fefb8041030 con 0x7fefc806def0 2024-09-21T00:15:17.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.577+0000 7fefbfe00640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fefa4078b90 0x7fefa407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:17.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.577+0000 7fefbfe00640 1 -- 172.21.15.83:0/3759376802 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fefb80bb760 con 0x7fefc806def0 2024-09-21T00:15:17.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.578+0000 7fefbea00640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fefa4078b90 0x7fefa407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:17.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.578+0000 7fefbea00640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fefa4078b90 0x7fefa407b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fefc81511f0 tx=0x7fefb0009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:17.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.582+0000 7fefbfe00640 1 -- 172.21.15.83:0/3759376802 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fefc80cd3f0 con 0x7fefc806def0 2024-09-21T00:15:17.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.768+0000 7fefcd200640 1 -- 172.21.15.83:0/3759376802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fefc80cfc50 con 0x7fefc806def0 2024-09-21T00:15:17.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.769+0000 7fefbfe00640 1 -- 172.21.15.83:0/3759376802 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17039 (secure 0 0 0) 0x7fefb8083970 con 0x7fefc806def0 2024-09-21T00:15:17.771 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:17.771 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":40,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:15:16.342761+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:15:14.312079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T00:15:15.307562+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.771+0000 7fefcd200640 1 -- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fefa4078b90 msgr2=0x7fefa407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.771+0000 7fefcd200640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fefa4078b90 0x7fefa407b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fefc81511f0 tx=0x7fefb0009040 comp rx=0 tx=0).stop 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.771+0000 7fefcd200640 1 -- 172.21.15.83:0/3759376802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefc806def0 msgr2=0x7fefc813f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.771+0000 7fefcd200640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefc806def0 0x7fefc813f950 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fefb80099c0 tx=0x7fefb80039e0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.771+0000 7fefcd200640 1 -- 172.21.15.83:0/3759376802 shutdown_connections 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.771+0000 7fefcd200640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fefa4078b90 0x7fefa407b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.771+0000 7fefcd200640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefc8152530 0x7fefc815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.771+0000 7fefcd200640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefc8073dd0 0x7fefc80afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.771+0000 7fefcd200640 1 --2- 172.21.15.83:0/3759376802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefc806def0 0x7fefc813f950 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.772+0000 7fefcd200640 1 -- 172.21.15.83:0/3759376802 >> 172.21.15.83:0/3759376802 conn(0x7fefc806f940 msgr2=0x7fefc806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.772+0000 7fefcd200640 1 -- 172.21.15.83:0/3759376802 shutdown_connections 2024-09-21T00:15:17.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:17.772+0000 7fefcd200640 1 -- 172.21.15.83:0/3759376802 wait complete. 2024-09-21T00:15:17.795 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T00:15:18.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.020+0000 7fc181e00640 1 -- 172.21.15.83:0/3586605018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc17c06e370 msgr2=0x7fc17c0b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:18.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.020+0000 7fc181e00640 1 --2- 172.21.15.83:0/3586605018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc17c06e370 0x7fc17c0b4f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0b2c60 tx=0x7fc16c02a560 comp rx=0 tx=0).stop 2024-09-21T00:15:18.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.020+0000 7fc181e00640 1 -- 172.21.15.83:0/3586605018 shutdown_connections 2024-09-21T00:15:18.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.020+0000 7fc181e00640 1 --2- 172.21.15.83:0/3586605018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc17c0cc8b0 0x7fc17c0cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:18.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.020+0000 7fc181e00640 1 --2- 172.21.15.83:0/3586605018 >> v2:172.21.15.142:3300/0 conn(0x7fc17c156c60 0x7fc17c0cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:18.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.020+0000 7fc181e00640 1 --2- 172.21.15.83:0/3586605018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc17c06e370 0x7fc17c0b4f90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:18.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.020+0000 7fc181e00640 1 -- 172.21.15.83:0/3586605018 >> 172.21.15.83:0/3586605018 conn(0x7fc17c06f920 msgr2=0x7fc17c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:18.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.020+0000 7fc181e00640 1 -- 172.21.15.83:0/3586605018 shutdown_connections 2024-09-21T00:15:18.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.020+0000 7fc181e00640 1 -- 172.21.15.83:0/3586605018 wait complete. 2024-09-21T00:15:18.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.023+0000 7fc181e00640 1 Processor -- start 2024-09-21T00:15:18.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.023+0000 7fc181e00640 1 -- start start 2024-09-21T00:15:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.024+0000 7fc181e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc17c06e370 0x7fc17c159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.024+0000 7fc181e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc17c0cc8b0 0x7fc17c1f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.024+0000 7fc181e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17c156c60 0x7fc17c145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.024+0000 7fc181e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c06d450 con 0x7fc17c06e370 2024-09-21T00:15:18.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.024+0000 7fc181e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c06d2d0 con 0x7fc17c156c60 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.024+0000 7fc181e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc17c06d5d0 con 0x7fc17c0cc8b0 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.024+0000 7fc180a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc17c06e370 0x7fc17c159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.024+0000 7fc180a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc17c06e370 0x7fc17c159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44254/0 (socket says 172.21.15.83:44254) 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.024+0000 7fc180a00640 1 -- 172.21.15.83:0/2555058145 learned_addr learned my addr 172.21.15.83:0/2555058145 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.025+0000 7fc173e00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc17c0cc8b0 0x7fc17c1f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.025+0000 7fc181400640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17c156c60 0x7fc17c145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.025+0000 7fc180a00640 1 -- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc17c0cc8b0 msgr2=0x7fc17c1f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.025+0000 7fc180a00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc17c0cc8b0 0x7fc17c1f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.025+0000 7fc180a00640 1 -- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17c156c60 msgr2=0x7fc17c145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.025+0000 7fc180a00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17c156c60 0x7fc17c145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.025+0000 7fc180a00640 1 -- 172.21.15.83:0/2555058145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c0afae0 con 0x7fc17c06e370 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.025+0000 7fc181400640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17c156c60 0x7fc17c145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:18.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.025+0000 7fc180a00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc17c06e370 0x7fc17c159b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc16c000c00 tx=0x7fc16c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.025+0000 7fc179600640 1 -- 172.21.15.83:0/2555058145 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c03e030 con 0x7fc17c06e370 2024-09-21T00:15:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.026+0000 7fc179600640 1 -- 172.21.15.83:0/2555058145 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc16c003e00 con 0x7fc17c06e370 2024-09-21T00:15:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.026+0000 7fc179600640 1 -- 172.21.15.83:0/2555058145 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c035040 con 0x7fc17c06e370 2024-09-21T00:15:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.026+0000 7fc181e00640 1 -- 172.21.15.83:0/2555058145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c0afdc0 con 0x7fc17c06e370 2024-09-21T00:15:18.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.026+0000 7fc181e00640 1 -- 172.21.15.83:0/2555058145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c0b0380 con 0x7fc17c06e370 2024-09-21T00:15:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.027+0000 7fc181e00640 1 -- 172.21.15.83:0/2555058145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17c06db60 con 0x7fc17c06e370 2024-09-21T00:15:18.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.028+0000 7fc179600640 1 -- 172.21.15.83:0/2555058145 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc16c041030 con 0x7fc17c06e370 2024-09-21T00:15:18.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.029+0000 7fc179600640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc158078b90 0x7fc15807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:18.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.029+0000 7fc179600640 1 -- 172.21.15.83:0/2555058145 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fc16c0bb730 con 0x7fc17c06e370 2024-09-21T00:15:18.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.029+0000 7fc173e00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc158078b90 0x7fc15807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:18.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.030+0000 7fc173e00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc158078b90 0x7fc15807b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc17c1560c0 tx=0x7fc16400b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.033+0000 7fc179600640 1 -- 172.21.15.83:0/2555058145 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc16c0832f0 con 0x7fc17c06e370 2024-09-21T00:15:18.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.258+0000 7fc181e00640 1 -- 172.21.15.83:0/2555058145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc17c074c10 con 0x7fc17c06e370 2024-09-21T00:15:18.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.888+0000 7fc179600640 1 -- 172.21.15.83:0/2555058145 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fc16c087d20 con 0x7fc17c06e370 2024-09-21T00:15:18.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.890+0000 7fc181e00640 1 -- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc158078b90 msgr2=0x7fc15807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:18.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.890+0000 7fc181e00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc158078b90 0x7fc15807b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc17c1560c0 tx=0x7fc16400b2e0 comp rx=0 tx=0).stop 2024-09-21T00:15:18.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.890+0000 7fc181e00640 1 -- 172.21.15.83:0/2555058145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc17c06e370 msgr2=0x7fc17c159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:18.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.890+0000 7fc181e00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc17c06e370 0x7fc17c159b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc16c000c00 tx=0x7fc16c003910 comp rx=0 tx=0).stop 2024-09-21T00:15:18.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.891+0000 7fc181e00640 1 -- 172.21.15.83:0/2555058145 shutdown_connections 2024-09-21T00:15:18.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.891+0000 7fc181e00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc158078b90 0x7fc15807b0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:18.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.891+0000 7fc181e00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17c156c60 0x7fc17c145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:18.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.891+0000 7fc181e00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc17c0cc8b0 0x7fc17c1f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:18.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.891+0000 7fc181e00640 1 --2- 172.21.15.83:0/2555058145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc17c06e370 0x7fc17c159b60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:18.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.891+0000 7fc181e00640 1 -- 172.21.15.83:0/2555058145 >> 172.21.15.83:0/2555058145 conn(0x7fc17c06f920 msgr2=0x7fc17c1561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:18.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.891+0000 7fc181e00640 1 -- 172.21.15.83:0/2555058145 shutdown_connections 2024-09-21T00:15:18.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:18.891+0000 7fc181e00640 1 -- 172.21.15.83:0/2555058145 wait complete. 2024-09-21T00:15:18.918 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T00:15:18.918 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T00:15:19.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.142+0000 7f3bf2600640 1 -- 172.21.15.83:0/1672735648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bec0cef00 msgr2=0x7f3bec0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:19.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.142+0000 7f3bf2600640 1 --2- 172.21.15.83:0/1672735648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bec0cef00 0x7f3bec0cf310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3be4005fd0 tx=0x7f3be402aa90 comp rx=0 tx=0).stop 2024-09-21T00:15:19.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.143+0000 7f3bf2600640 1 -- 172.21.15.83:0/1672735648 shutdown_connections 2024-09-21T00:15:19.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.143+0000 7f3bf2600640 1 --2- 172.21.15.83:0/1672735648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bec0cef00 0x7f3bec0cf310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:19.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.143+0000 7f3bf2600640 1 --2- 172.21.15.83:0/1672735648 >> v2:172.21.15.142:3300/0 conn(0x7f3bec06ddf0 0x7f3bec06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:19.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.143+0000 7f3bf2600640 1 -- 172.21.15.83:0/1672735648 >> 172.21.15.83:0/1672735648 conn(0x7f3bec0b1b90 msgr2=0x7f3bec0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:19.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.143+0000 7f3bf2600640 1 -- 172.21.15.83:0/1672735648 shutdown_connections 2024-09-21T00:15:19.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.143+0000 7f3bf2600640 1 -- 172.21.15.83:0/1672735648 wait complete. 2024-09-21T00:15:19.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.145+0000 7f3bf2600640 1 Processor -- start 2024-09-21T00:15:19.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.145+0000 7f3bf2600640 1 -- start start 2024-09-21T00:15:19.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.146+0000 7f3bf2600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bec06ddf0 0x7f3bec0b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.146+0000 7f3bf2600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bec0cef00 0x7f3bec1f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.146+0000 7f3bf2600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bec156a50 0x7f3bec15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.146+0000 7f3bf2600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec0cf850 con 0x7f3bec0cef00 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.146+0000 7f3bf2600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec161060 con 0x7f3bec06ddf0 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.146+0000 7f3bf2600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3bec0cf9d0 con 0x7f3bec156a50 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.147+0000 7f3be2a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bec0cef00 0x7f3bec1f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.147+0000 7f3be2a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bec0cef00 0x7f3bec1f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44262/0 (socket says 172.21.15.83:44262) 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.147+0000 7f3be2a00640 1 -- 172.21.15.83:0/3646651586 learned_addr learned my addr 172.21.15.83:0/3646651586 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.147+0000 7f3beb400640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bec06ddf0 0x7f3bec0b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.147+0000 7f3bebe00640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bec156a50 0x7f3bec15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.147+0000 7f3be2a00640 1 -- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bec156a50 msgr2=0x7f3bec15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.147+0000 7f3be2a00640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bec156a50 0x7f3bec15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:19.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.147+0000 7f3be2a00640 1 -- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bec06ddf0 msgr2=0x7f3bec0b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:19.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.147+0000 7f3be2a00640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bec06ddf0 0x7f3bec0b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:19.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.147+0000 7f3be2a00640 1 -- 172.21.15.83:0/3646651586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec0b3410 con 0x7f3bec0cef00 2024-09-21T00:15:19.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.148+0000 7f3be2a00640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bec0cef00 0x7f3bec1f60a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009fd0 tx=0x7f3bd400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:19.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.148+0000 7f3be3e00640 1 -- 172.21.15.83:0/3646651586 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd400ccc0 con 0x7f3bec0cef00 2024-09-21T00:15:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.148+0000 7f3be3e00640 1 -- 172.21.15.83:0/3646651586 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bd400ee70 con 0x7f3bec0cef00 2024-09-21T00:15:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.148+0000 7f3bf2600640 1 -- 172.21.15.83:0/3646651586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bec159550 con 0x7f3bec0cef00 2024-09-21T00:15:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.148+0000 7f3be3e00640 1 -- 172.21.15.83:0/3646651586 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd400ce60 con 0x7f3bec0cef00 2024-09-21T00:15:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.148+0000 7f3bf2600640 1 -- 172.21.15.83:0/3646651586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bec159b10 con 0x7f3bec0cef00 2024-09-21T00:15:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.149+0000 7f3bf2600640 1 -- 172.21.15.83:0/3646651586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bec06e200 con 0x7f3bec0cef00 2024-09-21T00:15:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.150+0000 7f3be3e00640 1 -- 172.21.15.83:0/3646651586 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3bd4005280 con 0x7f3bec0cef00 2024-09-21T00:15:19.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.151+0000 7f3be3e00640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3bc8078bc0 0x7f3bc807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:19.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.151+0000 7f3be3e00640 1 -- 172.21.15.83:0/3646651586 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f3bd409b710 con 0x7f3bec0cef00 2024-09-21T00:15:19.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.152+0000 7f3beb400640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3bc8078bc0 0x7f3bc807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:19.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.152+0000 7f3beb400640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3bc8078bc0 0x7f3bc807b0d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc001720 tx=0x7f3bdc009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:19.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.156+0000 7f3be3e00640 1 -- 172.21.15.83:0/3646651586 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3bd40632d0 con 0x7f3bec0cef00 2024-09-21T00:15:19.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.378+0000 7f3bf2600640 1 -- 172.21.15.83:0/3646651586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3bec160270 con 0x7f3bec0cef00 2024-09-21T00:15:19.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.897+0000 7f3be3e00640 1 -- 172.21.15.83:0/3646651586 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f3bd4067d00 con 0x7f3bec0cef00 2024-09-21T00:15:19.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.899+0000 7f3bf2600640 1 -- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3bc8078bc0 msgr2=0x7f3bc807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:19.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3bc8078bc0 0x7f3bc807b0d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc001720 tx=0x7f3bdc009040 comp rx=0 tx=0).stop 2024-09-21T00:15:19.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 -- 172.21.15.83:0/3646651586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bec0cef00 msgr2=0x7f3bec1f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:19.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bec0cef00 0x7f3bec1f60a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009fd0 tx=0x7f3bd400ec20 comp rx=0 tx=0).stop 2024-09-21T00:15:19.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 -- 172.21.15.83:0/3646651586 shutdown_connections 2024-09-21T00:15:19.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3bc8078bc0 0x7f3bc807b0d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:19.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bec156a50 0x7f3bec15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:19.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bec0cef00 0x7f3bec1f60a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:19.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 --2- 172.21.15.83:0/3646651586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bec06ddf0 0x7f3bec0b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:19.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 -- 172.21.15.83:0/3646651586 >> 172.21.15.83:0/3646651586 conn(0x7f3bec0b1b90 msgr2=0x7f3bec06d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:19.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 -- 172.21.15.83:0/3646651586 shutdown_connections 2024-09-21T00:15:19.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:19.900+0000 7f3bf2600640 1 -- 172.21.15.83:0/3646651586 wait complete. 2024-09-21T00:15:19.924 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T00:15:19.924 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:20.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.142+0000 7fa047c00640 1 -- 172.21.15.83:0/2467209265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0400cbc10 msgr2=0x7fa0400cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:20.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.142+0000 7fa047c00640 1 --2- 172.21.15.83:0/2467209265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0400cbc10 0x7fa0400cc020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa02c005fd0 tx=0x7fa02c02a5d0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.142+0000 7fa047c00640 1 -- 172.21.15.83:0/2467209265 shutdown_connections 2024-09-21T00:15:20.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.142+0000 7fa047c00640 1 --2- 172.21.15.83:0/2467209265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0400cbc10 0x7fa0400cc020 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.142+0000 7fa047c00640 1 --2- 172.21.15.83:0/2467209265 >> v2:172.21.15.142:3300/0 conn(0x7fa040074cb0 0x7fa040073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.142+0000 7fa047c00640 1 -- 172.21.15.83:0/2467209265 >> 172.21.15.83:0/2467209265 conn(0x7fa0400cca40 msgr2=0x7fa0400cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:20.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.142+0000 7fa047c00640 1 -- 172.21.15.83:0/2467209265 shutdown_connections 2024-09-21T00:15:20.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.142+0000 7fa047c00640 1 -- 172.21.15.83:0/2467209265 wait complete. 2024-09-21T00:15:20.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.144+0000 7fa047c00640 1 Processor -- start 2024-09-21T00:15:20.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.144+0000 7fa047c00640 1 -- start start 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.146+0000 7fa047c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04006ddf0 0x7fa0401f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.146+0000 7fa047c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa040074cb0 0x7fa040158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.146+0000 7fa047c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0400cbc10 0x7fa0400cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.146+0000 7fa047c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa04006f360 con 0x7fa0400cbc10 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.146+0000 7fa047c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa04006f1e0 con 0x7fa04006ddf0 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.146+0000 7fa047c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa04006f4e0 con 0x7fa040074cb0 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.146+0000 7fa045c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0400cbc10 0x7fa0400cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.146+0000 7fa045c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0400cbc10 0x7fa0400cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44278/0 (socket says 172.21.15.83:44278) 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.146+0000 7fa045c00640 1 -- 172.21.15.83:0/721726637 learned_addr learned my addr 172.21.15.83:0/721726637 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.146+0000 7fa03fe00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa040074cb0 0x7fa040158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:20.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa045200640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04006ddf0 0x7fa0401f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:20.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa045c00640 1 -- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa040074cb0 msgr2=0x7fa040158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:20.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa045c00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa040074cb0 0x7fa040158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa045c00640 1 -- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04006ddf0 msgr2=0x7fa0401f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:20.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa045c00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04006ddf0 0x7fa0401f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa045c00640 1 -- 172.21.15.83:0/721726637 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa040158ca0 con 0x7fa0400cbc10 2024-09-21T00:15:20.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa045c00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0400cbc10 0x7fa0400cf590 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c760 tx=0x7fa03800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:20.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa03cc00640 1 -- 172.21.15.83:0/721726637 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038003b70 con 0x7fa0400cbc10 2024-09-21T00:15:20.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa03cc00640 1 -- 172.21.15.83:0/721726637 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa038003d30 con 0x7fa0400cbc10 2024-09-21T00:15:20.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa03cc00640 1 -- 172.21.15.83:0/721726637 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03800aab0 con 0x7fa0400cbc10 2024-09-21T00:15:20.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa047c00640 1 -- 172.21.15.83:0/721726637 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0400cb410 con 0x7fa0400cbc10 2024-09-21T00:15:20.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.147+0000 7fa047c00640 1 -- 172.21.15.83:0/721726637 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0401f5af0 con 0x7fa0400cbc10 2024-09-21T00:15:20.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.148+0000 7fa047c00640 1 -- 172.21.15.83:0/721726637 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0400cb180 con 0x7fa0400cbc10 2024-09-21T00:15:20.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.150+0000 7fa03cc00640 1 -- 172.21.15.83:0/721726637 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa03800ac50 con 0x7fa0400cbc10 2024-09-21T00:15:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.151+0000 7fa03cc00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa020078b90 0x7fa02007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.151+0000 7fa03cc00640 1 -- 172.21.15.83:0/721726637 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fa03809acb0 con 0x7fa0400cbc10 2024-09-21T00:15:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.151+0000 7fa045200640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa020078b90 0x7fa02007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:20.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.152+0000 7fa045200640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa020078b90 0x7fa02007b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa04015a730 tx=0x7fa034005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.155+0000 7fa03cc00640 1 -- 172.21.15.83:0/721726637 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa038062f50 con 0x7fa0400cbc10 2024-09-21T00:15:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.378+0000 7fa047c00640 1 -- 172.21.15.83:0/721726637 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0400cb930 con 0x7fa0400cbc10 2024-09-21T00:15:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.378+0000 7fa03cc00640 1 -- 172.21.15.83:0/721726637 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7fa0400cb930 con 0x7fa0400cbc10 2024-09-21T00:15:20.381 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:20.381 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":18,"btime":"2024-09-21T00:15:19:889534+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2168701718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2168701718},{"type":"v1","addr":"172.21.15.142:6836","nonce":2168701718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/399437337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":399437337},{"type":"v1","addr":"172.21.15.83:6835","nonce":399437337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4915,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/683491362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":683491362},{"type":"v1","addr":"172.21.15.83:6834","nonce":683491362}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:15:16.342714+0000","modified":"2024-09-21T00:15:19.380367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4918},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4918":{"gid":4918,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1450693530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1450693530},{"type":"v1","addr":"172.21.15.142:6837","nonce":1450693530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4918,"qdb_cluster":[4918]},"id":2}]} 2024-09-21T00:15:20.381 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 18 2024-09-21T00:15:20.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 -- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa020078b90 msgr2=0x7fa02007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:20.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa020078b90 0x7fa02007b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa04015a730 tx=0x7fa034005f90 comp rx=0 tx=0).stop 2024-09-21T00:15:20.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 -- 172.21.15.83:0/721726637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0400cbc10 msgr2=0x7fa0400cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:20.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0400cbc10 0x7fa0400cf590 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c760 tx=0x7fa03800cc20 comp rx=0 tx=0).stop 2024-09-21T00:15:20.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 -- 172.21.15.83:0/721726637 shutdown_connections 2024-09-21T00:15:20.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa020078b90 0x7fa02007b0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0400cbc10 0x7fa0400cf590 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa040074cb0 0x7fa040158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 --2- 172.21.15.83:0/721726637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04006ddf0 0x7fa0401f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 -- 172.21.15.83:0/721726637 >> 172.21.15.83:0/721726637 conn(0x7fa0400cca40 msgr2=0x7fa04015b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:20.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 -- 172.21.15.83:0/721726637 shutdown_connections 2024-09-21T00:15:20.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.381+0000 7fa047c00640 1 -- 172.21.15.83:0/721726637 wait complete. 2024-09-21T00:15:20.405 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:15:20.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.624+0000 7f1a21a00640 1 -- 172.21.15.83:0/575752806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a1c06e330 msgr2=0x7f1a1c1623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:20.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.624+0000 7f1a21a00640 1 --2- 172.21.15.83:0/575752806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a1c06e330 0x7f1a1c1623a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c075b90 tx=0x7f1a1402aa50 comp rx=0 tx=0).stop 2024-09-21T00:15:20.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.624+0000 7f1a21a00640 1 -- 172.21.15.83:0/575752806 shutdown_connections 2024-09-21T00:15:20.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.624+0000 7f1a21a00640 1 --2- 172.21.15.83:0/575752806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a1c06e330 0x7f1a1c1623a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.624+0000 7f1a21a00640 1 --2- 172.21.15.83:0/575752806 >> v2:172.21.15.142:3300/0 conn(0x7f1a1c15e7c0 0x7f1a1c06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.624+0000 7f1a21a00640 1 --2- 172.21.15.83:0/575752806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c0cb750 0x7f1a1c0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.624+0000 7f1a21a00640 1 -- 172.21.15.83:0/575752806 >> 172.21.15.83:0/575752806 conn(0x7f1a1c0cca40 msgr2=0x7f1a1c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:20.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.624+0000 7f1a21a00640 1 -- 172.21.15.83:0/575752806 shutdown_connections 2024-09-21T00:15:20.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.624+0000 7f1a21a00640 1 -- 172.21.15.83:0/575752806 wait complete. 2024-09-21T00:15:20.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.627+0000 7f1a21a00640 1 Processor -- start 2024-09-21T00:15:20.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.627+0000 7f1a21a00640 1 -- start start 2024-09-21T00:15:20.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.628+0000 7f1a21a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a1c06e330 0x7f1a1c1f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:20.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.628+0000 7f1a21a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15e7c0 0x7f1a1c15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:20.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.628+0000 7f1a21a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a1c15c300 0x7f1a1c15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:20.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.628+0000 7f1a21a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c162a60 con 0x7f1a1c15c300 2024-09-21T00:15:20.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.628+0000 7f1a21a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c1628e0 con 0x7f1a1c06e330 2024-09-21T00:15:20.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.628+0000 7f1a21a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1c162be0 con 0x7f1a1c15e7c0 2024-09-21T00:15:20.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a1b400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a1c15c300 0x7f1a1c15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:20.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a1b400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a1c15c300 0x7f1a1c15eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44298/0 (socket says 172.21.15.83:44298) 2024-09-21T00:15:20.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a1b400640 1 -- 172.21.15.83:0/318352922 learned_addr learned my addr 172.21.15.83:0/318352922 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:20.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a12000640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15e7c0 0x7f1a1c15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:20.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a1aa00640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a1c06e330 0x7f1a1c1f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:20.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a1b400640 1 -- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15e7c0 msgr2=0x7f1a1c15bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:20.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a1b400640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15e7c0 0x7f1a1c15bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a1b400640 1 -- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a1c06e330 msgr2=0x7f1a1c1f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:20.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a1b400640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a1c06e330 0x7f1a1c1f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a1b400640 1 -- 172.21.15.83:0/318352922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c0b5960 con 0x7f1a1c15c300 2024-09-21T00:15:20.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.629+0000 7f1a1b400640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a1c15c300 0x7f1a1c15eea0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a14006010 tx=0x7f1a14003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:20.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.630+0000 7f1a13400640 1 -- 172.21.15.83:0/318352922 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a14046070 con 0x7f1a1c15c300 2024-09-21T00:15:20.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.630+0000 7f1a13400640 1 -- 172.21.15.83:0/318352922 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a14004340 con 0x7f1a1c15c300 2024-09-21T00:15:20.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.630+0000 7f1a13400640 1 -- 172.21.15.83:0/318352922 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a14033070 con 0x7f1a1c15c300 2024-09-21T00:15:20.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.630+0000 7f1a21a00640 1 -- 172.21.15.83:0/318352922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1c0b5c00 con 0x7f1a1c15c300 2024-09-21T00:15:20.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.630+0000 7f1a21a00640 1 -- 172.21.15.83:0/318352922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1c160250 con 0x7f1a1c15c300 2024-09-21T00:15:20.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.631+0000 7f1a21a00640 1 -- 172.21.15.83:0/318352922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a1c1630d0 con 0x7f1a1c15c300 2024-09-21T00:15:20.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.632+0000 7f1a13400640 1 -- 172.21.15.83:0/318352922 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a14049070 con 0x7f1a1c15c300 2024-09-21T00:15:20.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.634+0000 7f1a13400640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f19f8078b90 0x7f19f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:20.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.634+0000 7f1a13400640 1 -- 172.21.15.83:0/318352922 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f1a140bbed0 con 0x7f1a1c15c300 2024-09-21T00:15:20.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.634+0000 7f1a1aa00640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f19f8078b90 0x7f19f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:20.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.635+0000 7f1a1aa00640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f19f8078b90 0x7f19f807b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009ac0 tx=0x7f1a0c005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:20.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.638+0000 7f1a13400640 1 -- 172.21.15.83:0/318352922 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1a1403e070 con 0x7f1a1c15c300 2024-09-21T00:15:20.715 INFO:tasks.ceph.mds.d.smithi142.stderr:2024-09-21T00:15:20.714+0000 7f48a1800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T00:15:20.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.825+0000 7f1a21a00640 1 -- 172.21.15.83:0/318352922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a1c0b3750 con 0x7f1a1c15c300 2024-09-21T00:15:20.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.826+0000 7f1a13400640 1 -- 172.21.15.83:0/318352922 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+17026 (secure 0 0 0) 0x7f1a14083b20 con 0x7f1a1c15c300 2024-09-21T00:15:20.828 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:20.829 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":41,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:15:17.861314+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:15:14.312079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T00:15:15.307562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:15:20.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.828+0000 7f1a21a00640 1 -- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f19f8078b90 msgr2=0x7f19f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:20.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.828+0000 7f1a21a00640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f19f8078b90 0x7f19f807b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009ac0 tx=0x7f1a0c005f90 comp rx=0 tx=0).stop 2024-09-21T00:15:20.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.828+0000 7f1a21a00640 1 -- 172.21.15.83:0/318352922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a1c15c300 msgr2=0x7f1a1c15eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:20.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.828+0000 7f1a21a00640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a1c15c300 0x7f1a1c15eea0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a14006010 tx=0x7f1a14003f10 comp rx=0 tx=0).stop 2024-09-21T00:15:20.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.829+0000 7f1a21a00640 1 -- 172.21.15.83:0/318352922 shutdown_connections 2024-09-21T00:15:20.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.829+0000 7f1a21a00640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f19f8078b90 0x7f19f807b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.829+0000 7f1a21a00640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a1c15c300 0x7f1a1c15eea0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.829+0000 7f1a21a00640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a1c15e7c0 0x7f1a1c15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.829+0000 7f1a21a00640 1 --2- 172.21.15.83:0/318352922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a1c06e330 0x7f1a1c1f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:20.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.829+0000 7f1a21a00640 1 -- 172.21.15.83:0/318352922 >> 172.21.15.83:0/318352922 conn(0x7f1a1c0cca40 msgr2=0x7f1a1c06f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:20.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.829+0000 7f1a21a00640 1 -- 172.21.15.83:0/318352922 shutdown_connections 2024-09-21T00:15:20.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:20.829+0000 7f1a21a00640 1 -- 172.21.15.83:0/318352922 wait complete. 2024-09-21T00:15:20.853 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T00:15:20.853 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:15:21.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.071+0000 7f901bc00640 1 -- 172.21.15.83:0/2020498278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f901415e7c0 msgr2=0x7f901406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:21.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.071+0000 7f901bc00640 1 --2- 172.21.15.83:0/2020498278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f901415e7c0 0x7f901406ddf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9014071cc0 tx=0x7f900002a560 comp rx=0 tx=0).stop 2024-09-21T00:15:21.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.071+0000 7f901bc00640 1 -- 172.21.15.83:0/2020498278 shutdown_connections 2024-09-21T00:15:21.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.071+0000 7f901bc00640 1 --2- 172.21.15.83:0/2020498278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f901406e330 0x7f90141623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.071+0000 7f901bc00640 1 --2- 172.21.15.83:0/2020498278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f901415e7c0 0x7f901406ddf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.071+0000 7f901bc00640 1 --2- 172.21.15.83:0/2020498278 >> v2:172.21.15.142:3300/0 conn(0x7f90140cb750 0x7f90140af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.071+0000 7f901bc00640 1 -- 172.21.15.83:0/2020498278 >> 172.21.15.83:0/2020498278 conn(0x7f90140cca40 msgr2=0x7f90140cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:21.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.071+0000 7f901bc00640 1 -- 172.21.15.83:0/2020498278 shutdown_connections 2024-09-21T00:15:21.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.071+0000 7f901bc00640 1 -- 172.21.15.83:0/2020498278 wait complete. 2024-09-21T00:15:21.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.074+0000 7f901bc00640 1 Processor -- start 2024-09-21T00:15:21.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.074+0000 7f901bc00640 1 -- start start 2024-09-21T00:15:21.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.075+0000 7f901bc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901406e330 0x7f901415d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:21.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.075+0000 7f901bc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f901415e7c0 0x7f9014161000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:21.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.075+0000 7f901bc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f901415fd00 0x7f90140a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:21.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.075+0000 7f901bc00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9014162a60 con 0x7f901415e7c0 2024-09-21T00:15:21.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.075+0000 7f901bc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90141628e0 con 0x7f901406e330 2024-09-21T00:15:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.075+0000 7f901bc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9014162be0 con 0x7f901415fd00 2024-09-21T00:15:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.076+0000 7f9013e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f901415e7c0 0x7f9014161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.076+0000 7f9013e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f901415e7c0 0x7f9014161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44316/0 (socket says 172.21.15.83:44316) 2024-09-21T00:15:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.076+0000 7f9013e00640 1 -- 172.21.15.83:0/1737460050 learned_addr learned my addr 172.21.15.83:0/1737460050 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.076+0000 7f9019c00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f901415fd00 0x7f90140a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.076+0000 7f9019200640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901406e330 0x7f901415d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:21.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.076+0000 7f9013e00640 1 -- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f901415fd00 msgr2=0x7f90140a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:21.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.076+0000 7f9013e00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f901415fd00 0x7f90140a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.076+0000 7f9013e00640 1 -- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901406e330 msgr2=0x7f901415d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:21.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.076+0000 7f9013e00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901406e330 0x7f901415d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.076+0000 7f9013e00640 1 -- 172.21.15.83:0/1737460050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9014161d30 con 0x7f901415e7c0 2024-09-21T00:15:21.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.077+0000 7f9013e00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f901415e7c0 0x7f9014161000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9000034040 tx=0x7f9000003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:21.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.077+0000 7f9010c00640 1 -- 172.21.15.83:0/1737460050 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900003e030 con 0x7f901415e7c0 2024-09-21T00:15:21.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.077+0000 7f9010c00640 1 -- 172.21.15.83:0/1737460050 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9000003e00 con 0x7f901415e7c0 2024-09-21T00:15:21.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.077+0000 7f901bc00640 1 -- 172.21.15.83:0/1737460050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901415ef40 con 0x7f901415e7c0 2024-09-21T00:15:21.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.077+0000 7f9010c00640 1 -- 172.21.15.83:0/1737460050 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000035040 con 0x7f901415e7c0 2024-09-21T00:15:21.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.077+0000 7f901bc00640 1 -- 172.21.15.83:0/1737460050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901415f500 con 0x7f901415e7c0 2024-09-21T00:15:21.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.078+0000 7f901bc00640 1 -- 172.21.15.83:0/1737460050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90140b3cc0 con 0x7f901415e7c0 2024-09-21T00:15:21.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.079+0000 7f9010c00640 1 -- 172.21.15.83:0/1737460050 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9000041030 con 0x7f901415e7c0 2024-09-21T00:15:21.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.080+0000 7f9010c00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ff4078bc0 0x7f8ff407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:21.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.080+0000 7f9010c00640 1 -- 172.21.15.83:0/1737460050 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f90000bb5b0 con 0x7f901415e7c0 2024-09-21T00:15:21.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.081+0000 7f9019200640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ff4078bc0 0x7f8ff407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:21.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.081+0000 7f9019200640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ff4078bc0 0x7f8ff407b0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f900800bad0 tx=0x7f900800b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:21.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.085+0000 7f9010c00640 1 -- 172.21.15.83:0/1737460050 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9000083200 con 0x7f901415e7c0 2024-09-21T00:15:21.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.267+0000 7f901bc00640 1 -- 172.21.15.83:0/1737460050 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90141630a0 con 0x7f8ff4078bc0 2024-09-21T00:15:21.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.272+0000 7f9010c00640 1 -- 172.21.15.83:0/1737460050 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251689 (secure 0 0 0) 0x7f90141630a0 con 0x7f8ff4078bc0 2024-09-21T00:15:21.277 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:15:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 -- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ff4078bc0 msgr2=0x7f8ff407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ff4078bc0 0x7f8ff407b0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f900800bad0 tx=0x7f900800b2e0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 -- 172.21.15.83:0/1737460050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f901415e7c0 msgr2=0x7f9014161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f901415e7c0 0x7f9014161000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9000034040 tx=0x7f9000003910 comp rx=0 tx=0).stop 2024-09-21T00:15:21.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 -- 172.21.15.83:0/1737460050 shutdown_connections 2024-09-21T00:15:21.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8ff4078bc0 0x7f8ff407b0d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f901415fd00 0x7f90140a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f901415e7c0 0x7f9014161000 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 --2- 172.21.15.83:0/1737460050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f901406e330 0x7f901415d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 -- 172.21.15.83:0/1737460050 >> 172.21.15.83:0/1737460050 conn(0x7f90140cca40 msgr2=0x7f90140b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:21.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 -- 172.21.15.83:0/1737460050 shutdown_connections 2024-09-21T00:15:21.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.276+0000 7f901bc00640 1 -- 172.21.15.83:0/1737460050 wait complete. 2024-09-21T00:15:21.300 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-21T00:15:20.869390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221028,"kb_used_data":4748,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753692,"statfs":{"total":773094113280,"available":772867780608,"internally_reserved":0,"allocated":4861952,"data_stored":2713228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001964"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893738+0000","last_change":"2024-09-21T00:15:16.887689+0000","last_active":"2024-09-21T00:15:16.893738+0000","last_peered":"2024-09-21T00:15:16.893738+0000","last_clean":"2024-09-21T00:15:16.893738+0000","last_became_active":"2024-09-21T00:15:16.886688+0000","last_became_peered":"2024-09-21T00:15:16.886688+0000","last_unstale":"2024-09-21T00:15:16.893738+0000","last_undegraded":"2024-09-21T00:15:16.893738+0000","last_fullsized":"2024-09-21T00:15:16.893738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.498683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888756+0000","last_change":"2024-09-21T00:15:16.885091+0000","last_active":"2024-09-21T00:15:16.888756+0000","last_peered":"2024-09-21T00:15:16.888756+0000","last_clean":"2024-09-21T00:15:16.888756+0000","last_became_active":"2024-09-21T00:15:16.878833+0000","last_became_peered":"2024-09-21T00:15:16.878833+0000","last_unstale":"2024-09-21T00:15:16.888756+0000","last_undegraded":"2024-09-21T00:15:16.888756+0000","last_fullsized":"2024-09-21T00:15:16.888756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:05.866795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.874244+0000","last_change":"2024-09-21T00:15:16.866321+0000","last_active":"2024-09-21T00:15:16.874244+0000","last_peered":"2024-09-21T00:15:16.874244+0000","last_clean":"2024-09-21T00:15:16.874244+0000","last_became_active":"2024-09-21T00:15:16.865947+0000","last_became_peered":"2024-09-21T00:15:16.865947+0000","last_unstale":"2024-09-21T00:15:16.874244+0000","last_undegraded":"2024-09-21T00:15:16.874244+0000","last_fullsized":"2024-09-21T00:15:16.874244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.312162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.864229+0000","last_change":"2024-09-21T00:15:16.862740+0000","last_active":"2024-09-21T00:15:16.864229+0000","last_peered":"2024-09-21T00:15:16.864229+0000","last_clean":"2024-09-21T00:15:16.864229+0000","last_became_active":"2024-09-21T00:15:16.861357+0000","last_became_peered":"2024-09-21T00:15:16.861357+0000","last_unstale":"2024-09-21T00:15:16.864229+0000","last_undegraded":"2024-09-21T00:15:16.864229+0000","last_fullsized":"2024-09-21T00:15:16.864229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:28.019280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868472+0000","last_change":"2024-09-21T00:15:16.882024+0000","last_active":"2024-09-21T00:15:17.868472+0000","last_peered":"2024-09-21T00:15:17.868472+0000","last_clean":"2024-09-21T00:15:17.868472+0000","last_became_active":"2024-09-21T00:15:16.878211+0000","last_became_peered":"2024-09-21T00:15:16.878211+0000","last_unstale":"2024-09-21T00:15:17.868472+0000","last_undegraded":"2024-09-21T00:15:17.868472+0000","last_fullsized":"2024-09-21T00:15:17.868472+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:48.635778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885291+0000","last_change":"2024-09-21T00:15:16.881989+0000","last_active":"2024-09-21T00:15:16.885291+0000","last_peered":"2024-09-21T00:15:16.885291+0000","last_clean":"2024-09-21T00:15:16.885291+0000","last_became_active":"2024-09-21T00:15:16.881672+0000","last_became_peered":"2024-09-21T00:15:16.881672+0000","last_unstale":"2024-09-21T00:15:16.885291+0000","last_undegraded":"2024-09-21T00:15:16.885291+0000","last_fullsized":"2024-09-21T00:15:16.885291+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:15.743262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.890066+0000","last_change":"2024-09-21T00:15:16.886616+0000","last_active":"2024-09-21T00:15:16.890066+0000","last_peered":"2024-09-21T00:15:16.890066+0000","last_clean":"2024-09-21T00:15:16.890066+0000","last_became_active":"2024-09-21T00:15:16.886275+0000","last_became_peered":"2024-09-21T00:15:16.886275+0000","last_unstale":"2024-09-21T00:15:16.890066+0000","last_undegraded":"2024-09-21T00:15:16.890066+0000","last_fullsized":"2024-09-21T00:15:16.890066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:02:33.652281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893560+0000","last_change":"2024-09-21T00:15:16.882497+0000","last_active":"2024-09-21T00:15:16.893560+0000","last_peered":"2024-09-21T00:15:16.893560+0000","last_clean":"2024-09-21T00:15:16.893560+0000","last_became_active":"2024-09-21T00:15:16.881675+0000","last_became_peered":"2024-09-21T00:15:16.881675+0000","last_unstale":"2024-09-21T00:15:16.893560+0000","last_undegraded":"2024-09-21T00:15:16.893560+0000","last_fullsized":"2024-09-21T00:15:16.893560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:10.585312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868290+0000","last_change":"2024-09-21T00:15:16.869075+0000","last_active":"2024-09-21T00:15:17.868290+0000","last_peered":"2024-09-21T00:15:17.868290+0000","last_clean":"2024-09-21T00:15:17.868290+0000","last_became_active":"2024-09-21T00:15:16.868688+0000","last_became_peered":"2024-09-21T00:15:16.868688+0000","last_unstale":"2024-09-21T00:15:17.868290+0000","last_undegraded":"2024-09-21T00:15:17.868290+0000","last_fullsized":"2024-09-21T00:15:17.868290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:09.707961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886006+0000","last_change":"2024-09-21T00:15:16.877674+0000","last_active":"2024-09-21T00:15:16.886006+0000","last_peered":"2024-09-21T00:15:16.886006+0000","last_clean":"2024-09-21T00:15:16.886006+0000","last_became_active":"2024-09-21T00:15:16.877348+0000","last_became_peered":"2024-09-21T00:15:16.877348+0000","last_unstale":"2024-09-21T00:15:16.886006+0000","last_undegraded":"2024-09-21T00:15:16.886006+0000","last_fullsized":"2024-09-21T00:15:16.886006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:38.180375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879914+0000","last_change":"2024-09-21T00:15:16.875449+0000","last_active":"2024-09-21T00:15:16.879914+0000","last_peered":"2024-09-21T00:15:16.879914+0000","last_clean":"2024-09-21T00:15:16.879914+0000","last_became_active":"2024-09-21T00:15:16.874660+0000","last_became_peered":"2024-09-21T00:15:16.874660+0000","last_unstale":"2024-09-21T00:15:16.879914+0000","last_undegraded":"2024-09-21T00:15:16.879914+0000","last_fullsized":"2024-09-21T00:15:16.879914+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:13.353817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868752+0000","last_change":"2024-09-21T00:15:16.880104+0000","last_active":"2024-09-21T00:15:17.868752+0000","last_peered":"2024-09-21T00:15:17.868752+0000","last_clean":"2024-09-21T00:15:17.868752+0000","last_became_active":"2024-09-21T00:15:16.877255+0000","last_became_peered":"2024-09-21T00:15:16.877255+0000","last_unstale":"2024-09-21T00:15:17.868752+0000","last_undegraded":"2024-09-21T00:15:17.868752+0000","last_fullsized":"2024-09-21T00:15:17.868752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:59.633259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888359+0000","last_change":"2024-09-21T00:15:16.886033+0000","last_active":"2024-09-21T00:15:16.888359+0000","last_peered":"2024-09-21T00:15:16.888359+0000","last_clean":"2024-09-21T00:15:16.888359+0000","last_became_active":"2024-09-21T00:15:16.885733+0000","last_became_peered":"2024-09-21T00:15:16.885733+0000","last_unstale":"2024-09-21T00:15:16.888359+0000","last_undegraded":"2024-09-21T00:15:16.888359+0000","last_fullsized":"2024-09-21T00:15:16.888359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:20:09.045667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.873226+0000","last_change":"2024-09-21T00:15:16.867951+0000","last_active":"2024-09-21T00:15:16.873226+0000","last_peered":"2024-09-21T00:15:16.873226+0000","last_clean":"2024-09-21T00:15:16.873226+0000","last_became_active":"2024-09-21T00:15:16.867657+0000","last_became_peered":"2024-09-21T00:15:16.867657+0000","last_unstale":"2024-09-21T00:15:16.873226+0000","last_undegraded":"2024-09-21T00:15:16.873226+0000","last_fullsized":"2024-09-21T00:15:16.873226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:59.633259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865646+0000","last_change":"2024-09-21T00:15:16.878574+0000","last_active":"2024-09-21T00:15:17.865646+0000","last_peered":"2024-09-21T00:15:17.865646+0000","last_clean":"2024-09-21T00:15:17.865646+0000","last_became_active":"2024-09-21T00:15:16.878228+0000","last_became_peered":"2024-09-21T00:15:16.878228+0000","last_unstale":"2024-09-21T00:15:17.865646+0000","last_undegraded":"2024-09-21T00:15:17.865646+0000","last_fullsized":"2024-09-21T00:15:17.865646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:33.038941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.876743+0000","last_change":"2024-09-21T00:15:16.868688+0000","last_active":"2024-09-21T00:15:16.876743+0000","last_peered":"2024-09-21T00:15:16.876743+0000","last_clean":"2024-09-21T00:15:16.876743+0000","last_became_active":"2024-09-21T00:15:16.868393+0000","last_became_peered":"2024-09-21T00:15:16.868393+0000","last_unstale":"2024-09-21T00:15:16.876743+0000","last_undegraded":"2024-09-21T00:15:16.876743+0000","last_fullsized":"2024-09-21T00:15:16.876743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:42.112862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866592+0000","last_change":"2024-09-21T00:15:16.872582+0000","last_active":"2024-09-21T00:15:17.866592+0000","last_peered":"2024-09-21T00:15:17.866592+0000","last_clean":"2024-09-21T00:15:17.866592+0000","last_became_active":"2024-09-21T00:15:16.872290+0000","last_became_peered":"2024-09-21T00:15:16.872290+0000","last_unstale":"2024-09-21T00:15:17.866592+0000","last_undegraded":"2024-09-21T00:15:17.866592+0000","last_fullsized":"2024-09-21T00:15:17.866592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:27.588288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866182+0000","last_change":"2024-09-21T00:15:16.869555+0000","last_active":"2024-09-21T00:15:17.866182+0000","last_peered":"2024-09-21T00:15:17.866182+0000","last_clean":"2024-09-21T00:15:17.866182+0000","last_became_active":"2024-09-21T00:15:16.869251+0000","last_became_peered":"2024-09-21T00:15:16.869251+0000","last_unstale":"2024-09-21T00:15:17.866182+0000","last_undegraded":"2024-09-21T00:15:17.866182+0000","last_fullsized":"2024-09-21T00:15:17.866182+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:27.130026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-21T00:15:15.864138+0000","last_change":"2024-09-21T00:15:15.864138+0000","last_active":"2024-09-21T00:15:15.838346+0000","last_peered":"2024-09-21T00:15:15.838346+0000","last_clean":"2024-09-21T00:15:15.838346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T00:15:15.864138+0000","last_undegraded":"2024-09-21T00:15:15.864138+0000","last_fullsized":"2024-09-21T00:15:15.864138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.876036+0000","last_change":"2024-09-21T00:15:16.864289+0000","last_active":"2024-09-21T00:15:16.876036+0000","last_peered":"2024-09-21T00:15:16.876036+0000","last_clean":"2024-09-21T00:15:16.876036+0000","last_became_active":"2024-09-21T00:15:16.862950+0000","last_became_peered":"2024-09-21T00:15:16.862950+0000","last_unstale":"2024-09-21T00:15:16.876036+0000","last_undegraded":"2024-09-21T00:15:16.876036+0000","last_fullsized":"2024-09-21T00:15:16.876036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:25.302443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.877901+0000","last_change":"2024-09-21T00:15:16.865247+0000","last_active":"2024-09-21T00:15:16.877901+0000","last_peered":"2024-09-21T00:15:16.877901+0000","last_clean":"2024-09-21T00:15:16.877901+0000","last_became_active":"2024-09-21T00:15:16.864945+0000","last_became_peered":"2024-09-21T00:15:16.864945+0000","last_unstale":"2024-09-21T00:15:16.877901+0000","last_undegraded":"2024-09-21T00:15:16.877901+0000","last_fullsized":"2024-09-21T00:15:16.877901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:48.052839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885933+0000","last_change":"2024-09-21T00:15:16.880182+0000","last_active":"2024-09-21T00:15:16.885933+0000","last_peered":"2024-09-21T00:15:16.885933+0000","last_clean":"2024-09-21T00:15:16.885933+0000","last_became_active":"2024-09-21T00:15:16.874473+0000","last_became_peered":"2024-09-21T00:15:16.874473+0000","last_unstale":"2024-09-21T00:15:16.885933+0000","last_undegraded":"2024-09-21T00:15:16.885933+0000","last_fullsized":"2024-09-21T00:15:16.885933+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:03.681601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865743+0000","last_change":"2024-09-21T00:15:16.885945+0000","last_active":"2024-09-21T00:15:17.865743+0000","last_peered":"2024-09-21T00:15:17.865743+0000","last_clean":"2024-09-21T00:15:17.865743+0000","last_became_active":"2024-09-21T00:15:16.885606+0000","last_became_peered":"2024-09-21T00:15:16.885606+0000","last_unstale":"2024-09-21T00:15:17.865743+0000","last_undegraded":"2024-09-21T00:15:17.865743+0000","last_fullsized":"2024-09-21T00:15:17.865743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:14.873933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886342+0000","last_change":"2024-09-21T00:15:16.876420+0000","last_active":"2024-09-21T00:15:16.886342+0000","last_peered":"2024-09-21T00:15:16.886342+0000","last_clean":"2024-09-21T00:15:16.886342+0000","last_became_active":"2024-09-21T00:15:16.876184+0000","last_became_peered":"2024-09-21T00:15:16.876184+0000","last_unstale":"2024-09-21T00:15:16.886342+0000","last_undegraded":"2024-09-21T00:15:16.886342+0000","last_fullsized":"2024-09-21T00:15:16.886342+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:58.071856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889095+0000","last_change":"2024-09-21T00:15:16.875257+0000","last_active":"2024-09-21T00:15:16.889095+0000","last_peered":"2024-09-21T00:15:16.889095+0000","last_clean":"2024-09-21T00:15:16.889095+0000","last_became_active":"2024-09-21T00:15:16.874968+0000","last_became_peered":"2024-09-21T00:15:16.874968+0000","last_unstale":"2024-09-21T00:15:16.889095+0000","last_undegraded":"2024-09-21T00:15:16.889095+0000","last_fullsized":"2024-09-21T00:15:16.889095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:13.786819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.878361+0000","last_change":"2024-09-21T00:15:16.869118+0000","last_active":"2024-09-21T00:15:16.878361+0000","last_peered":"2024-09-21T00:15:16.878361+0000","last_clean":"2024-09-21T00:15:16.878361+0000","last_became_active":"2024-09-21T00:15:16.868763+0000","last_became_peered":"2024-09-21T00:15:16.868763+0000","last_unstale":"2024-09-21T00:15:16.878361+0000","last_undegraded":"2024-09-21T00:15:16.878361+0000","last_fullsized":"2024-09-21T00:15:16.878361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:23:49.873761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.887394+0000","last_change":"2024-09-21T00:15:16.883500+0000","last_active":"2024-09-21T00:15:16.887394+0000","last_peered":"2024-09-21T00:15:16.887394+0000","last_clean":"2024-09-21T00:15:16.887394+0000","last_became_active":"2024-09-21T00:15:16.883162+0000","last_became_peered":"2024-09-21T00:15:16.883162+0000","last_unstale":"2024-09-21T00:15:16.887394+0000","last_undegraded":"2024-09-21T00:15:16.887394+0000","last_fullsized":"2024-09-21T00:15:16.887394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:51.082466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.892774+0000","last_change":"2024-09-21T00:15:16.890105+0000","last_active":"2024-09-21T00:15:16.892774+0000","last_peered":"2024-09-21T00:15:16.892774+0000","last_clean":"2024-09-21T00:15:16.892774+0000","last_became_active":"2024-09-21T00:15:16.889782+0000","last_became_peered":"2024-09-21T00:15:16.889782+0000","last_unstale":"2024-09-21T00:15:16.892774+0000","last_undegraded":"2024-09-21T00:15:16.892774+0000","last_fullsized":"2024-09-21T00:15:16.892774+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:24.562660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866430+0000","last_change":"2024-09-21T00:15:16.883797+0000","last_active":"2024-09-21T00:15:17.866430+0000","last_peered":"2024-09-21T00:15:17.866430+0000","last_clean":"2024-09-21T00:15:17.866430+0000","last_became_active":"2024-09-21T00:15:16.882778+0000","last_became_peered":"2024-09-21T00:15:16.882778+0000","last_unstale":"2024-09-21T00:15:17.866430+0000","last_undegraded":"2024-09-21T00:15:17.866430+0000","last_fullsized":"2024-09-21T00:15:17.866430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:31.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865866+0000","last_change":"2024-09-21T00:15:16.881676+0000","last_active":"2024-09-21T00:15:17.865866+0000","last_peered":"2024-09-21T00:15:17.865866+0000","last_clean":"2024-09-21T00:15:17.865866+0000","last_became_active":"2024-09-21T00:15:16.881381+0000","last_became_peered":"2024-09-21T00:15:16.881381+0000","last_unstale":"2024-09-21T00:15:17.865866+0000","last_undegraded":"2024-09-21T00:15:17.865866+0000","last_fullsized":"2024-09-21T00:15:17.865866+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:29.864436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888158+0000","last_change":"2024-09-21T00:15:16.880582+0000","last_active":"2024-09-21T00:15:16.888158+0000","last_peered":"2024-09-21T00:15:16.888158+0000","last_clean":"2024-09-21T00:15:16.888158+0000","last_became_active":"2024-09-21T00:15:16.880298+0000","last_became_peered":"2024-09-21T00:15:16.880298+0000","last_unstale":"2024-09-21T00:15:16.888158+0000","last_undegraded":"2024-09-21T00:15:16.888158+0000","last_fullsized":"2024-09-21T00:15:16.888158+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:02.087826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893532+0000","last_change":"2024-09-21T00:15:16.881999+0000","last_active":"2024-09-21T00:15:16.893532+0000","last_peered":"2024-09-21T00:15:16.893532+0000","last_clean":"2024-09-21T00:15:16.893532+0000","last_became_active":"2024-09-21T00:15:16.881229+0000","last_became_peered":"2024-09-21T00:15:16.881229+0000","last_unstale":"2024-09-21T00:15:16.893532+0000","last_undegraded":"2024-09-21T00:15:16.893532+0000","last_fullsized":"2024-09-21T00:15:16.893532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.632208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866047+0000","last_change":"2024-09-21T00:15:16.867828+0000","last_active":"2024-09-21T00:15:17.866047+0000","last_peered":"2024-09-21T00:15:17.866047+0000","last_clean":"2024-09-21T00:15:17.866047+0000","last_became_active":"2024-09-21T00:15:16.867248+0000","last_became_peered":"2024-09-21T00:15:16.867248+0000","last_unstale":"2024-09-21T00:15:17.866047+0000","last_undegraded":"2024-09-21T00:15:17.866047+0000","last_fullsized":"2024-09-21T00:15:17.866047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:17.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889194+0000","last_change":"2024-09-21T00:15:15.871147+0000","last_active":"2024-09-21T00:15:16.889194+0000","last_peered":"2024-09-21T00:15:16.889194+0000","last_clean":"2024-09-21T00:15:16.889194+0000","last_became_active":"2024-09-21T00:15:15.870802+0000","last_became_peered":"2024-09-21T00:15:15.870802+0000","last_unstale":"2024-09-21T00:15:16.889194+0000","last_undegraded":"2024-09-21T00:15:16.889194+0000","last_fullsized":"2024-09-21T00:15:16.889194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:38.278690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885479+0000","last_change":"2024-09-21T00:15:16.883776+0000","last_active":"2024-09-21T00:15:16.885479+0000","last_peered":"2024-09-21T00:15:16.885479+0000","last_clean":"2024-09-21T00:15:16.885479+0000","last_became_active":"2024-09-21T00:15:16.881047+0000","last_became_peered":"2024-09-21T00:15:16.881047+0000","last_unstale":"2024-09-21T00:15:16.885479+0000","last_undegraded":"2024-09-21T00:15:16.885479+0000","last_fullsized":"2024-09-21T00:15:16.885479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:18.509764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885933+0000","last_change":"2024-09-21T00:15:15.865052+0000","last_active":"2024-09-21T00:15:16.885933+0000","last_peered":"2024-09-21T00:15:16.885933+0000","last_clean":"2024-09-21T00:15:16.885933+0000","last_became_active":"2024-09-21T00:15:15.864719+0000","last_became_peered":"2024-09-21T00:15:15.864719+0000","last_unstale":"2024-09-21T00:15:16.885933+0000","last_undegraded":"2024-09-21T00:15:16.885933+0000","last_fullsized":"2024-09-21T00:15:16.885933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:03.742657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866396+0000","last_change":"2024-09-21T00:15:16.875044+0000","last_active":"2024-09-21T00:15:17.866396+0000","last_peered":"2024-09-21T00:15:17.866396+0000","last_clean":"2024-09-21T00:15:17.866396+0000","last_became_active":"2024-09-21T00:15:16.869954+0000","last_became_peered":"2024-09-21T00:15:16.869954+0000","last_unstale":"2024-09-21T00:15:17.866396+0000","last_undegraded":"2024-09-21T00:15:17.866396+0000","last_fullsized":"2024-09-21T00:15:17.866396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:48.086484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900622+0000","last_change":"2024-09-21T00:15:15.869470+0000","last_active":"2024-09-21T00:15:16.900622+0000","last_peered":"2024-09-21T00:15:16.900622+0000","last_clean":"2024-09-21T00:15:16.900622+0000","last_became_active":"2024-09-21T00:15:15.869161+0000","last_became_peered":"2024-09-21T00:15:15.869161+0000","last_unstale":"2024-09-21T00:15:16.900622+0000","last_undegraded":"2024-09-21T00:15:16.900622+0000","last_fullsized":"2024-09-21T00:15:16.900622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:11.623197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.880499+0000","last_change":"2024-09-21T00:15:16.874950+0000","last_active":"2024-09-21T00:15:16.880499+0000","last_peered":"2024-09-21T00:15:16.880499+0000","last_clean":"2024-09-21T00:15:16.880499+0000","last_became_active":"2024-09-21T00:15:16.874649+0000","last_became_peered":"2024-09-21T00:15:16.874649+0000","last_unstale":"2024-09-21T00:15:16.880499+0000","last_undegraded":"2024-09-21T00:15:16.880499+0000","last_fullsized":"2024-09-21T00:15:16.880499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:00.593215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.899021+0000","last_change":"2024-09-21T00:15:15.876080+0000","last_active":"2024-09-21T00:15:16.899021+0000","last_peered":"2024-09-21T00:15:16.899021+0000","last_clean":"2024-09-21T00:15:16.899021+0000","last_became_active":"2024-09-21T00:15:15.875776+0000","last_became_peered":"2024-09-21T00:15:15.875776+0000","last_unstale":"2024-09-21T00:15:16.899021+0000","last_undegraded":"2024-09-21T00:15:16.899021+0000","last_fullsized":"2024-09-21T00:15:16.899021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:08.705060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.897229+0000","last_change":"2024-09-21T00:15:16.890109+0000","last_active":"2024-09-21T00:15:16.897229+0000","last_peered":"2024-09-21T00:15:16.897229+0000","last_clean":"2024-09-21T00:15:16.897229+0000","last_became_active":"2024-09-21T00:15:16.889670+0000","last_became_peered":"2024-09-21T00:15:16.889670+0000","last_unstale":"2024-09-21T00:15:16.897229+0000","last_undegraded":"2024-09-21T00:15:16.897229+0000","last_fullsized":"2024-09-21T00:15:16.897229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:02.210312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.887840+0000","last_change":"2024-09-21T00:15:15.863814+0000","last_active":"2024-09-21T00:15:16.887840+0000","last_peered":"2024-09-21T00:15:16.887840+0000","last_clean":"2024-09-21T00:15:16.887840+0000","last_became_active":"2024-09-21T00:15:15.862421+0000","last_became_peered":"2024-09-21T00:15:15.862421+0000","last_unstale":"2024-09-21T00:15:16.887840+0000","last_undegraded":"2024-09-21T00:15:16.887840+0000","last_fullsized":"2024-09-21T00:15:16.887840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:47.632876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888786+0000","last_change":"2024-09-21T00:15:16.885001+0000","last_active":"2024-09-21T00:15:16.888786+0000","last_peered":"2024-09-21T00:15:16.888786+0000","last_clean":"2024-09-21T00:15:16.888786+0000","last_became_active":"2024-09-21T00:15:16.884672+0000","last_became_peered":"2024-09-21T00:15:16.884672+0000","last_unstale":"2024-09-21T00:15:16.888786+0000","last_undegraded":"2024-09-21T00:15:16.888786+0000","last_fullsized":"2024-09-21T00:15:16.888786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.312162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893837+0000","last_change":"2024-09-21T00:15:15.868966+0000","last_active":"2024-09-21T00:15:16.893837+0000","last_peered":"2024-09-21T00:15:16.893837+0000","last_clean":"2024-09-21T00:15:16.893837+0000","last_became_active":"2024-09-21T00:15:15.868667+0000","last_became_peered":"2024-09-21T00:15:15.868667+0000","last_unstale":"2024-09-21T00:15:16.893837+0000","last_undegraded":"2024-09-21T00:15:16.893837+0000","last_fullsized":"2024-09-21T00:15:16.893837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:08:22.105332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866062+0000","last_change":"2024-09-21T00:15:16.863866+0000","last_active":"2024-09-21T00:15:17.866062+0000","last_peered":"2024-09-21T00:15:17.866062+0000","last_clean":"2024-09-21T00:15:17.866062+0000","last_became_active":"2024-09-21T00:15:16.862688+0000","last_became_peered":"2024-09-21T00:15:16.862688+0000","last_unstale":"2024-09-21T00:15:17.866062+0000","last_undegraded":"2024-09-21T00:15:17.866062+0000","last_fullsized":"2024-09-21T00:15:17.866062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:52.562904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.855893+0000","last_change":"2024-09-21T00:15:15.874143+0000","last_active":"2024-09-21T00:15:16.855893+0000","last_peered":"2024-09-21T00:15:16.855893+0000","last_clean":"2024-09-21T00:15:16.855893+0000","last_became_active":"2024-09-21T00:15:15.871902+0000","last_became_peered":"2024-09-21T00:15:15.871902+0000","last_unstale":"2024-09-21T00:15:16.855893+0000","last_undegraded":"2024-09-21T00:15:16.855893+0000","last_fullsized":"2024-09-21T00:15:16.855893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:24.299541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.884299+0000","last_change":"2024-09-21T00:15:16.876073+0000","last_active":"2024-09-21T00:15:16.884299+0000","last_peered":"2024-09-21T00:15:16.884299+0000","last_clean":"2024-09-21T00:15:16.884299+0000","last_became_active":"2024-09-21T00:15:16.875374+0000","last_became_peered":"2024-09-21T00:15:16.875374+0000","last_unstale":"2024-09-21T00:15:16.884299+0000","last_undegraded":"2024-09-21T00:15:16.884299+0000","last_fullsized":"2024-09-21T00:15:16.884299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:26:25.907755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866306+0000","last_change":"2024-09-21T00:15:15.872912+0000","last_active":"2024-09-21T00:15:16.866306+0000","last_peered":"2024-09-21T00:15:16.866306+0000","last_clean":"2024-09-21T00:15:16.866306+0000","last_became_active":"2024-09-21T00:15:15.872553+0000","last_became_peered":"2024-09-21T00:15:15.872553+0000","last_unstale":"2024-09-21T00:15:16.866306+0000","last_undegraded":"2024-09-21T00:15:16.866306+0000","last_fullsized":"2024-09-21T00:15:16.866306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:36.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.881302+0000","last_change":"2024-09-21T00:15:16.864727+0000","last_active":"2024-09-21T00:15:16.881302+0000","last_peered":"2024-09-21T00:15:16.881302+0000","last_clean":"2024-09-21T00:15:16.881302+0000","last_became_active":"2024-09-21T00:15:16.864246+0000","last_became_peered":"2024-09-21T00:15:16.864246+0000","last_unstale":"2024-09-21T00:15:16.881302+0000","last_undegraded":"2024-09-21T00:15:16.881302+0000","last_fullsized":"2024-09-21T00:15:16.881302+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:51.082466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.858347+0000","last_change":"2024-09-21T00:15:15.871490+0000","last_active":"2024-09-21T00:15:16.858347+0000","last_peered":"2024-09-21T00:15:16.858347+0000","last_clean":"2024-09-21T00:15:16.858347+0000","last_became_active":"2024-09-21T00:15:15.871156+0000","last_became_peered":"2024-09-21T00:15:15.871156+0000","last_unstale":"2024-09-21T00:15:16.858347+0000","last_undegraded":"2024-09-21T00:15:16.858347+0000","last_fullsized":"2024-09-21T00:15:16.858347+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:12.350916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889035+0000","last_change":"2024-09-21T00:15:16.876745+0000","last_active":"2024-09-21T00:15:16.889035+0000","last_peered":"2024-09-21T00:15:16.889035+0000","last_clean":"2024-09-21T00:15:16.889035+0000","last_became_active":"2024-09-21T00:15:16.876387+0000","last_became_peered":"2024-09-21T00:15:16.876387+0000","last_unstale":"2024-09-21T00:15:16.889035+0000","last_undegraded":"2024-09-21T00:15:16.889035+0000","last_fullsized":"2024-09-21T00:15:16.889035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:29.493781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866219+0000","last_change":"2024-09-21T00:15:15.861011+0000","last_active":"2024-09-21T00:15:17.866219+0000","last_peered":"2024-09-21T00:15:17.866219+0000","last_clean":"2024-09-21T00:15:17.866219+0000","last_became_active":"2024-09-21T00:15:15.859747+0000","last_became_peered":"2024-09-21T00:15:15.859747+0000","last_unstale":"2024-09-21T00:15:17.866219+0000","last_undegraded":"2024-09-21T00:15:17.866219+0000","last_fullsized":"2024-09-21T00:15:17.866219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:11.431973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879757+0000","last_change":"2024-09-21T00:15:16.871360+0000","last_active":"2024-09-21T00:15:16.879757+0000","last_peered":"2024-09-21T00:15:16.879757+0000","last_clean":"2024-09-21T00:15:16.879757+0000","last_became_active":"2024-09-21T00:15:16.871013+0000","last_became_peered":"2024-09-21T00:15:16.871013+0000","last_unstale":"2024-09-21T00:15:16.879757+0000","last_undegraded":"2024-09-21T00:15:16.879757+0000","last_fullsized":"2024-09-21T00:15:16.879757+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:13.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866222+0000","last_change":"2024-09-21T00:15:15.865177+0000","last_active":"2024-09-21T00:15:17.866222+0000","last_peered":"2024-09-21T00:15:17.866222+0000","last_clean":"2024-09-21T00:15:17.866222+0000","last_became_active":"2024-09-21T00:15:15.864924+0000","last_became_peered":"2024-09-21T00:15:15.864924+0000","last_unstale":"2024-09-21T00:15:17.866222+0000","last_undegraded":"2024-09-21T00:15:17.866222+0000","last_fullsized":"2024-09-21T00:15:17.866222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:04:53.011253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888496+0000","last_change":"2024-09-21T00:15:16.886616+0000","last_active":"2024-09-21T00:15:16.888496+0000","last_peered":"2024-09-21T00:15:16.888496+0000","last_clean":"2024-09-21T00:15:16.888496+0000","last_became_active":"2024-09-21T00:15:16.886309+0000","last_became_peered":"2024-09-21T00:15:16.886309+0000","last_unstale":"2024-09-21T00:15:16.888496+0000","last_undegraded":"2024-09-21T00:15:16.888496+0000","last_fullsized":"2024-09-21T00:15:16.888496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:22.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.907440+0000","last_change":"2024-09-21T00:15:15.872932+0000","last_active":"2024-09-21T00:15:16.907440+0000","last_peered":"2024-09-21T00:15:16.907440+0000","last_clean":"2024-09-21T00:15:16.907440+0000","last_became_active":"2024-09-21T00:15:15.872625+0000","last_became_peered":"2024-09-21T00:15:15.872625+0000","last_unstale":"2024-09-21T00:15:16.907440+0000","last_undegraded":"2024-09-21T00:15:16.907440+0000","last_fullsized":"2024-09-21T00:15:16.907440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:02.678699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.880518+0000","last_change":"2024-09-21T00:15:16.869519+0000","last_active":"2024-09-21T00:15:16.880518+0000","last_peered":"2024-09-21T00:15:16.880518+0000","last_clean":"2024-09-21T00:15:16.880518+0000","last_became_active":"2024-09-21T00:15:16.868514+0000","last_became_peered":"2024-09-21T00:15:16.868514+0000","last_unstale":"2024-09-21T00:15:16.880518+0000","last_undegraded":"2024-09-21T00:15:16.880518+0000","last_fullsized":"2024-09-21T00:15:16.880518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:04.585473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900610+0000","last_change":"2024-09-21T00:15:15.864869+0000","last_active":"2024-09-21T00:15:16.900610+0000","last_peered":"2024-09-21T00:15:16.900610+0000","last_clean":"2024-09-21T00:15:16.900610+0000","last_became_active":"2024-09-21T00:15:15.863402+0000","last_became_peered":"2024-09-21T00:15:15.863402+0000","last_unstale":"2024-09-21T00:15:16.900610+0000","last_undegraded":"2024-09-21T00:15:16.900610+0000","last_fullsized":"2024-09-21T00:15:16.900610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:15.543176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.891762+0000","last_change":"2024-09-21T00:15:16.889929+0000","last_active":"2024-09-21T00:15:16.891762+0000","last_peered":"2024-09-21T00:15:16.891762+0000","last_clean":"2024-09-21T00:15:16.891762+0000","last_became_active":"2024-09-21T00:15:16.889592+0000","last_became_peered":"2024-09-21T00:15:16.889592+0000","last_unstale":"2024-09-21T00:15:16.891762+0000","last_undegraded":"2024-09-21T00:15:16.891762+0000","last_fullsized":"2024-09-21T00:15:16.891762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:18:05.708718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.870448+0000","last_change":"2024-09-21T00:15:15.856402+0000","last_active":"2024-09-21T00:15:16.870448+0000","last_peered":"2024-09-21T00:15:16.870448+0000","last_clean":"2024-09-21T00:15:16.870448+0000","last_became_active":"2024-09-21T00:15:15.856065+0000","last_became_peered":"2024-09-21T00:15:15.856065+0000","last_unstale":"2024-09-21T00:15:16.870448+0000","last_undegraded":"2024-09-21T00:15:16.870448+0000","last_fullsized":"2024-09-21T00:15:16.870448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:34.468856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885960+0000","last_change":"2024-09-21T00:15:16.880219+0000","last_active":"2024-09-21T00:15:16.885960+0000","last_peered":"2024-09-21T00:15:16.885960+0000","last_clean":"2024-09-21T00:15:16.885960+0000","last_became_active":"2024-09-21T00:15:16.879024+0000","last_became_peered":"2024-09-21T00:15:16.879024+0000","last_unstale":"2024-09-21T00:15:16.885960+0000","last_undegraded":"2024-09-21T00:15:16.885960+0000","last_fullsized":"2024-09-21T00:15:16.885960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:12.626099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865879+0000","last_change":"2024-09-21T00:15:15.864833+0000","last_active":"2024-09-21T00:15:17.865879+0000","last_peered":"2024-09-21T00:15:17.865879+0000","last_clean":"2024-09-21T00:15:17.865879+0000","last_became_active":"2024-09-21T00:15:15.864497+0000","last_became_peered":"2024-09-21T00:15:15.864497+0000","last_unstale":"2024-09-21T00:15:17.865879+0000","last_undegraded":"2024-09-21T00:15:17.865879+0000","last_fullsized":"2024-09-21T00:15:17.865879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:49.050645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868649+0000","last_change":"2024-09-21T00:15:16.881508+0000","last_active":"2024-09-21T00:15:17.868649+0000","last_peered":"2024-09-21T00:15:17.868649+0000","last_clean":"2024-09-21T00:15:17.868649+0000","last_became_active":"2024-09-21T00:15:16.877197+0000","last_became_peered":"2024-09-21T00:15:16.877197+0000","last_unstale":"2024-09-21T00:15:17.868649+0000","last_undegraded":"2024-09-21T00:15:17.868649+0000","last_fullsized":"2024-09-21T00:15:17.868649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:39.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889411+0000","last_change":"2024-09-21T00:15:15.866587+0000","last_active":"2024-09-21T00:15:16.889411+0000","last_peered":"2024-09-21T00:15:16.889411+0000","last_clean":"2024-09-21T00:15:16.889411+0000","last_became_active":"2024-09-21T00:15:15.864940+0000","last_became_peered":"2024-09-21T00:15:15.864940+0000","last_unstale":"2024-09-21T00:15:16.889411+0000","last_undegraded":"2024-09-21T00:15:16.889411+0000","last_fullsized":"2024-09-21T00:15:16.889411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:22.127731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893356+0000","last_change":"2024-09-21T00:15:16.892157+0000","last_active":"2024-09-21T00:15:16.893356+0000","last_peered":"2024-09-21T00:15:16.893356+0000","last_clean":"2024-09-21T00:15:16.893356+0000","last_became_active":"2024-09-21T00:15:16.888127+0000","last_became_peered":"2024-09-21T00:15:16.888127+0000","last_unstale":"2024-09-21T00:15:16.893356+0000","last_undegraded":"2024-09-21T00:15:16.893356+0000","last_fullsized":"2024-09-21T00:15:16.893356+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:02.683038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889917+0000","last_change":"2024-09-21T00:15:15.873619+0000","last_active":"2024-09-21T00:15:16.889917+0000","last_peered":"2024-09-21T00:15:16.889917+0000","last_clean":"2024-09-21T00:15:16.889917+0000","last_became_active":"2024-09-21T00:15:15.873342+0000","last_became_peered":"2024-09-21T00:15:15.873342+0000","last_unstale":"2024-09-21T00:15:16.889917+0000","last_undegraded":"2024-09-21T00:15:16.889917+0000","last_fullsized":"2024-09-21T00:15:16.889917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:40.599261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900501+0000","last_change":"2024-09-21T00:15:16.894537+0000","last_active":"2024-09-21T00:15:16.900501+0000","last_peered":"2024-09-21T00:15:16.900501+0000","last_clean":"2024-09-21T00:15:16.900501+0000","last_became_active":"2024-09-21T00:15:16.894328+0000","last_became_peered":"2024-09-21T00:15:16.894328+0000","last_unstale":"2024-09-21T00:15:16.900501+0000","last_undegraded":"2024-09-21T00:15:16.900501+0000","last_fullsized":"2024-09-21T00:15:16.900501+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:32.391700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866406+0000","last_change":"2024-09-21T00:15:15.869830+0000","last_active":"2024-09-21T00:15:17.866406+0000","last_peered":"2024-09-21T00:15:17.866406+0000","last_clean":"2024-09-21T00:15:17.866406+0000","last_became_active":"2024-09-21T00:15:15.867650+0000","last_became_peered":"2024-09-21T00:15:15.867650+0000","last_unstale":"2024-09-21T00:15:17.866406+0000","last_undegraded":"2024-09-21T00:15:17.866406+0000","last_fullsized":"2024-09-21T00:15:17.866406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:28.691334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.890222+0000","last_change":"2024-09-21T00:15:16.887082+0000","last_active":"2024-09-21T00:15:16.890222+0000","last_peered":"2024-09-21T00:15:16.890222+0000","last_clean":"2024-09-21T00:15:16.890222+0000","last_became_active":"2024-09-21T00:15:16.885720+0000","last_became_peered":"2024-09-21T00:15:16.885720+0000","last_unstale":"2024-09-21T00:15:16.890222+0000","last_undegraded":"2024-09-21T00:15:16.890222+0000","last_fullsized":"2024-09-21T00:15:16.890222+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:53.816749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867676+0000","last_change":"2024-09-21T00:15:15.872212+0000","last_active":"2024-09-21T00:15:17.867676+0000","last_peered":"2024-09-21T00:15:17.867676+0000","last_clean":"2024-09-21T00:15:17.867676+0000","last_became_active":"2024-09-21T00:15:15.870779+0000","last_became_peered":"2024-09-21T00:15:15.870779+0000","last_unstale":"2024-09-21T00:15:17.867676+0000","last_undegraded":"2024-09-21T00:15:17.867676+0000","last_fullsized":"2024-09-21T00:15:17.867676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:43.736010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-21T00:15:15.864118+0000","last_change":"2024-09-21T00:15:15.864118+0000","last_active":"2024-09-21T00:15:15.838346+0000","last_peered":"2024-09-21T00:15:15.838346+0000","last_clean":"2024-09-21T00:15:15.838346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T00:15:15.864118+0000","last_undegraded":"2024-09-21T00:15:15.864118+0000","last_fullsized":"2024-09-21T00:15:15.864118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T00:15:15.876395+0000","last_change":"2024-09-21T00:15:15.873944+0000","last_active":"2024-09-21T00:15:15.876395+0000","last_peered":"2024-09-21T00:15:15.876395+0000","last_clean":"2024-09-21T00:15:15.876395+0000","last_became_active":"2024-09-21T00:15:15.873612+0000","last_became_peered":"2024-09-21T00:15:15.873612+0000","last_unstale":"2024-09-21T00:15:15.876395+0000","last_undegraded":"2024-09-21T00:15:15.876395+0000","last_fullsized":"2024-09-21T00:15:15.876395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:31.652679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865655+0000","last_change":"2024-09-21T00:15:16.878490+0000","last_active":"2024-09-21T00:15:17.865655+0000","last_peered":"2024-09-21T00:15:17.865655+0000","last_clean":"2024-09-21T00:15:17.865655+0000","last_became_active":"2024-09-21T00:15:16.878218+0000","last_became_peered":"2024-09-21T00:15:16.878218+0000","last_unstale":"2024-09-21T00:15:17.865655+0000","last_undegraded":"2024-09-21T00:15:17.865655+0000","last_fullsized":"2024-09-21T00:15:17.865655+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:58.804183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T00:15:15.875463+0000","last_change":"2024-09-21T00:15:15.869680+0000","last_active":"2024-09-21T00:15:15.875463+0000","last_peered":"2024-09-21T00:15:15.875463+0000","last_clean":"2024-09-21T00:15:15.875463+0000","last_became_active":"2024-09-21T00:15:15.869363+0000","last_became_peered":"2024-09-21T00:15:15.869363+0000","last_unstale":"2024-09-21T00:15:15.875463+0000","last_undegraded":"2024-09-21T00:15:15.875463+0000","last_fullsized":"2024-09-21T00:15:15.875463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:30.627507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893469+0000","last_change":"2024-09-21T00:15:16.881332+0000","last_active":"2024-09-21T00:15:16.893469+0000","last_peered":"2024-09-21T00:15:16.893469+0000","last_clean":"2024-09-21T00:15:16.893469+0000","last_became_active":"2024-09-21T00:15:16.881080+0000","last_became_peered":"2024-09-21T00:15:16.881080+0000","last_unstale":"2024-09-21T00:15:16.893469+0000","last_undegraded":"2024-09-21T00:15:16.893469+0000","last_fullsized":"2024-09-21T00:15:16.893469+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:34.255761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.870217+0000","last_change":"2024-09-21T00:15:15.869495+0000","last_active":"2024-09-21T00:15:16.870217+0000","last_peered":"2024-09-21T00:15:16.870217+0000","last_clean":"2024-09-21T00:15:16.870217+0000","last_became_active":"2024-09-21T00:15:15.868711+0000","last_became_peered":"2024-09-21T00:15:15.868711+0000","last_unstale":"2024-09-21T00:15:16.870217+0000","last_undegraded":"2024-09-21T00:15:16.870217+0000","last_fullsized":"2024-09-21T00:15:16.870217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:29.397639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879204+0000","last_change":"2024-09-21T00:15:16.871518+0000","last_active":"2024-09-21T00:15:16.879204+0000","last_peered":"2024-09-21T00:15:16.879204+0000","last_clean":"2024-09-21T00:15:16.879204+0000","last_became_active":"2024-09-21T00:15:16.867533+0000","last_became_peered":"2024-09-21T00:15:16.867533+0000","last_unstale":"2024-09-21T00:15:16.879204+0000","last_undegraded":"2024-09-21T00:15:16.879204+0000","last_fullsized":"2024-09-21T00:15:16.879204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:16.546077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866257+0000","last_change":"2024-09-21T00:15:15.873204+0000","last_active":"2024-09-21T00:15:16.866257+0000","last_peered":"2024-09-21T00:15:16.866257+0000","last_clean":"2024-09-21T00:15:16.866257+0000","last_became_active":"2024-09-21T00:15:15.872545+0000","last_became_peered":"2024-09-21T00:15:15.872545+0000","last_unstale":"2024-09-21T00:15:16.866257+0000","last_undegraded":"2024-09-21T00:15:16.866257+0000","last_fullsized":"2024-09-21T00:15:16.866257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:30.945225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.897267+0000","last_change":"2024-09-21T00:15:16.879831+0000","last_active":"2024-09-21T00:15:16.897267+0000","last_peered":"2024-09-21T00:15:16.897267+0000","last_clean":"2024-09-21T00:15:16.897267+0000","last_became_active":"2024-09-21T00:15:16.879538+0000","last_became_peered":"2024-09-21T00:15:16.879538+0000","last_unstale":"2024-09-21T00:15:16.897267+0000","last_undegraded":"2024-09-21T00:15:16.897267+0000","last_fullsized":"2024-09-21T00:15:16.897267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:58.449816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.867406+0000","last_change":"2024-09-21T00:15:15.868499+0000","last_active":"2024-09-21T00:15:16.867406+0000","last_peered":"2024-09-21T00:15:16.867406+0000","last_clean":"2024-09-21T00:15:16.867406+0000","last_became_active":"2024-09-21T00:15:15.868218+0000","last_became_peered":"2024-09-21T00:15:15.868218+0000","last_unstale":"2024-09-21T00:15:16.867406+0000","last_undegraded":"2024-09-21T00:15:16.867406+0000","last_fullsized":"2024-09-21T00:15:16.867406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.537075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868970+0000","last_change":"2024-09-21T00:15:16.882839+0000","last_active":"2024-09-21T00:15:17.868970+0000","last_peered":"2024-09-21T00:15:17.868970+0000","last_clean":"2024-09-21T00:15:17.868970+0000","last_became_active":"2024-09-21T00:15:16.878078+0000","last_became_peered":"2024-09-21T00:15:16.878078+0000","last_unstale":"2024-09-21T00:15:17.868970+0000","last_undegraded":"2024-09-21T00:15:17.868970+0000","last_fullsized":"2024-09-21T00:15:17.868970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:13.786819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866618+0000","last_change":"2024-09-21T00:15:15.861682+0000","last_active":"2024-09-21T00:15:17.866618+0000","last_peered":"2024-09-21T00:15:17.866618+0000","last_clean":"2024-09-21T00:15:17.866618+0000","last_became_active":"2024-09-21T00:15:15.861408+0000","last_became_peered":"2024-09-21T00:15:15.861408+0000","last_unstale":"2024-09-21T00:15:17.866618+0000","last_undegraded":"2024-09-21T00:15:17.866618+0000","last_fullsized":"2024-09-21T00:15:17.866618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:30.905194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879887+0000","last_change":"2024-09-21T00:15:16.875154+0000","last_active":"2024-09-21T00:15:16.879887+0000","last_peered":"2024-09-21T00:15:16.879887+0000","last_clean":"2024-09-21T00:15:16.879887+0000","last_became_active":"2024-09-21T00:15:16.874266+0000","last_became_peered":"2024-09-21T00:15:16.874266+0000","last_unstale":"2024-09-21T00:15:16.879887+0000","last_undegraded":"2024-09-21T00:15:16.879887+0000","last_fullsized":"2024-09-21T00:15:16.879887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:24.704654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868030+0000","last_change":"2024-09-21T00:15:15.874388+0000","last_active":"2024-09-21T00:15:17.868030+0000","last_peered":"2024-09-21T00:15:17.868030+0000","last_clean":"2024-09-21T00:15:17.868030+0000","last_became_active":"2024-09-21T00:15:15.873129+0000","last_became_peered":"2024-09-21T00:15:15.873129+0000","last_unstale":"2024-09-21T00:15:17.868030+0000","last_undegraded":"2024-09-21T00:15:17.868030+0000","last_fullsized":"2024-09-21T00:15:17.868030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:14.230132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-21T00:15:15.861246+0000","last_change":"2024-09-21T00:15:15.861246+0000","last_active":"2024-09-21T00:15:15.838346+0000","last_peered":"2024-09-21T00:15:15.838346+0000","last_clean":"2024-09-21T00:15:15.838346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T00:15:15.861246+0000","last_undegraded":"2024-09-21T00:15:15.861246+0000","last_fullsized":"2024-09-21T00:15:15.861246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867811+0000","last_change":"2024-09-21T00:15:15.863805+0000","last_active":"2024-09-21T00:15:17.867811+0000","last_peered":"2024-09-21T00:15:17.867811+0000","last_clean":"2024-09-21T00:15:17.867811+0000","last_became_active":"2024-09-21T00:15:15.863461+0000","last_became_peered":"2024-09-21T00:15:15.863461+0000","last_unstale":"2024-09-21T00:15:17.867811+0000","last_undegraded":"2024-09-21T00:15:17.867811+0000","last_fullsized":"2024-09-21T00:15:17.867811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:26.759455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867630+0000","last_change":"2024-09-21T00:15:16.864392+0000","last_active":"2024-09-21T00:15:17.867630+0000","last_peered":"2024-09-21T00:15:17.867630+0000","last_clean":"2024-09-21T00:15:17.867630+0000","last_became_active":"2024-09-21T00:15:16.864065+0000","last_became_peered":"2024-09-21T00:15:16.864065+0000","last_unstale":"2024-09-21T00:15:17.867630+0000","last_undegraded":"2024-09-21T00:15:17.867630+0000","last_fullsized":"2024-09-21T00:15:17.867630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:23.130632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.858033+0000","last_change":"2024-09-21T00:15:15.863840+0000","last_active":"2024-09-21T00:15:16.858033+0000","last_peered":"2024-09-21T00:15:16.858033+0000","last_clean":"2024-09-21T00:15:16.858033+0000","last_became_active":"2024-09-21T00:15:15.863081+0000","last_became_peered":"2024-09-21T00:15:15.863081+0000","last_unstale":"2024-09-21T00:15:16.858033+0000","last_undegraded":"2024-09-21T00:15:16.858033+0000","last_fullsized":"2024-09-21T00:15:16.858033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:23.701752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885634+0000","last_change":"2024-09-21T00:15:16.881804+0000","last_active":"2024-09-21T00:15:16.885634+0000","last_peered":"2024-09-21T00:15:16.885634+0000","last_clean":"2024-09-21T00:15:16.885634+0000","last_became_active":"2024-09-21T00:15:16.881268+0000","last_became_peered":"2024-09-21T00:15:16.881268+0000","last_unstale":"2024-09-21T00:15:16.885634+0000","last_undegraded":"2024-09-21T00:15:16.885634+0000","last_fullsized":"2024-09-21T00:15:16.885634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:36.128848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.856977+0000","last_change":"2024-09-21T00:15:15.874106+0000","last_active":"2024-09-21T00:15:16.856977+0000","last_peered":"2024-09-21T00:15:16.856977+0000","last_clean":"2024-09-21T00:15:16.856977+0000","last_became_active":"2024-09-21T00:15:15.873619+0000","last_became_peered":"2024-09-21T00:15:15.873619+0000","last_unstale":"2024-09-21T00:15:16.856977+0000","last_undegraded":"2024-09-21T00:15:16.856977+0000","last_fullsized":"2024-09-21T00:15:16.856977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:28.490880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866088+0000","last_change":"2024-09-21T00:15:16.861424+0000","last_active":"2024-09-21T00:15:17.866088+0000","last_peered":"2024-09-21T00:15:17.866088+0000","last_clean":"2024-09-21T00:15:17.866088+0000","last_became_active":"2024-09-21T00:15:16.861130+0000","last_became_peered":"2024-09-21T00:15:16.861130+0000","last_unstale":"2024-09-21T00:15:17.866088+0000","last_undegraded":"2024-09-21T00:15:17.866088+0000","last_fullsized":"2024-09-21T00:15:17.866088+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:05.839943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865885+0000","last_change":"2024-09-21T00:15:15.860701+0000","last_active":"2024-09-21T00:15:17.865885+0000","last_peered":"2024-09-21T00:15:17.865885+0000","last_clean":"2024-09-21T00:15:17.865885+0000","last_became_active":"2024-09-21T00:15:15.860434+0000","last_became_peered":"2024-09-21T00:15:15.860434+0000","last_unstale":"2024-09-21T00:15:17.865885+0000","last_undegraded":"2024-09-21T00:15:17.865885+0000","last_fullsized":"2024-09-21T00:15:17.865885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:02.081143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886058+0000","last_change":"2024-09-21T00:15:16.881672+0000","last_active":"2024-09-21T00:15:16.886058+0000","last_peered":"2024-09-21T00:15:16.886058+0000","last_clean":"2024-09-21T00:15:16.886058+0000","last_became_active":"2024-09-21T00:15:16.881337+0000","last_became_peered":"2024-09-21T00:15:16.881337+0000","last_unstale":"2024-09-21T00:15:16.886058+0000","last_undegraded":"2024-09-21T00:15:16.886058+0000","last_fullsized":"2024-09-21T00:15:16.886058+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:28.019280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.857047+0000","last_change":"2024-09-21T00:15:15.866551+0000","last_active":"2024-09-21T00:15:16.857047+0000","last_peered":"2024-09-21T00:15:16.857047+0000","last_clean":"2024-09-21T00:15:16.857047+0000","last_became_active":"2024-09-21T00:15:15.866253+0000","last_became_peered":"2024-09-21T00:15:15.866253+0000","last_unstale":"2024-09-21T00:15:16.857047+0000","last_undegraded":"2024-09-21T00:15:16.857047+0000","last_fullsized":"2024-09-21T00:15:16.857047+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:47.049937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866440+0000","last_change":"2024-09-21T00:15:16.887371+0000","last_active":"2024-09-21T00:15:17.866440+0000","last_peered":"2024-09-21T00:15:17.866440+0000","last_clean":"2024-09-21T00:15:17.866440+0000","last_became_active":"2024-09-21T00:15:16.887049+0000","last_became_peered":"2024-09-21T00:15:16.887049+0000","last_unstale":"2024-09-21T00:15:17.866440+0000","last_undegraded":"2024-09-21T00:15:17.866440+0000","last_fullsized":"2024-09-21T00:15:17.866440+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:02.733269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.854744+0000","last_change":"2024-09-21T00:15:15.874239+0000","last_active":"2024-09-21T00:15:16.854744+0000","last_peered":"2024-09-21T00:15:16.854744+0000","last_clean":"2024-09-21T00:15:16.854744+0000","last_became_active":"2024-09-21T00:15:15.873980+0000","last_became_peered":"2024-09-21T00:15:15.873980+0000","last_unstale":"2024-09-21T00:15:16.854744+0000","last_undegraded":"2024-09-21T00:15:16.854744+0000","last_fullsized":"2024-09-21T00:15:16.854744+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:12.783917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866375+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:15:16.866375+0000","last_peered":"2024-09-21T00:15:16.866375+0000","last_clean":"2024-09-21T00:15:16.866375+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:15:16.866375+0000","last_undegraded":"2024-09-21T00:15:16.866375+0000","last_fullsized":"2024-09-21T00:15:16.866375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":475136,"data_stored":194497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":194955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1052672,"data_stored":783151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":192853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":769295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:15:21.306 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:15:21.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.557+0000 7f163ec00640 1 -- 172.21.15.83:0/1353470532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1638074cb0 msgr2=0x7f1638073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:21.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.557+0000 7f163ec00640 1 --2- 172.21.15.83:0/1353470532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1638074cb0 0x7f1638073dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f163809e110 tx=0x7f162802aac0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.558+0000 7f163ec00640 1 -- 172.21.15.83:0/1353470532 shutdown_connections 2024-09-21T00:15:21.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.558+0000 7f163ec00640 1 --2- 172.21.15.83:0/1353470532 >> v2:172.21.15.142:3300/0 conn(0x7f16380cbc10 0x7f16380cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.558+0000 7f163ec00640 1 --2- 172.21.15.83:0/1353470532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1638074cb0 0x7f1638073dd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.558+0000 7f163ec00640 1 -- 172.21.15.83:0/1353470532 >> 172.21.15.83:0/1353470532 conn(0x7f16380cca40 msgr2=0x7f16380cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:21.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.558+0000 7f163ec00640 1 -- 172.21.15.83:0/1353470532 shutdown_connections 2024-09-21T00:15:21.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.558+0000 7f163ec00640 1 -- 172.21.15.83:0/1353470532 wait complete. 2024-09-21T00:15:21.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.560+0000 7f163ec00640 1 Processor -- start 2024-09-21T00:15:21.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.560+0000 7f163ec00640 1 -- start start 2024-09-21T00:15:21.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.561+0000 7f163ec00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f163806ddf0 0x7f16380c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:21.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.561+0000 7f163ec00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1638074cb0 0x7f16381f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:21.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.561+0000 7f163ec00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16380cbc10 0x7f16380a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:21.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.561+0000 7f163ec00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f163806f3c0 con 0x7f16380cbc10 2024-09-21T00:15:21.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.561+0000 7f163ec00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f163806f240 con 0x7f1638074cb0 2024-09-21T00:15:21.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.561+0000 7f163ec00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f163806f540 con 0x7f163806ddf0 2024-09-21T00:15:21.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.562+0000 7f163cc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16380cbc10 0x7f16380a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:21.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.562+0000 7f163cc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16380cbc10 0x7f16380a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44330/0 (socket says 172.21.15.83:44330) 2024-09-21T00:15:21.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.562+0000 7f163cc00640 1 -- 172.21.15.83:0/3511815278 learned_addr learned my addr 172.21.15.83:0/3511815278 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:21.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.562+0000 7f1637e00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f163806ddf0 0x7f16380c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:21.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.562+0000 7f1637400640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1638074cb0 0x7f16381f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:21.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.562+0000 7f163cc00640 1 -- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f163806ddf0 msgr2=0x7f16380c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:21.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.562+0000 7f163cc00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f163806ddf0 0x7f16380c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.562+0000 7f163cc00640 1 -- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1638074cb0 msgr2=0x7f16381f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:21.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.562+0000 7f163cc00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1638074cb0 0x7f16381f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.562+0000 7f163cc00640 1 -- 172.21.15.83:0/3511815278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16380c65e0 con 0x7f16380cbc10 2024-09-21T00:15:21.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.563+0000 7f163cc00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16380cbc10 0x7f16380a0230 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f163000c3f0 tx=0x7f163000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:21.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.563+0000 7f162fe00640 1 -- 172.21.15.83:0/3511815278 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630017070 con 0x7f16380cbc10 2024-09-21T00:15:21.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.563+0000 7f162fe00640 1 -- 172.21.15.83:0/3511815278 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16300053c0 con 0x7f16380cbc10 2024-09-21T00:15:21.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.563+0000 7f163ec00640 1 -- 172.21.15.83:0/3511815278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16380c3ac0 con 0x7f16380cbc10 2024-09-21T00:15:21.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.563+0000 7f162fe00640 1 -- 172.21.15.83:0/3511815278 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630003850 con 0x7f16380cbc10 2024-09-21T00:15:21.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.563+0000 7f163ec00640 1 -- 172.21.15.83:0/3511815278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16380c83e0 con 0x7f16380cbc10 2024-09-21T00:15:21.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.564+0000 7f163ec00640 1 -- 172.21.15.83:0/3511815278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16380c67b0 con 0x7f16380cbc10 2024-09-21T00:15:21.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.565+0000 7f162fe00640 1 -- 172.21.15.83:0/3511815278 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f163001a070 con 0x7f16380cbc10 2024-09-21T00:15:21.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.566+0000 7f162fe00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1618078b90 0x7f161807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:21.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.566+0000 7f162fe00640 1 -- 172.21.15.83:0/3511815278 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f163009a370 con 0x7f16380cbc10 2024-09-21T00:15:21.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.567+0000 7f1637e00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1618078b90 0x7f161807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:21.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.568+0000 7f1637e00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1618078b90 0x7f161807b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1628035000 tx=0x7f1628004ab0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:21.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.571+0000 7f162fe00640 1 -- 172.21.15.83:0/3511815278 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1630062640 con 0x7f16380cbc10 2024-09-21T00:15:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.755+0000 7f163ec00640 1 -- 172.21.15.83:0/3511815278 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f163806f9f0 con 0x7f1618078b90 2024-09-21T00:15:21.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.760+0000 7f162fe00640 1 -- 172.21.15.83:0/3511815278 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251689 (secure 0 0 0) 0x7f1628083740 con 0x7f1618078b90 2024-09-21T00:15:21.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:21.766 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:15:21.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 -- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1618078b90 msgr2=0x7f161807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:21.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1618078b90 0x7f161807b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1628035000 tx=0x7f1628004ab0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 -- 172.21.15.83:0/3511815278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16380cbc10 msgr2=0x7f16380a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:21.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16380cbc10 0x7f16380a0230 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f163000c3f0 tx=0x7f163000c8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 -- 172.21.15.83:0/3511815278 shutdown_connections 2024-09-21T00:15:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f1618078b90 0x7f161807b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16380cbc10 0x7f16380a0230 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1638074cb0 0x7f16381f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 --2- 172.21.15.83:0/3511815278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f163806ddf0 0x7f16380c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 -- 172.21.15.83:0/3511815278 >> 172.21.15.83:0/3511815278 conn(0x7f16380cca40 msgr2=0x7f1638070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 -- 172.21.15.83:0/3511815278 shutdown_connections 2024-09-21T00:15:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:21.764+0000 7f163ec00640 1 -- 172.21.15.83:0/3511815278 wait complete. 2024-09-21T00:15:21.787 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-21T00:15:20.869390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221028,"kb_used_data":4748,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753692,"statfs":{"total":773094113280,"available":772867780608,"internally_reserved":0,"allocated":4861952,"data_stored":2713228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001964"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893738+0000","last_change":"2024-09-21T00:15:16.887689+0000","last_active":"2024-09-21T00:15:16.893738+0000","last_peered":"2024-09-21T00:15:16.893738+0000","last_clean":"2024-09-21T00:15:16.893738+0000","last_became_active":"2024-09-21T00:15:16.886688+0000","last_became_peered":"2024-09-21T00:15:16.886688+0000","last_unstale":"2024-09-21T00:15:16.893738+0000","last_undegraded":"2024-09-21T00:15:16.893738+0000","last_fullsized":"2024-09-21T00:15:16.893738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.498683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888756+0000","last_change":"2024-09-21T00:15:16.885091+0000","last_active":"2024-09-21T00:15:16.888756+0000","last_peered":"2024-09-21T00:15:16.888756+0000","last_clean":"2024-09-21T00:15:16.888756+0000","last_became_active":"2024-09-21T00:15:16.878833+0000","last_became_peered":"2024-09-21T00:15:16.878833+0000","last_unstale":"2024-09-21T00:15:16.888756+0000","last_undegraded":"2024-09-21T00:15:16.888756+0000","last_fullsized":"2024-09-21T00:15:16.888756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:05.866795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.874244+0000","last_change":"2024-09-21T00:15:16.866321+0000","last_active":"2024-09-21T00:15:16.874244+0000","last_peered":"2024-09-21T00:15:16.874244+0000","last_clean":"2024-09-21T00:15:16.874244+0000","last_became_active":"2024-09-21T00:15:16.865947+0000","last_became_peered":"2024-09-21T00:15:16.865947+0000","last_unstale":"2024-09-21T00:15:16.874244+0000","last_undegraded":"2024-09-21T00:15:16.874244+0000","last_fullsized":"2024-09-21T00:15:16.874244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.312162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.864229+0000","last_change":"2024-09-21T00:15:16.862740+0000","last_active":"2024-09-21T00:15:16.864229+0000","last_peered":"2024-09-21T00:15:16.864229+0000","last_clean":"2024-09-21T00:15:16.864229+0000","last_became_active":"2024-09-21T00:15:16.861357+0000","last_became_peered":"2024-09-21T00:15:16.861357+0000","last_unstale":"2024-09-21T00:15:16.864229+0000","last_undegraded":"2024-09-21T00:15:16.864229+0000","last_fullsized":"2024-09-21T00:15:16.864229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:28.019280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868472+0000","last_change":"2024-09-21T00:15:16.882024+0000","last_active":"2024-09-21T00:15:17.868472+0000","last_peered":"2024-09-21T00:15:17.868472+0000","last_clean":"2024-09-21T00:15:17.868472+0000","last_became_active":"2024-09-21T00:15:16.878211+0000","last_became_peered":"2024-09-21T00:15:16.878211+0000","last_unstale":"2024-09-21T00:15:17.868472+0000","last_undegraded":"2024-09-21T00:15:17.868472+0000","last_fullsized":"2024-09-21T00:15:17.868472+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:48.635778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885291+0000","last_change":"2024-09-21T00:15:16.881989+0000","last_active":"2024-09-21T00:15:16.885291+0000","last_peered":"2024-09-21T00:15:16.885291+0000","last_clean":"2024-09-21T00:15:16.885291+0000","last_became_active":"2024-09-21T00:15:16.881672+0000","last_became_peered":"2024-09-21T00:15:16.881672+0000","last_unstale":"2024-09-21T00:15:16.885291+0000","last_undegraded":"2024-09-21T00:15:16.885291+0000","last_fullsized":"2024-09-21T00:15:16.885291+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:15.743262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.890066+0000","last_change":"2024-09-21T00:15:16.886616+0000","last_active":"2024-09-21T00:15:16.890066+0000","last_peered":"2024-09-21T00:15:16.890066+0000","last_clean":"2024-09-21T00:15:16.890066+0000","last_became_active":"2024-09-21T00:15:16.886275+0000","last_became_peered":"2024-09-21T00:15:16.886275+0000","last_unstale":"2024-09-21T00:15:16.890066+0000","last_undegraded":"2024-09-21T00:15:16.890066+0000","last_fullsized":"2024-09-21T00:15:16.890066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:02:33.652281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893560+0000","last_change":"2024-09-21T00:15:16.882497+0000","last_active":"2024-09-21T00:15:16.893560+0000","last_peered":"2024-09-21T00:15:16.893560+0000","last_clean":"2024-09-21T00:15:16.893560+0000","last_became_active":"2024-09-21T00:15:16.881675+0000","last_became_peered":"2024-09-21T00:15:16.881675+0000","last_unstale":"2024-09-21T00:15:16.893560+0000","last_undegraded":"2024-09-21T00:15:16.893560+0000","last_fullsized":"2024-09-21T00:15:16.893560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:10.585312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868290+0000","last_change":"2024-09-21T00:15:16.869075+0000","last_active":"2024-09-21T00:15:17.868290+0000","last_peered":"2024-09-21T00:15:17.868290+0000","last_clean":"2024-09-21T00:15:17.868290+0000","last_became_active":"2024-09-21T00:15:16.868688+0000","last_became_peered":"2024-09-21T00:15:16.868688+0000","last_unstale":"2024-09-21T00:15:17.868290+0000","last_undegraded":"2024-09-21T00:15:17.868290+0000","last_fullsized":"2024-09-21T00:15:17.868290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:09.707961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886006+0000","last_change":"2024-09-21T00:15:16.877674+0000","last_active":"2024-09-21T00:15:16.886006+0000","last_peered":"2024-09-21T00:15:16.886006+0000","last_clean":"2024-09-21T00:15:16.886006+0000","last_became_active":"2024-09-21T00:15:16.877348+0000","last_became_peered":"2024-09-21T00:15:16.877348+0000","last_unstale":"2024-09-21T00:15:16.886006+0000","last_undegraded":"2024-09-21T00:15:16.886006+0000","last_fullsized":"2024-09-21T00:15:16.886006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:38.180375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879914+0000","last_change":"2024-09-21T00:15:16.875449+0000","last_active":"2024-09-21T00:15:16.879914+0000","last_peered":"2024-09-21T00:15:16.879914+0000","last_clean":"2024-09-21T00:15:16.879914+0000","last_became_active":"2024-09-21T00:15:16.874660+0000","last_became_peered":"2024-09-21T00:15:16.874660+0000","last_unstale":"2024-09-21T00:15:16.879914+0000","last_undegraded":"2024-09-21T00:15:16.879914+0000","last_fullsized":"2024-09-21T00:15:16.879914+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:13.353817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868752+0000","last_change":"2024-09-21T00:15:16.880104+0000","last_active":"2024-09-21T00:15:17.868752+0000","last_peered":"2024-09-21T00:15:17.868752+0000","last_clean":"2024-09-21T00:15:17.868752+0000","last_became_active":"2024-09-21T00:15:16.877255+0000","last_became_peered":"2024-09-21T00:15:16.877255+0000","last_unstale":"2024-09-21T00:15:17.868752+0000","last_undegraded":"2024-09-21T00:15:17.868752+0000","last_fullsized":"2024-09-21T00:15:17.868752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:59.633259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888359+0000","last_change":"2024-09-21T00:15:16.886033+0000","last_active":"2024-09-21T00:15:16.888359+0000","last_peered":"2024-09-21T00:15:16.888359+0000","last_clean":"2024-09-21T00:15:16.888359+0000","last_became_active":"2024-09-21T00:15:16.885733+0000","last_became_peered":"2024-09-21T00:15:16.885733+0000","last_unstale":"2024-09-21T00:15:16.888359+0000","last_undegraded":"2024-09-21T00:15:16.888359+0000","last_fullsized":"2024-09-21T00:15:16.888359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:20:09.045667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.873226+0000","last_change":"2024-09-21T00:15:16.867951+0000","last_active":"2024-09-21T00:15:16.873226+0000","last_peered":"2024-09-21T00:15:16.873226+0000","last_clean":"2024-09-21T00:15:16.873226+0000","last_became_active":"2024-09-21T00:15:16.867657+0000","last_became_peered":"2024-09-21T00:15:16.867657+0000","last_unstale":"2024-09-21T00:15:16.873226+0000","last_undegraded":"2024-09-21T00:15:16.873226+0000","last_fullsized":"2024-09-21T00:15:16.873226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:59.633259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865646+0000","last_change":"2024-09-21T00:15:16.878574+0000","last_active":"2024-09-21T00:15:17.865646+0000","last_peered":"2024-09-21T00:15:17.865646+0000","last_clean":"2024-09-21T00:15:17.865646+0000","last_became_active":"2024-09-21T00:15:16.878228+0000","last_became_peered":"2024-09-21T00:15:16.878228+0000","last_unstale":"2024-09-21T00:15:17.865646+0000","last_undegraded":"2024-09-21T00:15:17.865646+0000","last_fullsized":"2024-09-21T00:15:17.865646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:33.038941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.876743+0000","last_change":"2024-09-21T00:15:16.868688+0000","last_active":"2024-09-21T00:15:16.876743+0000","last_peered":"2024-09-21T00:15:16.876743+0000","last_clean":"2024-09-21T00:15:16.876743+0000","last_became_active":"2024-09-21T00:15:16.868393+0000","last_became_peered":"2024-09-21T00:15:16.868393+0000","last_unstale":"2024-09-21T00:15:16.876743+0000","last_undegraded":"2024-09-21T00:15:16.876743+0000","last_fullsized":"2024-09-21T00:15:16.876743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:42.112862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866592+0000","last_change":"2024-09-21T00:15:16.872582+0000","last_active":"2024-09-21T00:15:17.866592+0000","last_peered":"2024-09-21T00:15:17.866592+0000","last_clean":"2024-09-21T00:15:17.866592+0000","last_became_active":"2024-09-21T00:15:16.872290+0000","last_became_peered":"2024-09-21T00:15:16.872290+0000","last_unstale":"2024-09-21T00:15:17.866592+0000","last_undegraded":"2024-09-21T00:15:17.866592+0000","last_fullsized":"2024-09-21T00:15:17.866592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:27.588288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866182+0000","last_change":"2024-09-21T00:15:16.869555+0000","last_active":"2024-09-21T00:15:17.866182+0000","last_peered":"2024-09-21T00:15:17.866182+0000","last_clean":"2024-09-21T00:15:17.866182+0000","last_became_active":"2024-09-21T00:15:16.869251+0000","last_became_peered":"2024-09-21T00:15:16.869251+0000","last_unstale":"2024-09-21T00:15:17.866182+0000","last_undegraded":"2024-09-21T00:15:17.866182+0000","last_fullsized":"2024-09-21T00:15:17.866182+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:27.130026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-21T00:15:15.864138+0000","last_change":"2024-09-21T00:15:15.864138+0000","last_active":"2024-09-21T00:15:15.838346+0000","last_peered":"2024-09-21T00:15:15.838346+0000","last_clean":"2024-09-21T00:15:15.838346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T00:15:15.864138+0000","last_undegraded":"2024-09-21T00:15:15.864138+0000","last_fullsized":"2024-09-21T00:15:15.864138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.876036+0000","last_change":"2024-09-21T00:15:16.864289+0000","last_active":"2024-09-21T00:15:16.876036+0000","last_peered":"2024-09-21T00:15:16.876036+0000","last_clean":"2024-09-21T00:15:16.876036+0000","last_became_active":"2024-09-21T00:15:16.862950+0000","last_became_peered":"2024-09-21T00:15:16.862950+0000","last_unstale":"2024-09-21T00:15:16.876036+0000","last_undegraded":"2024-09-21T00:15:16.876036+0000","last_fullsized":"2024-09-21T00:15:16.876036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:25.302443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.877901+0000","last_change":"2024-09-21T00:15:16.865247+0000","last_active":"2024-09-21T00:15:16.877901+0000","last_peered":"2024-09-21T00:15:16.877901+0000","last_clean":"2024-09-21T00:15:16.877901+0000","last_became_active":"2024-09-21T00:15:16.864945+0000","last_became_peered":"2024-09-21T00:15:16.864945+0000","last_unstale":"2024-09-21T00:15:16.877901+0000","last_undegraded":"2024-09-21T00:15:16.877901+0000","last_fullsized":"2024-09-21T00:15:16.877901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:48.052839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885933+0000","last_change":"2024-09-21T00:15:16.880182+0000","last_active":"2024-09-21T00:15:16.885933+0000","last_peered":"2024-09-21T00:15:16.885933+0000","last_clean":"2024-09-21T00:15:16.885933+0000","last_became_active":"2024-09-21T00:15:16.874473+0000","last_became_peered":"2024-09-21T00:15:16.874473+0000","last_unstale":"2024-09-21T00:15:16.885933+0000","last_undegraded":"2024-09-21T00:15:16.885933+0000","last_fullsized":"2024-09-21T00:15:16.885933+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:03.681601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865743+0000","last_change":"2024-09-21T00:15:16.885945+0000","last_active":"2024-09-21T00:15:17.865743+0000","last_peered":"2024-09-21T00:15:17.865743+0000","last_clean":"2024-09-21T00:15:17.865743+0000","last_became_active":"2024-09-21T00:15:16.885606+0000","last_became_peered":"2024-09-21T00:15:16.885606+0000","last_unstale":"2024-09-21T00:15:17.865743+0000","last_undegraded":"2024-09-21T00:15:17.865743+0000","last_fullsized":"2024-09-21T00:15:17.865743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:14.873933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886342+0000","last_change":"2024-09-21T00:15:16.876420+0000","last_active":"2024-09-21T00:15:16.886342+0000","last_peered":"2024-09-21T00:15:16.886342+0000","last_clean":"2024-09-21T00:15:16.886342+0000","last_became_active":"2024-09-21T00:15:16.876184+0000","last_became_peered":"2024-09-21T00:15:16.876184+0000","last_unstale":"2024-09-21T00:15:16.886342+0000","last_undegraded":"2024-09-21T00:15:16.886342+0000","last_fullsized":"2024-09-21T00:15:16.886342+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:58.071856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889095+0000","last_change":"2024-09-21T00:15:16.875257+0000","last_active":"2024-09-21T00:15:16.889095+0000","last_peered":"2024-09-21T00:15:16.889095+0000","last_clean":"2024-09-21T00:15:16.889095+0000","last_became_active":"2024-09-21T00:15:16.874968+0000","last_became_peered":"2024-09-21T00:15:16.874968+0000","last_unstale":"2024-09-21T00:15:16.889095+0000","last_undegraded":"2024-09-21T00:15:16.889095+0000","last_fullsized":"2024-09-21T00:15:16.889095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:13.786819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.878361+0000","last_change":"2024-09-21T00:15:16.869118+0000","last_active":"2024-09-21T00:15:16.878361+0000","last_peered":"2024-09-21T00:15:16.878361+0000","last_clean":"2024-09-21T00:15:16.878361+0000","last_became_active":"2024-09-21T00:15:16.868763+0000","last_became_peered":"2024-09-21T00:15:16.868763+0000","last_unstale":"2024-09-21T00:15:16.878361+0000","last_undegraded":"2024-09-21T00:15:16.878361+0000","last_fullsized":"2024-09-21T00:15:16.878361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:23:49.873761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.887394+0000","last_change":"2024-09-21T00:15:16.883500+0000","last_active":"2024-09-21T00:15:16.887394+0000","last_peered":"2024-09-21T00:15:16.887394+0000","last_clean":"2024-09-21T00:15:16.887394+0000","last_became_active":"2024-09-21T00:15:16.883162+0000","last_became_peered":"2024-09-21T00:15:16.883162+0000","last_unstale":"2024-09-21T00:15:16.887394+0000","last_undegraded":"2024-09-21T00:15:16.887394+0000","last_fullsized":"2024-09-21T00:15:16.887394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:51.082466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.892774+0000","last_change":"2024-09-21T00:15:16.890105+0000","last_active":"2024-09-21T00:15:16.892774+0000","last_peered":"2024-09-21T00:15:16.892774+0000","last_clean":"2024-09-21T00:15:16.892774+0000","last_became_active":"2024-09-21T00:15:16.889782+0000","last_became_peered":"2024-09-21T00:15:16.889782+0000","last_unstale":"2024-09-21T00:15:16.892774+0000","last_undegraded":"2024-09-21T00:15:16.892774+0000","last_fullsized":"2024-09-21T00:15:16.892774+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:24.562660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866430+0000","last_change":"2024-09-21T00:15:16.883797+0000","last_active":"2024-09-21T00:15:17.866430+0000","last_peered":"2024-09-21T00:15:17.866430+0000","last_clean":"2024-09-21T00:15:17.866430+0000","last_became_active":"2024-09-21T00:15:16.882778+0000","last_became_peered":"2024-09-21T00:15:16.882778+0000","last_unstale":"2024-09-21T00:15:17.866430+0000","last_undegraded":"2024-09-21T00:15:17.866430+0000","last_fullsized":"2024-09-21T00:15:17.866430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:31.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865866+0000","last_change":"2024-09-21T00:15:16.881676+0000","last_active":"2024-09-21T00:15:17.865866+0000","last_peered":"2024-09-21T00:15:17.865866+0000","last_clean":"2024-09-21T00:15:17.865866+0000","last_became_active":"2024-09-21T00:15:16.881381+0000","last_became_peered":"2024-09-21T00:15:16.881381+0000","last_unstale":"2024-09-21T00:15:17.865866+0000","last_undegraded":"2024-09-21T00:15:17.865866+0000","last_fullsized":"2024-09-21T00:15:17.865866+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:29.864436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888158+0000","last_change":"2024-09-21T00:15:16.880582+0000","last_active":"2024-09-21T00:15:16.888158+0000","last_peered":"2024-09-21T00:15:16.888158+0000","last_clean":"2024-09-21T00:15:16.888158+0000","last_became_active":"2024-09-21T00:15:16.880298+0000","last_became_peered":"2024-09-21T00:15:16.880298+0000","last_unstale":"2024-09-21T00:15:16.888158+0000","last_undegraded":"2024-09-21T00:15:16.888158+0000","last_fullsized":"2024-09-21T00:15:16.888158+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:02.087826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893532+0000","last_change":"2024-09-21T00:15:16.881999+0000","last_active":"2024-09-21T00:15:16.893532+0000","last_peered":"2024-09-21T00:15:16.893532+0000","last_clean":"2024-09-21T00:15:16.893532+0000","last_became_active":"2024-09-21T00:15:16.881229+0000","last_became_peered":"2024-09-21T00:15:16.881229+0000","last_unstale":"2024-09-21T00:15:16.893532+0000","last_undegraded":"2024-09-21T00:15:16.893532+0000","last_fullsized":"2024-09-21T00:15:16.893532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.632208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866047+0000","last_change":"2024-09-21T00:15:16.867828+0000","last_active":"2024-09-21T00:15:17.866047+0000","last_peered":"2024-09-21T00:15:17.866047+0000","last_clean":"2024-09-21T00:15:17.866047+0000","last_became_active":"2024-09-21T00:15:16.867248+0000","last_became_peered":"2024-09-21T00:15:16.867248+0000","last_unstale":"2024-09-21T00:15:17.866047+0000","last_undegraded":"2024-09-21T00:15:17.866047+0000","last_fullsized":"2024-09-21T00:15:17.866047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:17.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889194+0000","last_change":"2024-09-21T00:15:15.871147+0000","last_active":"2024-09-21T00:15:16.889194+0000","last_peered":"2024-09-21T00:15:16.889194+0000","last_clean":"2024-09-21T00:15:16.889194+0000","last_became_active":"2024-09-21T00:15:15.870802+0000","last_became_peered":"2024-09-21T00:15:15.870802+0000","last_unstale":"2024-09-21T00:15:16.889194+0000","last_undegraded":"2024-09-21T00:15:16.889194+0000","last_fullsized":"2024-09-21T00:15:16.889194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:38.278690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885479+0000","last_change":"2024-09-21T00:15:16.883776+0000","last_active":"2024-09-21T00:15:16.885479+0000","last_peered":"2024-09-21T00:15:16.885479+0000","last_clean":"2024-09-21T00:15:16.885479+0000","last_became_active":"2024-09-21T00:15:16.881047+0000","last_became_peered":"2024-09-21T00:15:16.881047+0000","last_unstale":"2024-09-21T00:15:16.885479+0000","last_undegraded":"2024-09-21T00:15:16.885479+0000","last_fullsized":"2024-09-21T00:15:16.885479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:18.509764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885933+0000","last_change":"2024-09-21T00:15:15.865052+0000","last_active":"2024-09-21T00:15:16.885933+0000","last_peered":"2024-09-21T00:15:16.885933+0000","last_clean":"2024-09-21T00:15:16.885933+0000","last_became_active":"2024-09-21T00:15:15.864719+0000","last_became_peered":"2024-09-21T00:15:15.864719+0000","last_unstale":"2024-09-21T00:15:16.885933+0000","last_undegraded":"2024-09-21T00:15:16.885933+0000","last_fullsized":"2024-09-21T00:15:16.885933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:03.742657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866396+0000","last_change":"2024-09-21T00:15:16.875044+0000","last_active":"2024-09-21T00:15:17.866396+0000","last_peered":"2024-09-21T00:15:17.866396+0000","last_clean":"2024-09-21T00:15:17.866396+0000","last_became_active":"2024-09-21T00:15:16.869954+0000","last_became_peered":"2024-09-21T00:15:16.869954+0000","last_unstale":"2024-09-21T00:15:17.866396+0000","last_undegraded":"2024-09-21T00:15:17.866396+0000","last_fullsized":"2024-09-21T00:15:17.866396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:48.086484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900622+0000","last_change":"2024-09-21T00:15:15.869470+0000","last_active":"2024-09-21T00:15:16.900622+0000","last_peered":"2024-09-21T00:15:16.900622+0000","last_clean":"2024-09-21T00:15:16.900622+0000","last_became_active":"2024-09-21T00:15:15.869161+0000","last_became_peered":"2024-09-21T00:15:15.869161+0000","last_unstale":"2024-09-21T00:15:16.900622+0000","last_undegraded":"2024-09-21T00:15:16.900622+0000","last_fullsized":"2024-09-21T00:15:16.900622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:11.623197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.880499+0000","last_change":"2024-09-21T00:15:16.874950+0000","last_active":"2024-09-21T00:15:16.880499+0000","last_peered":"2024-09-21T00:15:16.880499+0000","last_clean":"2024-09-21T00:15:16.880499+0000","last_became_active":"2024-09-21T00:15:16.874649+0000","last_became_peered":"2024-09-21T00:15:16.874649+0000","last_unstale":"2024-09-21T00:15:16.880499+0000","last_undegraded":"2024-09-21T00:15:16.880499+0000","last_fullsized":"2024-09-21T00:15:16.880499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:00.593215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.899021+0000","last_change":"2024-09-21T00:15:15.876080+0000","last_active":"2024-09-21T00:15:16.899021+0000","last_peered":"2024-09-21T00:15:16.899021+0000","last_clean":"2024-09-21T00:15:16.899021+0000","last_became_active":"2024-09-21T00:15:15.875776+0000","last_became_peered":"2024-09-21T00:15:15.875776+0000","last_unstale":"2024-09-21T00:15:16.899021+0000","last_undegraded":"2024-09-21T00:15:16.899021+0000","last_fullsized":"2024-09-21T00:15:16.899021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:08.705060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.897229+0000","last_change":"2024-09-21T00:15:16.890109+0000","last_active":"2024-09-21T00:15:16.897229+0000","last_peered":"2024-09-21T00:15:16.897229+0000","last_clean":"2024-09-21T00:15:16.897229+0000","last_became_active":"2024-09-21T00:15:16.889670+0000","last_became_peered":"2024-09-21T00:15:16.889670+0000","last_unstale":"2024-09-21T00:15:16.897229+0000","last_undegraded":"2024-09-21T00:15:16.897229+0000","last_fullsized":"2024-09-21T00:15:16.897229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:02.210312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.887840+0000","last_change":"2024-09-21T00:15:15.863814+0000","last_active":"2024-09-21T00:15:16.887840+0000","last_peered":"2024-09-21T00:15:16.887840+0000","last_clean":"2024-09-21T00:15:16.887840+0000","last_became_active":"2024-09-21T00:15:15.862421+0000","last_became_peered":"2024-09-21T00:15:15.862421+0000","last_unstale":"2024-09-21T00:15:16.887840+0000","last_undegraded":"2024-09-21T00:15:16.887840+0000","last_fullsized":"2024-09-21T00:15:16.887840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:47.632876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888786+0000","last_change":"2024-09-21T00:15:16.885001+0000","last_active":"2024-09-21T00:15:16.888786+0000","last_peered":"2024-09-21T00:15:16.888786+0000","last_clean":"2024-09-21T00:15:16.888786+0000","last_became_active":"2024-09-21T00:15:16.884672+0000","last_became_peered":"2024-09-21T00:15:16.884672+0000","last_unstale":"2024-09-21T00:15:16.888786+0000","last_undegraded":"2024-09-21T00:15:16.888786+0000","last_fullsized":"2024-09-21T00:15:16.888786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.312162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893837+0000","last_change":"2024-09-21T00:15:15.868966+0000","last_active":"2024-09-21T00:15:16.893837+0000","last_peered":"2024-09-21T00:15:16.893837+0000","last_clean":"2024-09-21T00:15:16.893837+0000","last_became_active":"2024-09-21T00:15:15.868667+0000","last_became_peered":"2024-09-21T00:15:15.868667+0000","last_unstale":"2024-09-21T00:15:16.893837+0000","last_undegraded":"2024-09-21T00:15:16.893837+0000","last_fullsized":"2024-09-21T00:15:16.893837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:08:22.105332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866062+0000","last_change":"2024-09-21T00:15:16.863866+0000","last_active":"2024-09-21T00:15:17.866062+0000","last_peered":"2024-09-21T00:15:17.866062+0000","last_clean":"2024-09-21T00:15:17.866062+0000","last_became_active":"2024-09-21T00:15:16.862688+0000","last_became_peered":"2024-09-21T00:15:16.862688+0000","last_unstale":"2024-09-21T00:15:17.866062+0000","last_undegraded":"2024-09-21T00:15:17.866062+0000","last_fullsized":"2024-09-21T00:15:17.866062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:52.562904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.855893+0000","last_change":"2024-09-21T00:15:15.874143+0000","last_active":"2024-09-21T00:15:16.855893+0000","last_peered":"2024-09-21T00:15:16.855893+0000","last_clean":"2024-09-21T00:15:16.855893+0000","last_became_active":"2024-09-21T00:15:15.871902+0000","last_became_peered":"2024-09-21T00:15:15.871902+0000","last_unstale":"2024-09-21T00:15:16.855893+0000","last_undegraded":"2024-09-21T00:15:16.855893+0000","last_fullsized":"2024-09-21T00:15:16.855893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:24.299541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.884299+0000","last_change":"2024-09-21T00:15:16.876073+0000","last_active":"2024-09-21T00:15:16.884299+0000","last_peered":"2024-09-21T00:15:16.884299+0000","last_clean":"2024-09-21T00:15:16.884299+0000","last_became_active":"2024-09-21T00:15:16.875374+0000","last_became_peered":"2024-09-21T00:15:16.875374+0000","last_unstale":"2024-09-21T00:15:16.884299+0000","last_undegraded":"2024-09-21T00:15:16.884299+0000","last_fullsized":"2024-09-21T00:15:16.884299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:26:25.907755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866306+0000","last_change":"2024-09-21T00:15:15.872912+0000","last_active":"2024-09-21T00:15:16.866306+0000","last_peered":"2024-09-21T00:15:16.866306+0000","last_clean":"2024-09-21T00:15:16.866306+0000","last_became_active":"2024-09-21T00:15:15.872553+0000","last_became_peered":"2024-09-21T00:15:15.872553+0000","last_unstale":"2024-09-21T00:15:16.866306+0000","last_undegraded":"2024-09-21T00:15:16.866306+0000","last_fullsized":"2024-09-21T00:15:16.866306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:36.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.881302+0000","last_change":"2024-09-21T00:15:16.864727+0000","last_active":"2024-09-21T00:15:16.881302+0000","last_peered":"2024-09-21T00:15:16.881302+0000","last_clean":"2024-09-21T00:15:16.881302+0000","last_became_active":"2024-09-21T00:15:16.864246+0000","last_became_peered":"2024-09-21T00:15:16.864246+0000","last_unstale":"2024-09-21T00:15:16.881302+0000","last_undegraded":"2024-09-21T00:15:16.881302+0000","last_fullsized":"2024-09-21T00:15:16.881302+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:51.082466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.858347+0000","last_change":"2024-09-21T00:15:15.871490+0000","last_active":"2024-09-21T00:15:16.858347+0000","last_peered":"2024-09-21T00:15:16.858347+0000","last_clean":"2024-09-21T00:15:16.858347+0000","last_became_active":"2024-09-21T00:15:15.871156+0000","last_became_peered":"2024-09-21T00:15:15.871156+0000","last_unstale":"2024-09-21T00:15:16.858347+0000","last_undegraded":"2024-09-21T00:15:16.858347+0000","last_fullsized":"2024-09-21T00:15:16.858347+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:12.350916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889035+0000","last_change":"2024-09-21T00:15:16.876745+0000","last_active":"2024-09-21T00:15:16.889035+0000","last_peered":"2024-09-21T00:15:16.889035+0000","last_clean":"2024-09-21T00:15:16.889035+0000","last_became_active":"2024-09-21T00:15:16.876387+0000","last_became_peered":"2024-09-21T00:15:16.876387+0000","last_unstale":"2024-09-21T00:15:16.889035+0000","last_undegraded":"2024-09-21T00:15:16.889035+0000","last_fullsized":"2024-09-21T00:15:16.889035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:29.493781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866219+0000","last_change":"2024-09-21T00:15:15.861011+0000","last_active":"2024-09-21T00:15:17.866219+0000","last_peered":"2024-09-21T00:15:17.866219+0000","last_clean":"2024-09-21T00:15:17.866219+0000","last_became_active":"2024-09-21T00:15:15.859747+0000","last_became_peered":"2024-09-21T00:15:15.859747+0000","last_unstale":"2024-09-21T00:15:17.866219+0000","last_undegraded":"2024-09-21T00:15:17.866219+0000","last_fullsized":"2024-09-21T00:15:17.866219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:11.431973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879757+0000","last_change":"2024-09-21T00:15:16.871360+0000","last_active":"2024-09-21T00:15:16.879757+0000","last_peered":"2024-09-21T00:15:16.879757+0000","last_clean":"2024-09-21T00:15:16.879757+0000","last_became_active":"2024-09-21T00:15:16.871013+0000","last_became_peered":"2024-09-21T00:15:16.871013+0000","last_unstale":"2024-09-21T00:15:16.879757+0000","last_undegraded":"2024-09-21T00:15:16.879757+0000","last_fullsized":"2024-09-21T00:15:16.879757+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:13.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866222+0000","last_change":"2024-09-21T00:15:15.865177+0000","last_active":"2024-09-21T00:15:17.866222+0000","last_peered":"2024-09-21T00:15:17.866222+0000","last_clean":"2024-09-21T00:15:17.866222+0000","last_became_active":"2024-09-21T00:15:15.864924+0000","last_became_peered":"2024-09-21T00:15:15.864924+0000","last_unstale":"2024-09-21T00:15:17.866222+0000","last_undegraded":"2024-09-21T00:15:17.866222+0000","last_fullsized":"2024-09-21T00:15:17.866222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:04:53.011253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888496+0000","last_change":"2024-09-21T00:15:16.886616+0000","last_active":"2024-09-21T00:15:16.888496+0000","last_peered":"2024-09-21T00:15:16.888496+0000","last_clean":"2024-09-21T00:15:16.888496+0000","last_became_active":"2024-09-21T00:15:16.886309+0000","last_became_peered":"2024-09-21T00:15:16.886309+0000","last_unstale":"2024-09-21T00:15:16.888496+0000","last_undegraded":"2024-09-21T00:15:16.888496+0000","last_fullsized":"2024-09-21T00:15:16.888496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:22.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.907440+0000","last_change":"2024-09-21T00:15:15.872932+0000","last_active":"2024-09-21T00:15:16.907440+0000","last_peered":"2024-09-21T00:15:16.907440+0000","last_clean":"2024-09-21T00:15:16.907440+0000","last_became_active":"2024-09-21T00:15:15.872625+0000","last_became_peered":"2024-09-21T00:15:15.872625+0000","last_unstale":"2024-09-21T00:15:16.907440+0000","last_undegraded":"2024-09-21T00:15:16.907440+0000","last_fullsized":"2024-09-21T00:15:16.907440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:02.678699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.880518+0000","last_change":"2024-09-21T00:15:16.869519+0000","last_active":"2024-09-21T00:15:16.880518+0000","last_peered":"2024-09-21T00:15:16.880518+0000","last_clean":"2024-09-21T00:15:16.880518+0000","last_became_active":"2024-09-21T00:15:16.868514+0000","last_became_peered":"2024-09-21T00:15:16.868514+0000","last_unstale":"2024-09-21T00:15:16.880518+0000","last_undegraded":"2024-09-21T00:15:16.880518+0000","last_fullsized":"2024-09-21T00:15:16.880518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:04.585473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900610+0000","last_change":"2024-09-21T00:15:15.864869+0000","last_active":"2024-09-21T00:15:16.900610+0000","last_peered":"2024-09-21T00:15:16.900610+0000","last_clean":"2024-09-21T00:15:16.900610+0000","last_became_active":"2024-09-21T00:15:15.863402+0000","last_became_peered":"2024-09-21T00:15:15.863402+0000","last_unstale":"2024-09-21T00:15:16.900610+0000","last_undegraded":"2024-09-21T00:15:16.900610+0000","last_fullsized":"2024-09-21T00:15:16.900610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:15.543176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.891762+0000","last_change":"2024-09-21T00:15:16.889929+0000","last_active":"2024-09-21T00:15:16.891762+0000","last_peered":"2024-09-21T00:15:16.891762+0000","last_clean":"2024-09-21T00:15:16.891762+0000","last_became_active":"2024-09-21T00:15:16.889592+0000","last_became_peered":"2024-09-21T00:15:16.889592+0000","last_unstale":"2024-09-21T00:15:16.891762+0000","last_undegraded":"2024-09-21T00:15:16.891762+0000","last_fullsized":"2024-09-21T00:15:16.891762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:18:05.708718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.870448+0000","last_change":"2024-09-21T00:15:15.856402+0000","last_active":"2024-09-21T00:15:16.870448+0000","last_peered":"2024-09-21T00:15:16.870448+0000","last_clean":"2024-09-21T00:15:16.870448+0000","last_became_active":"2024-09-21T00:15:15.856065+0000","last_became_peered":"2024-09-21T00:15:15.856065+0000","last_unstale":"2024-09-21T00:15:16.870448+0000","last_undegraded":"2024-09-21T00:15:16.870448+0000","last_fullsized":"2024-09-21T00:15:16.870448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:34.468856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885960+0000","last_change":"2024-09-21T00:15:16.880219+0000","last_active":"2024-09-21T00:15:16.885960+0000","last_peered":"2024-09-21T00:15:16.885960+0000","last_clean":"2024-09-21T00:15:16.885960+0000","last_became_active":"2024-09-21T00:15:16.879024+0000","last_became_peered":"2024-09-21T00:15:16.879024+0000","last_unstale":"2024-09-21T00:15:16.885960+0000","last_undegraded":"2024-09-21T00:15:16.885960+0000","last_fullsized":"2024-09-21T00:15:16.885960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:12.626099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865879+0000","last_change":"2024-09-21T00:15:15.864833+0000","last_active":"2024-09-21T00:15:17.865879+0000","last_peered":"2024-09-21T00:15:17.865879+0000","last_clean":"2024-09-21T00:15:17.865879+0000","last_became_active":"2024-09-21T00:15:15.864497+0000","last_became_peered":"2024-09-21T00:15:15.864497+0000","last_unstale":"2024-09-21T00:15:17.865879+0000","last_undegraded":"2024-09-21T00:15:17.865879+0000","last_fullsized":"2024-09-21T00:15:17.865879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:49.050645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868649+0000","last_change":"2024-09-21T00:15:16.881508+0000","last_active":"2024-09-21T00:15:17.868649+0000","last_peered":"2024-09-21T00:15:17.868649+0000","last_clean":"2024-09-21T00:15:17.868649+0000","last_became_active":"2024-09-21T00:15:16.877197+0000","last_became_peered":"2024-09-21T00:15:16.877197+0000","last_unstale":"2024-09-21T00:15:17.868649+0000","last_undegraded":"2024-09-21T00:15:17.868649+0000","last_fullsized":"2024-09-21T00:15:17.868649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:39.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889411+0000","last_change":"2024-09-21T00:15:15.866587+0000","last_active":"2024-09-21T00:15:16.889411+0000","last_peered":"2024-09-21T00:15:16.889411+0000","last_clean":"2024-09-21T00:15:16.889411+0000","last_became_active":"2024-09-21T00:15:15.864940+0000","last_became_peered":"2024-09-21T00:15:15.864940+0000","last_unstale":"2024-09-21T00:15:16.889411+0000","last_undegraded":"2024-09-21T00:15:16.889411+0000","last_fullsized":"2024-09-21T00:15:16.889411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:22.127731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893356+0000","last_change":"2024-09-21T00:15:16.892157+0000","last_active":"2024-09-21T00:15:16.893356+0000","last_peered":"2024-09-21T00:15:16.893356+0000","last_clean":"2024-09-21T00:15:16.893356+0000","last_became_active":"2024-09-21T00:15:16.888127+0000","last_became_peered":"2024-09-21T00:15:16.888127+0000","last_unstale":"2024-09-21T00:15:16.893356+0000","last_undegraded":"2024-09-21T00:15:16.893356+0000","last_fullsized":"2024-09-21T00:15:16.893356+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:02.683038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889917+0000","last_change":"2024-09-21T00:15:15.873619+0000","last_active":"2024-09-21T00:15:16.889917+0000","last_peered":"2024-09-21T00:15:16.889917+0000","last_clean":"2024-09-21T00:15:16.889917+0000","last_became_active":"2024-09-21T00:15:15.873342+0000","last_became_peered":"2024-09-21T00:15:15.873342+0000","last_unstale":"2024-09-21T00:15:16.889917+0000","last_undegraded":"2024-09-21T00:15:16.889917+0000","last_fullsized":"2024-09-21T00:15:16.889917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:40.599261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900501+0000","last_change":"2024-09-21T00:15:16.894537+0000","last_active":"2024-09-21T00:15:16.900501+0000","last_peered":"2024-09-21T00:15:16.900501+0000","last_clean":"2024-09-21T00:15:16.900501+0000","last_became_active":"2024-09-21T00:15:16.894328+0000","last_became_peered":"2024-09-21T00:15:16.894328+0000","last_unstale":"2024-09-21T00:15:16.900501+0000","last_undegraded":"2024-09-21T00:15:16.900501+0000","last_fullsized":"2024-09-21T00:15:16.900501+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:32.391700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866406+0000","last_change":"2024-09-21T00:15:15.869830+0000","last_active":"2024-09-21T00:15:17.866406+0000","last_peered":"2024-09-21T00:15:17.866406+0000","last_clean":"2024-09-21T00:15:17.866406+0000","last_became_active":"2024-09-21T00:15:15.867650+0000","last_became_peered":"2024-09-21T00:15:15.867650+0000","last_unstale":"2024-09-21T00:15:17.866406+0000","last_undegraded":"2024-09-21T00:15:17.866406+0000","last_fullsized":"2024-09-21T00:15:17.866406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:28.691334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.890222+0000","last_change":"2024-09-21T00:15:16.887082+0000","last_active":"2024-09-21T00:15:16.890222+0000","last_peered":"2024-09-21T00:15:16.890222+0000","last_clean":"2024-09-21T00:15:16.890222+0000","last_became_active":"2024-09-21T00:15:16.885720+0000","last_became_peered":"2024-09-21T00:15:16.885720+0000","last_unstale":"2024-09-21T00:15:16.890222+0000","last_undegraded":"2024-09-21T00:15:16.890222+0000","last_fullsized":"2024-09-21T00:15:16.890222+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:53.816749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867676+0000","last_change":"2024-09-21T00:15:15.872212+0000","last_active":"2024-09-21T00:15:17.867676+0000","last_peered":"2024-09-21T00:15:17.867676+0000","last_clean":"2024-09-21T00:15:17.867676+0000","last_became_active":"2024-09-21T00:15:15.870779+0000","last_became_peered":"2024-09-21T00:15:15.870779+0000","last_unstale":"2024-09-21T00:15:17.867676+0000","last_undegraded":"2024-09-21T00:15:17.867676+0000","last_fullsized":"2024-09-21T00:15:17.867676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:43.736010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-21T00:15:15.864118+0000","last_change":"2024-09-21T00:15:15.864118+0000","last_active":"2024-09-21T00:15:15.838346+0000","last_peered":"2024-09-21T00:15:15.838346+0000","last_clean":"2024-09-21T00:15:15.838346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T00:15:15.864118+0000","last_undegraded":"2024-09-21T00:15:15.864118+0000","last_fullsized":"2024-09-21T00:15:15.864118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T00:15:15.876395+0000","last_change":"2024-09-21T00:15:15.873944+0000","last_active":"2024-09-21T00:15:15.876395+0000","last_peered":"2024-09-21T00:15:15.876395+0000","last_clean":"2024-09-21T00:15:15.876395+0000","last_became_active":"2024-09-21T00:15:15.873612+0000","last_became_peered":"2024-09-21T00:15:15.873612+0000","last_unstale":"2024-09-21T00:15:15.876395+0000","last_undegraded":"2024-09-21T00:15:15.876395+0000","last_fullsized":"2024-09-21T00:15:15.876395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:31.652679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865655+0000","last_change":"2024-09-21T00:15:16.878490+0000","last_active":"2024-09-21T00:15:17.865655+0000","last_peered":"2024-09-21T00:15:17.865655+0000","last_clean":"2024-09-21T00:15:17.865655+0000","last_became_active":"2024-09-21T00:15:16.878218+0000","last_became_peered":"2024-09-21T00:15:16.878218+0000","last_unstale":"2024-09-21T00:15:17.865655+0000","last_undegraded":"2024-09-21T00:15:17.865655+0000","last_fullsized":"2024-09-21T00:15:17.865655+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:58.804183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T00:15:15.875463+0000","last_change":"2024-09-21T00:15:15.869680+0000","last_active":"2024-09-21T00:15:15.875463+0000","last_peered":"2024-09-21T00:15:15.875463+0000","last_clean":"2024-09-21T00:15:15.875463+0000","last_became_active":"2024-09-21T00:15:15.869363+0000","last_became_peered":"2024-09-21T00:15:15.869363+0000","last_unstale":"2024-09-21T00:15:15.875463+0000","last_undegraded":"2024-09-21T00:15:15.875463+0000","last_fullsized":"2024-09-21T00:15:15.875463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:30.627507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893469+0000","last_change":"2024-09-21T00:15:16.881332+0000","last_active":"2024-09-21T00:15:16.893469+0000","last_peered":"2024-09-21T00:15:16.893469+0000","last_clean":"2024-09-21T00:15:16.893469+0000","last_became_active":"2024-09-21T00:15:16.881080+0000","last_became_peered":"2024-09-21T00:15:16.881080+0000","last_unstale":"2024-09-21T00:15:16.893469+0000","last_undegraded":"2024-09-21T00:15:16.893469+0000","last_fullsized":"2024-09-21T00:15:16.893469+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:34.255761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.870217+0000","last_change":"2024-09-21T00:15:15.869495+0000","last_active":"2024-09-21T00:15:16.870217+0000","last_peered":"2024-09-21T00:15:16.870217+0000","last_clean":"2024-09-21T00:15:16.870217+0000","last_became_active":"2024-09-21T00:15:15.868711+0000","last_became_peered":"2024-09-21T00:15:15.868711+0000","last_unstale":"2024-09-21T00:15:16.870217+0000","last_undegraded":"2024-09-21T00:15:16.870217+0000","last_fullsized":"2024-09-21T00:15:16.870217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:29.397639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879204+0000","last_change":"2024-09-21T00:15:16.871518+0000","last_active":"2024-09-21T00:15:16.879204+0000","last_peered":"2024-09-21T00:15:16.879204+0000","last_clean":"2024-09-21T00:15:16.879204+0000","last_became_active":"2024-09-21T00:15:16.867533+0000","last_became_peered":"2024-09-21T00:15:16.867533+0000","last_unstale":"2024-09-21T00:15:16.879204+0000","last_undegraded":"2024-09-21T00:15:16.879204+0000","last_fullsized":"2024-09-21T00:15:16.879204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:16.546077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866257+0000","last_change":"2024-09-21T00:15:15.873204+0000","last_active":"2024-09-21T00:15:16.866257+0000","last_peered":"2024-09-21T00:15:16.866257+0000","last_clean":"2024-09-21T00:15:16.866257+0000","last_became_active":"2024-09-21T00:15:15.872545+0000","last_became_peered":"2024-09-21T00:15:15.872545+0000","last_unstale":"2024-09-21T00:15:16.866257+0000","last_undegraded":"2024-09-21T00:15:16.866257+0000","last_fullsized":"2024-09-21T00:15:16.866257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:30.945225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.897267+0000","last_change":"2024-09-21T00:15:16.879831+0000","last_active":"2024-09-21T00:15:16.897267+0000","last_peered":"2024-09-21T00:15:16.897267+0000","last_clean":"2024-09-21T00:15:16.897267+0000","last_became_active":"2024-09-21T00:15:16.879538+0000","last_became_peered":"2024-09-21T00:15:16.879538+0000","last_unstale":"2024-09-21T00:15:16.897267+0000","last_undegraded":"2024-09-21T00:15:16.897267+0000","last_fullsized":"2024-09-21T00:15:16.897267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:58.449816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.867406+0000","last_change":"2024-09-21T00:15:15.868499+0000","last_active":"2024-09-21T00:15:16.867406+0000","last_peered":"2024-09-21T00:15:16.867406+0000","last_clean":"2024-09-21T00:15:16.867406+0000","last_became_active":"2024-09-21T00:15:15.868218+0000","last_became_peered":"2024-09-21T00:15:15.868218+0000","last_unstale":"2024-09-21T00:15:16.867406+0000","last_undegraded":"2024-09-21T00:15:16.867406+0000","last_fullsized":"2024-09-21T00:15:16.867406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.537075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868970+0000","last_change":"2024-09-21T00:15:16.882839+0000","last_active":"2024-09-21T00:15:17.868970+0000","last_peered":"2024-09-21T00:15:17.868970+0000","last_clean":"2024-09-21T00:15:17.868970+0000","last_became_active":"2024-09-21T00:15:16.878078+0000","last_became_peered":"2024-09-21T00:15:16.878078+0000","last_unstale":"2024-09-21T00:15:17.868970+0000","last_undegraded":"2024-09-21T00:15:17.868970+0000","last_fullsized":"2024-09-21T00:15:17.868970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:13.786819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866618+0000","last_change":"2024-09-21T00:15:15.861682+0000","last_active":"2024-09-21T00:15:17.866618+0000","last_peered":"2024-09-21T00:15:17.866618+0000","last_clean":"2024-09-21T00:15:17.866618+0000","last_became_active":"2024-09-21T00:15:15.861408+0000","last_became_peered":"2024-09-21T00:15:15.861408+0000","last_unstale":"2024-09-21T00:15:17.866618+0000","last_undegraded":"2024-09-21T00:15:17.866618+0000","last_fullsized":"2024-09-21T00:15:17.866618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:30.905194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879887+0000","last_change":"2024-09-21T00:15:16.875154+0000","last_active":"2024-09-21T00:15:16.879887+0000","last_peered":"2024-09-21T00:15:16.879887+0000","last_clean":"2024-09-21T00:15:16.879887+0000","last_became_active":"2024-09-21T00:15:16.874266+0000","last_became_peered":"2024-09-21T00:15:16.874266+0000","last_unstale":"2024-09-21T00:15:16.879887+0000","last_undegraded":"2024-09-21T00:15:16.879887+0000","last_fullsized":"2024-09-21T00:15:16.879887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:24.704654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868030+0000","last_change":"2024-09-21T00:15:15.874388+0000","last_active":"2024-09-21T00:15:17.868030+0000","last_peered":"2024-09-21T00:15:17.868030+0000","last_clean":"2024-09-21T00:15:17.868030+0000","last_became_active":"2024-09-21T00:15:15.873129+0000","last_became_peered":"2024-09-21T00:15:15.873129+0000","last_unstale":"2024-09-21T00:15:17.868030+0000","last_undegraded":"2024-09-21T00:15:17.868030+0000","last_fullsized":"2024-09-21T00:15:17.868030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:14.230132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-21T00:15:15.861246+0000","last_change":"2024-09-21T00:15:15.861246+0000","last_active":"2024-09-21T00:15:15.838346+0000","last_peered":"2024-09-21T00:15:15.838346+0000","last_clean":"2024-09-21T00:15:15.838346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T00:15:15.861246+0000","last_undegraded":"2024-09-21T00:15:15.861246+0000","last_fullsized":"2024-09-21T00:15:15.861246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867811+0000","last_change":"2024-09-21T00:15:15.863805+0000","last_active":"2024-09-21T00:15:17.867811+0000","last_peered":"2024-09-21T00:15:17.867811+0000","last_clean":"2024-09-21T00:15:17.867811+0000","last_became_active":"2024-09-21T00:15:15.863461+0000","last_became_peered":"2024-09-21T00:15:15.863461+0000","last_unstale":"2024-09-21T00:15:17.867811+0000","last_undegraded":"2024-09-21T00:15:17.867811+0000","last_fullsized":"2024-09-21T00:15:17.867811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:26.759455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867630+0000","last_change":"2024-09-21T00:15:16.864392+0000","last_active":"2024-09-21T00:15:17.867630+0000","last_peered":"2024-09-21T00:15:17.867630+0000","last_clean":"2024-09-21T00:15:17.867630+0000","last_became_active":"2024-09-21T00:15:16.864065+0000","last_became_peered":"2024-09-21T00:15:16.864065+0000","last_unstale":"2024-09-21T00:15:17.867630+0000","last_undegraded":"2024-09-21T00:15:17.867630+0000","last_fullsized":"2024-09-21T00:15:17.867630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:23.130632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.858033+0000","last_change":"2024-09-21T00:15:15.863840+0000","last_active":"2024-09-21T00:15:16.858033+0000","last_peered":"2024-09-21T00:15:16.858033+0000","last_clean":"2024-09-21T00:15:16.858033+0000","last_became_active":"2024-09-21T00:15:15.863081+0000","last_became_peered":"2024-09-21T00:15:15.863081+0000","last_unstale":"2024-09-21T00:15:16.858033+0000","last_undegraded":"2024-09-21T00:15:16.858033+0000","last_fullsized":"2024-09-21T00:15:16.858033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:23.701752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885634+0000","last_change":"2024-09-21T00:15:16.881804+0000","last_active":"2024-09-21T00:15:16.885634+0000","last_peered":"2024-09-21T00:15:16.885634+0000","last_clean":"2024-09-21T00:15:16.885634+0000","last_became_active":"2024-09-21T00:15:16.881268+0000","last_became_peered":"2024-09-21T00:15:16.881268+0000","last_unstale":"2024-09-21T00:15:16.885634+0000","last_undegraded":"2024-09-21T00:15:16.885634+0000","last_fullsized":"2024-09-21T00:15:16.885634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:36.128848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.856977+0000","last_change":"2024-09-21T00:15:15.874106+0000","last_active":"2024-09-21T00:15:16.856977+0000","last_peered":"2024-09-21T00:15:16.856977+0000","last_clean":"2024-09-21T00:15:16.856977+0000","last_became_active":"2024-09-21T00:15:15.873619+0000","last_became_peered":"2024-09-21T00:15:15.873619+0000","last_unstale":"2024-09-21T00:15:16.856977+0000","last_undegraded":"2024-09-21T00:15:16.856977+0000","last_fullsized":"2024-09-21T00:15:16.856977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:28.490880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866088+0000","last_change":"2024-09-21T00:15:16.861424+0000","last_active":"2024-09-21T00:15:17.866088+0000","last_peered":"2024-09-21T00:15:17.866088+0000","last_clean":"2024-09-21T00:15:17.866088+0000","last_became_active":"2024-09-21T00:15:16.861130+0000","last_became_peered":"2024-09-21T00:15:16.861130+0000","last_unstale":"2024-09-21T00:15:17.866088+0000","last_undegraded":"2024-09-21T00:15:17.866088+0000","last_fullsized":"2024-09-21T00:15:17.866088+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:05.839943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865885+0000","last_change":"2024-09-21T00:15:15.860701+0000","last_active":"2024-09-21T00:15:17.865885+0000","last_peered":"2024-09-21T00:15:17.865885+0000","last_clean":"2024-09-21T00:15:17.865885+0000","last_became_active":"2024-09-21T00:15:15.860434+0000","last_became_peered":"2024-09-21T00:15:15.860434+0000","last_unstale":"2024-09-21T00:15:17.865885+0000","last_undegraded":"2024-09-21T00:15:17.865885+0000","last_fullsized":"2024-09-21T00:15:17.865885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:02.081143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886058+0000","last_change":"2024-09-21T00:15:16.881672+0000","last_active":"2024-09-21T00:15:16.886058+0000","last_peered":"2024-09-21T00:15:16.886058+0000","last_clean":"2024-09-21T00:15:16.886058+0000","last_became_active":"2024-09-21T00:15:16.881337+0000","last_became_peered":"2024-09-21T00:15:16.881337+0000","last_unstale":"2024-09-21T00:15:16.886058+0000","last_undegraded":"2024-09-21T00:15:16.886058+0000","last_fullsized":"2024-09-21T00:15:16.886058+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:28.019280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.857047+0000","last_change":"2024-09-21T00:15:15.866551+0000","last_active":"2024-09-21T00:15:16.857047+0000","last_peered":"2024-09-21T00:15:16.857047+0000","last_clean":"2024-09-21T00:15:16.857047+0000","last_became_active":"2024-09-21T00:15:15.866253+0000","last_became_peered":"2024-09-21T00:15:15.866253+0000","last_unstale":"2024-09-21T00:15:16.857047+0000","last_undegraded":"2024-09-21T00:15:16.857047+0000","last_fullsized":"2024-09-21T00:15:16.857047+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:47.049937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866440+0000","last_change":"2024-09-21T00:15:16.887371+0000","last_active":"2024-09-21T00:15:17.866440+0000","last_peered":"2024-09-21T00:15:17.866440+0000","last_clean":"2024-09-21T00:15:17.866440+0000","last_became_active":"2024-09-21T00:15:16.887049+0000","last_became_peered":"2024-09-21T00:15:16.887049+0000","last_unstale":"2024-09-21T00:15:17.866440+0000","last_undegraded":"2024-09-21T00:15:17.866440+0000","last_fullsized":"2024-09-21T00:15:17.866440+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:02.733269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.854744+0000","last_change":"2024-09-21T00:15:15.874239+0000","last_active":"2024-09-21T00:15:16.854744+0000","last_peered":"2024-09-21T00:15:16.854744+0000","last_clean":"2024-09-21T00:15:16.854744+0000","last_became_active":"2024-09-21T00:15:15.873980+0000","last_became_peered":"2024-09-21T00:15:15.873980+0000","last_unstale":"2024-09-21T00:15:16.854744+0000","last_undegraded":"2024-09-21T00:15:16.854744+0000","last_fullsized":"2024-09-21T00:15:16.854744+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:12.783917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866375+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:15:16.866375+0000","last_peered":"2024-09-21T00:15:16.866375+0000","last_clean":"2024-09-21T00:15:16.866375+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:15:16.866375+0000","last_undegraded":"2024-09-21T00:15:16.866375+0000","last_fullsized":"2024-09-21T00:15:16.866375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":475136,"data_stored":194497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":194955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1052672,"data_stored":783151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":192853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":769295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:15:21.791 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:15:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.048+0000 7fe73f000640 1 -- 172.21.15.83:0/1532992840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7380ce860 msgr2=0x7fe73815f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.048+0000 7fe73f000640 1 --2- 172.21.15.83:0/1532992840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7380ce860 0x7fe73815f5a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe738072560 tx=0x7fe73002aa30 comp rx=0 tx=0).stop 2024-09-21T00:15:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.048+0000 7fe73f000640 1 -- 172.21.15.83:0/1532992840 shutdown_connections 2024-09-21T00:15:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.048+0000 7fe73f000640 1 --2- 172.21.15.83:0/1532992840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7380ce860 0x7fe73815f5a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.048+0000 7fe73f000640 1 --2- 172.21.15.83:0/1532992840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7380cefa0 0x7fe7380ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.048+0000 7fe73f000640 1 --2- 172.21.15.83:0/1532992840 >> v2:172.21.15.142:3300/0 conn(0x7fe73815b9f0 0x7fe7380cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.048+0000 7fe73f000640 1 -- 172.21.15.83:0/1532992840 >> 172.21.15.83:0/1532992840 conn(0x7fe7380cca40 msgr2=0x7fe7380cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.048+0000 7fe73f000640 1 -- 172.21.15.83:0/1532992840 shutdown_connections 2024-09-21T00:15:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.048+0000 7fe73f000640 1 -- 172.21.15.83:0/1532992840 wait complete. 2024-09-21T00:15:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.050+0000 7fe73f000640 1 Processor -- start 2024-09-21T00:15:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.051+0000 7fe73f000640 1 -- start start 2024-09-21T00:15:22.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.052+0000 7fe73f000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7380ce860 0x7fe7381f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:22.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.052+0000 7fe73f000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7380cefa0 0x7fe7380a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:22.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.052+0000 7fe73f000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73815b9f0 0x7fe7380b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.052+0000 7fe73f000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe73815fe70 con 0x7fe7380cefa0 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.052+0000 7fe73f000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe73815fcf0 con 0x7fe73815b9f0 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.052+0000 7fe73f000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe73806ddf0 con 0x7fe7380ce860 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.052+0000 7fe72fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7380cefa0 0x7fe7380a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.052+0000 7fe72fe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7380cefa0 0x7fe7380a01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43246/0 (socket says 172.21.15.83:43246) 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.052+0000 7fe72fe00640 1 -- 172.21.15.83:0/2223233353 learned_addr learned my addr 172.21.15.83:0/2223233353 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe73d000640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73815b9f0 0x7fe7380b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe72fe00640 1 -- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7380ce860 msgr2=0x7fe7381f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe737e00640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7380ce860 0x7fe7381f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe72fe00640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7380ce860 0x7fe7381f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe72fe00640 1 -- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73815b9f0 msgr2=0x7fe7380b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe72fe00640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73815b9f0 0x7fe7380b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe72fe00640 1 -- 172.21.15.83:0/2223233353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7380b57d0 con 0x7fe7380cefa0 2024-09-21T00:15:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe73d000640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73815b9f0 0x7fe7380b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe737e00640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7380ce860 0x7fe7381f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe72fe00640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7380cefa0 0x7fe7380a01a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe72000e750 tx=0x7fe72000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe734c00640 1 -- 172.21.15.83:0/2223233353 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72000ccc0 con 0x7fe7380cefa0 2024-09-21T00:15:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe734c00640 1 -- 172.21.15.83:0/2223233353 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe72000ee60 con 0x7fe7380cefa0 2024-09-21T00:15:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe73f000640 1 -- 172.21.15.83:0/2223233353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7380b5ab0 con 0x7fe7380cefa0 2024-09-21T00:15:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe734c00640 1 -- 172.21.15.83:0/2223233353 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72000ce60 con 0x7fe7380cefa0 2024-09-21T00:15:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.053+0000 7fe73f000640 1 -- 172.21.15.83:0/2223233353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73809fc80 con 0x7fe7380cefa0 2024-09-21T00:15:22.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.054+0000 7fe73f000640 1 -- 172.21.15.83:0/2223233353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73809f7d0 con 0x7fe7380cefa0 2024-09-21T00:15:22.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.056+0000 7fe734c00640 1 -- 172.21.15.83:0/2223233353 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe720005280 con 0x7fe7380cefa0 2024-09-21T00:15:22.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.057+0000 7fe734c00640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe714078b90 0x7fe71407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:22.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.057+0000 7fe734c00640 1 -- 172.21.15.83:0/2223233353 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fe72009b9a0 con 0x7fe7380cefa0 2024-09-21T00:15:22.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.057+0000 7fe737e00640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe714078b90 0x7fe71407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:22.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.058+0000 7fe737e00640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe714078b90 0x7fe71407b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe728009a30 tx=0x7fe728005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:22.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.061+0000 7fe734c00640 1 -- 172.21.15.83:0/2223233353 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe720063bb0 con 0x7fe7380cefa0 2024-09-21T00:15:22.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.242+0000 7fe73f000640 1 -- 172.21.15.83:0/2223233353 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7380c6de0 con 0x7fe714078b90 2024-09-21T00:15:22.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.247+0000 7fe734c00640 1 -- 172.21.15.83:0/2223233353 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251689 (secure 0 0 0) 0x7fe7380c6de0 con 0x7fe714078b90 2024-09-21T00:15:22.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:22.253 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 -- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe714078b90 msgr2=0x7fe71407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe714078b90 0x7fe71407b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe728009a30 tx=0x7fe728005f90 comp rx=0 tx=0).stop 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 -- 172.21.15.83:0/2223233353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7380cefa0 msgr2=0x7fe7380a01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7380cefa0 0x7fe7380a01a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe72000e750 tx=0x7fe72000ec10 comp rx=0 tx=0).stop 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 -- 172.21.15.83:0/2223233353 shutdown_connections 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe714078b90 0x7fe71407b0a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73815b9f0 0x7fe7380b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7380cefa0 0x7fe7380a01a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 --2- 172.21.15.83:0/2223233353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7380ce860 0x7fe7381f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 -- 172.21.15.83:0/2223233353 >> 172.21.15.83:0/2223233353 conn(0x7fe7380cca40 msgr2=0x7fe7380ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 -- 172.21.15.83:0/2223233353 shutdown_connections 2024-09-21T00:15:22.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.251+0000 7fe73f000640 1 -- 172.21.15.83:0/2223233353 wait complete. 2024-09-21T00:15:22.274 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-21T00:15:20.869390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221028,"kb_used_data":4748,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753692,"statfs":{"total":773094113280,"available":772867780608,"internally_reserved":0,"allocated":4861952,"data_stored":2713228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001964"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893738+0000","last_change":"2024-09-21T00:15:16.887689+0000","last_active":"2024-09-21T00:15:16.893738+0000","last_peered":"2024-09-21T00:15:16.893738+0000","last_clean":"2024-09-21T00:15:16.893738+0000","last_became_active":"2024-09-21T00:15:16.886688+0000","last_became_peered":"2024-09-21T00:15:16.886688+0000","last_unstale":"2024-09-21T00:15:16.893738+0000","last_undegraded":"2024-09-21T00:15:16.893738+0000","last_fullsized":"2024-09-21T00:15:16.893738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.498683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888756+0000","last_change":"2024-09-21T00:15:16.885091+0000","last_active":"2024-09-21T00:15:16.888756+0000","last_peered":"2024-09-21T00:15:16.888756+0000","last_clean":"2024-09-21T00:15:16.888756+0000","last_became_active":"2024-09-21T00:15:16.878833+0000","last_became_peered":"2024-09-21T00:15:16.878833+0000","last_unstale":"2024-09-21T00:15:16.888756+0000","last_undegraded":"2024-09-21T00:15:16.888756+0000","last_fullsized":"2024-09-21T00:15:16.888756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:05.866795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.874244+0000","last_change":"2024-09-21T00:15:16.866321+0000","last_active":"2024-09-21T00:15:16.874244+0000","last_peered":"2024-09-21T00:15:16.874244+0000","last_clean":"2024-09-21T00:15:16.874244+0000","last_became_active":"2024-09-21T00:15:16.865947+0000","last_became_peered":"2024-09-21T00:15:16.865947+0000","last_unstale":"2024-09-21T00:15:16.874244+0000","last_undegraded":"2024-09-21T00:15:16.874244+0000","last_fullsized":"2024-09-21T00:15:16.874244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.312162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.864229+0000","last_change":"2024-09-21T00:15:16.862740+0000","last_active":"2024-09-21T00:15:16.864229+0000","last_peered":"2024-09-21T00:15:16.864229+0000","last_clean":"2024-09-21T00:15:16.864229+0000","last_became_active":"2024-09-21T00:15:16.861357+0000","last_became_peered":"2024-09-21T00:15:16.861357+0000","last_unstale":"2024-09-21T00:15:16.864229+0000","last_undegraded":"2024-09-21T00:15:16.864229+0000","last_fullsized":"2024-09-21T00:15:16.864229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:28.019280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868472+0000","last_change":"2024-09-21T00:15:16.882024+0000","last_active":"2024-09-21T00:15:17.868472+0000","last_peered":"2024-09-21T00:15:17.868472+0000","last_clean":"2024-09-21T00:15:17.868472+0000","last_became_active":"2024-09-21T00:15:16.878211+0000","last_became_peered":"2024-09-21T00:15:16.878211+0000","last_unstale":"2024-09-21T00:15:17.868472+0000","last_undegraded":"2024-09-21T00:15:17.868472+0000","last_fullsized":"2024-09-21T00:15:17.868472+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:48.635778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885291+0000","last_change":"2024-09-21T00:15:16.881989+0000","last_active":"2024-09-21T00:15:16.885291+0000","last_peered":"2024-09-21T00:15:16.885291+0000","last_clean":"2024-09-21T00:15:16.885291+0000","last_became_active":"2024-09-21T00:15:16.881672+0000","last_became_peered":"2024-09-21T00:15:16.881672+0000","last_unstale":"2024-09-21T00:15:16.885291+0000","last_undegraded":"2024-09-21T00:15:16.885291+0000","last_fullsized":"2024-09-21T00:15:16.885291+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:15.743262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.890066+0000","last_change":"2024-09-21T00:15:16.886616+0000","last_active":"2024-09-21T00:15:16.890066+0000","last_peered":"2024-09-21T00:15:16.890066+0000","last_clean":"2024-09-21T00:15:16.890066+0000","last_became_active":"2024-09-21T00:15:16.886275+0000","last_became_peered":"2024-09-21T00:15:16.886275+0000","last_unstale":"2024-09-21T00:15:16.890066+0000","last_undegraded":"2024-09-21T00:15:16.890066+0000","last_fullsized":"2024-09-21T00:15:16.890066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:02:33.652281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893560+0000","last_change":"2024-09-21T00:15:16.882497+0000","last_active":"2024-09-21T00:15:16.893560+0000","last_peered":"2024-09-21T00:15:16.893560+0000","last_clean":"2024-09-21T00:15:16.893560+0000","last_became_active":"2024-09-21T00:15:16.881675+0000","last_became_peered":"2024-09-21T00:15:16.881675+0000","last_unstale":"2024-09-21T00:15:16.893560+0000","last_undegraded":"2024-09-21T00:15:16.893560+0000","last_fullsized":"2024-09-21T00:15:16.893560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:10.585312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868290+0000","last_change":"2024-09-21T00:15:16.869075+0000","last_active":"2024-09-21T00:15:17.868290+0000","last_peered":"2024-09-21T00:15:17.868290+0000","last_clean":"2024-09-21T00:15:17.868290+0000","last_became_active":"2024-09-21T00:15:16.868688+0000","last_became_peered":"2024-09-21T00:15:16.868688+0000","last_unstale":"2024-09-21T00:15:17.868290+0000","last_undegraded":"2024-09-21T00:15:17.868290+0000","last_fullsized":"2024-09-21T00:15:17.868290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:09.707961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886006+0000","last_change":"2024-09-21T00:15:16.877674+0000","last_active":"2024-09-21T00:15:16.886006+0000","last_peered":"2024-09-21T00:15:16.886006+0000","last_clean":"2024-09-21T00:15:16.886006+0000","last_became_active":"2024-09-21T00:15:16.877348+0000","last_became_peered":"2024-09-21T00:15:16.877348+0000","last_unstale":"2024-09-21T00:15:16.886006+0000","last_undegraded":"2024-09-21T00:15:16.886006+0000","last_fullsized":"2024-09-21T00:15:16.886006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:38.180375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879914+0000","last_change":"2024-09-21T00:15:16.875449+0000","last_active":"2024-09-21T00:15:16.879914+0000","last_peered":"2024-09-21T00:15:16.879914+0000","last_clean":"2024-09-21T00:15:16.879914+0000","last_became_active":"2024-09-21T00:15:16.874660+0000","last_became_peered":"2024-09-21T00:15:16.874660+0000","last_unstale":"2024-09-21T00:15:16.879914+0000","last_undegraded":"2024-09-21T00:15:16.879914+0000","last_fullsized":"2024-09-21T00:15:16.879914+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:13.353817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868752+0000","last_change":"2024-09-21T00:15:16.880104+0000","last_active":"2024-09-21T00:15:17.868752+0000","last_peered":"2024-09-21T00:15:17.868752+0000","last_clean":"2024-09-21T00:15:17.868752+0000","last_became_active":"2024-09-21T00:15:16.877255+0000","last_became_peered":"2024-09-21T00:15:16.877255+0000","last_unstale":"2024-09-21T00:15:17.868752+0000","last_undegraded":"2024-09-21T00:15:17.868752+0000","last_fullsized":"2024-09-21T00:15:17.868752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:59.633259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888359+0000","last_change":"2024-09-21T00:15:16.886033+0000","last_active":"2024-09-21T00:15:16.888359+0000","last_peered":"2024-09-21T00:15:16.888359+0000","last_clean":"2024-09-21T00:15:16.888359+0000","last_became_active":"2024-09-21T00:15:16.885733+0000","last_became_peered":"2024-09-21T00:15:16.885733+0000","last_unstale":"2024-09-21T00:15:16.888359+0000","last_undegraded":"2024-09-21T00:15:16.888359+0000","last_fullsized":"2024-09-21T00:15:16.888359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:20:09.045667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.873226+0000","last_change":"2024-09-21T00:15:16.867951+0000","last_active":"2024-09-21T00:15:16.873226+0000","last_peered":"2024-09-21T00:15:16.873226+0000","last_clean":"2024-09-21T00:15:16.873226+0000","last_became_active":"2024-09-21T00:15:16.867657+0000","last_became_peered":"2024-09-21T00:15:16.867657+0000","last_unstale":"2024-09-21T00:15:16.873226+0000","last_undegraded":"2024-09-21T00:15:16.873226+0000","last_fullsized":"2024-09-21T00:15:16.873226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:59.633259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865646+0000","last_change":"2024-09-21T00:15:16.878574+0000","last_active":"2024-09-21T00:15:17.865646+0000","last_peered":"2024-09-21T00:15:17.865646+0000","last_clean":"2024-09-21T00:15:17.865646+0000","last_became_active":"2024-09-21T00:15:16.878228+0000","last_became_peered":"2024-09-21T00:15:16.878228+0000","last_unstale":"2024-09-21T00:15:17.865646+0000","last_undegraded":"2024-09-21T00:15:17.865646+0000","last_fullsized":"2024-09-21T00:15:17.865646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:33.038941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.876743+0000","last_change":"2024-09-21T00:15:16.868688+0000","last_active":"2024-09-21T00:15:16.876743+0000","last_peered":"2024-09-21T00:15:16.876743+0000","last_clean":"2024-09-21T00:15:16.876743+0000","last_became_active":"2024-09-21T00:15:16.868393+0000","last_became_peered":"2024-09-21T00:15:16.868393+0000","last_unstale":"2024-09-21T00:15:16.876743+0000","last_undegraded":"2024-09-21T00:15:16.876743+0000","last_fullsized":"2024-09-21T00:15:16.876743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:42.112862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866592+0000","last_change":"2024-09-21T00:15:16.872582+0000","last_active":"2024-09-21T00:15:17.866592+0000","last_peered":"2024-09-21T00:15:17.866592+0000","last_clean":"2024-09-21T00:15:17.866592+0000","last_became_active":"2024-09-21T00:15:16.872290+0000","last_became_peered":"2024-09-21T00:15:16.872290+0000","last_unstale":"2024-09-21T00:15:17.866592+0000","last_undegraded":"2024-09-21T00:15:17.866592+0000","last_fullsized":"2024-09-21T00:15:17.866592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:27.588288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866182+0000","last_change":"2024-09-21T00:15:16.869555+0000","last_active":"2024-09-21T00:15:17.866182+0000","last_peered":"2024-09-21T00:15:17.866182+0000","last_clean":"2024-09-21T00:15:17.866182+0000","last_became_active":"2024-09-21T00:15:16.869251+0000","last_became_peered":"2024-09-21T00:15:16.869251+0000","last_unstale":"2024-09-21T00:15:17.866182+0000","last_undegraded":"2024-09-21T00:15:17.866182+0000","last_fullsized":"2024-09-21T00:15:17.866182+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:27.130026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-21T00:15:15.864138+0000","last_change":"2024-09-21T00:15:15.864138+0000","last_active":"2024-09-21T00:15:15.838346+0000","last_peered":"2024-09-21T00:15:15.838346+0000","last_clean":"2024-09-21T00:15:15.838346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T00:15:15.864138+0000","last_undegraded":"2024-09-21T00:15:15.864138+0000","last_fullsized":"2024-09-21T00:15:15.864138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.876036+0000","last_change":"2024-09-21T00:15:16.864289+0000","last_active":"2024-09-21T00:15:16.876036+0000","last_peered":"2024-09-21T00:15:16.876036+0000","last_clean":"2024-09-21T00:15:16.876036+0000","last_became_active":"2024-09-21T00:15:16.862950+0000","last_became_peered":"2024-09-21T00:15:16.862950+0000","last_unstale":"2024-09-21T00:15:16.876036+0000","last_undegraded":"2024-09-21T00:15:16.876036+0000","last_fullsized":"2024-09-21T00:15:16.876036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:25.302443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.877901+0000","last_change":"2024-09-21T00:15:16.865247+0000","last_active":"2024-09-21T00:15:16.877901+0000","last_peered":"2024-09-21T00:15:16.877901+0000","last_clean":"2024-09-21T00:15:16.877901+0000","last_became_active":"2024-09-21T00:15:16.864945+0000","last_became_peered":"2024-09-21T00:15:16.864945+0000","last_unstale":"2024-09-21T00:15:16.877901+0000","last_undegraded":"2024-09-21T00:15:16.877901+0000","last_fullsized":"2024-09-21T00:15:16.877901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:48.052839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885933+0000","last_change":"2024-09-21T00:15:16.880182+0000","last_active":"2024-09-21T00:15:16.885933+0000","last_peered":"2024-09-21T00:15:16.885933+0000","last_clean":"2024-09-21T00:15:16.885933+0000","last_became_active":"2024-09-21T00:15:16.874473+0000","last_became_peered":"2024-09-21T00:15:16.874473+0000","last_unstale":"2024-09-21T00:15:16.885933+0000","last_undegraded":"2024-09-21T00:15:16.885933+0000","last_fullsized":"2024-09-21T00:15:16.885933+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:03.681601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865743+0000","last_change":"2024-09-21T00:15:16.885945+0000","last_active":"2024-09-21T00:15:17.865743+0000","last_peered":"2024-09-21T00:15:17.865743+0000","last_clean":"2024-09-21T00:15:17.865743+0000","last_became_active":"2024-09-21T00:15:16.885606+0000","last_became_peered":"2024-09-21T00:15:16.885606+0000","last_unstale":"2024-09-21T00:15:17.865743+0000","last_undegraded":"2024-09-21T00:15:17.865743+0000","last_fullsized":"2024-09-21T00:15:17.865743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:14.873933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886342+0000","last_change":"2024-09-21T00:15:16.876420+0000","last_active":"2024-09-21T00:15:16.886342+0000","last_peered":"2024-09-21T00:15:16.886342+0000","last_clean":"2024-09-21T00:15:16.886342+0000","last_became_active":"2024-09-21T00:15:16.876184+0000","last_became_peered":"2024-09-21T00:15:16.876184+0000","last_unstale":"2024-09-21T00:15:16.886342+0000","last_undegraded":"2024-09-21T00:15:16.886342+0000","last_fullsized":"2024-09-21T00:15:16.886342+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:58.071856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889095+0000","last_change":"2024-09-21T00:15:16.875257+0000","last_active":"2024-09-21T00:15:16.889095+0000","last_peered":"2024-09-21T00:15:16.889095+0000","last_clean":"2024-09-21T00:15:16.889095+0000","last_became_active":"2024-09-21T00:15:16.874968+0000","last_became_peered":"2024-09-21T00:15:16.874968+0000","last_unstale":"2024-09-21T00:15:16.889095+0000","last_undegraded":"2024-09-21T00:15:16.889095+0000","last_fullsized":"2024-09-21T00:15:16.889095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:13.786819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.878361+0000","last_change":"2024-09-21T00:15:16.869118+0000","last_active":"2024-09-21T00:15:16.878361+0000","last_peered":"2024-09-21T00:15:16.878361+0000","last_clean":"2024-09-21T00:15:16.878361+0000","last_became_active":"2024-09-21T00:15:16.868763+0000","last_became_peered":"2024-09-21T00:15:16.868763+0000","last_unstale":"2024-09-21T00:15:16.878361+0000","last_undegraded":"2024-09-21T00:15:16.878361+0000","last_fullsized":"2024-09-21T00:15:16.878361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:23:49.873761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.887394+0000","last_change":"2024-09-21T00:15:16.883500+0000","last_active":"2024-09-21T00:15:16.887394+0000","last_peered":"2024-09-21T00:15:16.887394+0000","last_clean":"2024-09-21T00:15:16.887394+0000","last_became_active":"2024-09-21T00:15:16.883162+0000","last_became_peered":"2024-09-21T00:15:16.883162+0000","last_unstale":"2024-09-21T00:15:16.887394+0000","last_undegraded":"2024-09-21T00:15:16.887394+0000","last_fullsized":"2024-09-21T00:15:16.887394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:51.082466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.892774+0000","last_change":"2024-09-21T00:15:16.890105+0000","last_active":"2024-09-21T00:15:16.892774+0000","last_peered":"2024-09-21T00:15:16.892774+0000","last_clean":"2024-09-21T00:15:16.892774+0000","last_became_active":"2024-09-21T00:15:16.889782+0000","last_became_peered":"2024-09-21T00:15:16.889782+0000","last_unstale":"2024-09-21T00:15:16.892774+0000","last_undegraded":"2024-09-21T00:15:16.892774+0000","last_fullsized":"2024-09-21T00:15:16.892774+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:24.562660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866430+0000","last_change":"2024-09-21T00:15:16.883797+0000","last_active":"2024-09-21T00:15:17.866430+0000","last_peered":"2024-09-21T00:15:17.866430+0000","last_clean":"2024-09-21T00:15:17.866430+0000","last_became_active":"2024-09-21T00:15:16.882778+0000","last_became_peered":"2024-09-21T00:15:16.882778+0000","last_unstale":"2024-09-21T00:15:17.866430+0000","last_undegraded":"2024-09-21T00:15:17.866430+0000","last_fullsized":"2024-09-21T00:15:17.866430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:31.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865866+0000","last_change":"2024-09-21T00:15:16.881676+0000","last_active":"2024-09-21T00:15:17.865866+0000","last_peered":"2024-09-21T00:15:17.865866+0000","last_clean":"2024-09-21T00:15:17.865866+0000","last_became_active":"2024-09-21T00:15:16.881381+0000","last_became_peered":"2024-09-21T00:15:16.881381+0000","last_unstale":"2024-09-21T00:15:17.865866+0000","last_undegraded":"2024-09-21T00:15:17.865866+0000","last_fullsized":"2024-09-21T00:15:17.865866+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:29.864436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888158+0000","last_change":"2024-09-21T00:15:16.880582+0000","last_active":"2024-09-21T00:15:16.888158+0000","last_peered":"2024-09-21T00:15:16.888158+0000","last_clean":"2024-09-21T00:15:16.888158+0000","last_became_active":"2024-09-21T00:15:16.880298+0000","last_became_peered":"2024-09-21T00:15:16.880298+0000","last_unstale":"2024-09-21T00:15:16.888158+0000","last_undegraded":"2024-09-21T00:15:16.888158+0000","last_fullsized":"2024-09-21T00:15:16.888158+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:02.087826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893532+0000","last_change":"2024-09-21T00:15:16.881999+0000","last_active":"2024-09-21T00:15:16.893532+0000","last_peered":"2024-09-21T00:15:16.893532+0000","last_clean":"2024-09-21T00:15:16.893532+0000","last_became_active":"2024-09-21T00:15:16.881229+0000","last_became_peered":"2024-09-21T00:15:16.881229+0000","last_unstale":"2024-09-21T00:15:16.893532+0000","last_undegraded":"2024-09-21T00:15:16.893532+0000","last_fullsized":"2024-09-21T00:15:16.893532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.632208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866047+0000","last_change":"2024-09-21T00:15:16.867828+0000","last_active":"2024-09-21T00:15:17.866047+0000","last_peered":"2024-09-21T00:15:17.866047+0000","last_clean":"2024-09-21T00:15:17.866047+0000","last_became_active":"2024-09-21T00:15:16.867248+0000","last_became_peered":"2024-09-21T00:15:16.867248+0000","last_unstale":"2024-09-21T00:15:17.866047+0000","last_undegraded":"2024-09-21T00:15:17.866047+0000","last_fullsized":"2024-09-21T00:15:17.866047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:17.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889194+0000","last_change":"2024-09-21T00:15:15.871147+0000","last_active":"2024-09-21T00:15:16.889194+0000","last_peered":"2024-09-21T00:15:16.889194+0000","last_clean":"2024-09-21T00:15:16.889194+0000","last_became_active":"2024-09-21T00:15:15.870802+0000","last_became_peered":"2024-09-21T00:15:15.870802+0000","last_unstale":"2024-09-21T00:15:16.889194+0000","last_undegraded":"2024-09-21T00:15:16.889194+0000","last_fullsized":"2024-09-21T00:15:16.889194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:38.278690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885479+0000","last_change":"2024-09-21T00:15:16.883776+0000","last_active":"2024-09-21T00:15:16.885479+0000","last_peered":"2024-09-21T00:15:16.885479+0000","last_clean":"2024-09-21T00:15:16.885479+0000","last_became_active":"2024-09-21T00:15:16.881047+0000","last_became_peered":"2024-09-21T00:15:16.881047+0000","last_unstale":"2024-09-21T00:15:16.885479+0000","last_undegraded":"2024-09-21T00:15:16.885479+0000","last_fullsized":"2024-09-21T00:15:16.885479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:18.509764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885933+0000","last_change":"2024-09-21T00:15:15.865052+0000","last_active":"2024-09-21T00:15:16.885933+0000","last_peered":"2024-09-21T00:15:16.885933+0000","last_clean":"2024-09-21T00:15:16.885933+0000","last_became_active":"2024-09-21T00:15:15.864719+0000","last_became_peered":"2024-09-21T00:15:15.864719+0000","last_unstale":"2024-09-21T00:15:16.885933+0000","last_undegraded":"2024-09-21T00:15:16.885933+0000","last_fullsized":"2024-09-21T00:15:16.885933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:03.742657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866396+0000","last_change":"2024-09-21T00:15:16.875044+0000","last_active":"2024-09-21T00:15:17.866396+0000","last_peered":"2024-09-21T00:15:17.866396+0000","last_clean":"2024-09-21T00:15:17.866396+0000","last_became_active":"2024-09-21T00:15:16.869954+0000","last_became_peered":"2024-09-21T00:15:16.869954+0000","last_unstale":"2024-09-21T00:15:17.866396+0000","last_undegraded":"2024-09-21T00:15:17.866396+0000","last_fullsized":"2024-09-21T00:15:17.866396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:48.086484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900622+0000","last_change":"2024-09-21T00:15:15.869470+0000","last_active":"2024-09-21T00:15:16.900622+0000","last_peered":"2024-09-21T00:15:16.900622+0000","last_clean":"2024-09-21T00:15:16.900622+0000","last_became_active":"2024-09-21T00:15:15.869161+0000","last_became_peered":"2024-09-21T00:15:15.869161+0000","last_unstale":"2024-09-21T00:15:16.900622+0000","last_undegraded":"2024-09-21T00:15:16.900622+0000","last_fullsized":"2024-09-21T00:15:16.900622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:11.623197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.880499+0000","last_change":"2024-09-21T00:15:16.874950+0000","last_active":"2024-09-21T00:15:16.880499+0000","last_peered":"2024-09-21T00:15:16.880499+0000","last_clean":"2024-09-21T00:15:16.880499+0000","last_became_active":"2024-09-21T00:15:16.874649+0000","last_became_peered":"2024-09-21T00:15:16.874649+0000","last_unstale":"2024-09-21T00:15:16.880499+0000","last_undegraded":"2024-09-21T00:15:16.880499+0000","last_fullsized":"2024-09-21T00:15:16.880499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:00.593215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.899021+0000","last_change":"2024-09-21T00:15:15.876080+0000","last_active":"2024-09-21T00:15:16.899021+0000","last_peered":"2024-09-21T00:15:16.899021+0000","last_clean":"2024-09-21T00:15:16.899021+0000","last_became_active":"2024-09-21T00:15:15.875776+0000","last_became_peered":"2024-09-21T00:15:15.875776+0000","last_unstale":"2024-09-21T00:15:16.899021+0000","last_undegraded":"2024-09-21T00:15:16.899021+0000","last_fullsized":"2024-09-21T00:15:16.899021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:08.705060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.897229+0000","last_change":"2024-09-21T00:15:16.890109+0000","last_active":"2024-09-21T00:15:16.897229+0000","last_peered":"2024-09-21T00:15:16.897229+0000","last_clean":"2024-09-21T00:15:16.897229+0000","last_became_active":"2024-09-21T00:15:16.889670+0000","last_became_peered":"2024-09-21T00:15:16.889670+0000","last_unstale":"2024-09-21T00:15:16.897229+0000","last_undegraded":"2024-09-21T00:15:16.897229+0000","last_fullsized":"2024-09-21T00:15:16.897229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:02.210312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.887840+0000","last_change":"2024-09-21T00:15:15.863814+0000","last_active":"2024-09-21T00:15:16.887840+0000","last_peered":"2024-09-21T00:15:16.887840+0000","last_clean":"2024-09-21T00:15:16.887840+0000","last_became_active":"2024-09-21T00:15:15.862421+0000","last_became_peered":"2024-09-21T00:15:15.862421+0000","last_unstale":"2024-09-21T00:15:16.887840+0000","last_undegraded":"2024-09-21T00:15:16.887840+0000","last_fullsized":"2024-09-21T00:15:16.887840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:47.632876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888786+0000","last_change":"2024-09-21T00:15:16.885001+0000","last_active":"2024-09-21T00:15:16.888786+0000","last_peered":"2024-09-21T00:15:16.888786+0000","last_clean":"2024-09-21T00:15:16.888786+0000","last_became_active":"2024-09-21T00:15:16.884672+0000","last_became_peered":"2024-09-21T00:15:16.884672+0000","last_unstale":"2024-09-21T00:15:16.888786+0000","last_undegraded":"2024-09-21T00:15:16.888786+0000","last_fullsized":"2024-09-21T00:15:16.888786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.312162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893837+0000","last_change":"2024-09-21T00:15:15.868966+0000","last_active":"2024-09-21T00:15:16.893837+0000","last_peered":"2024-09-21T00:15:16.893837+0000","last_clean":"2024-09-21T00:15:16.893837+0000","last_became_active":"2024-09-21T00:15:15.868667+0000","last_became_peered":"2024-09-21T00:15:15.868667+0000","last_unstale":"2024-09-21T00:15:16.893837+0000","last_undegraded":"2024-09-21T00:15:16.893837+0000","last_fullsized":"2024-09-21T00:15:16.893837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:08:22.105332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866062+0000","last_change":"2024-09-21T00:15:16.863866+0000","last_active":"2024-09-21T00:15:17.866062+0000","last_peered":"2024-09-21T00:15:17.866062+0000","last_clean":"2024-09-21T00:15:17.866062+0000","last_became_active":"2024-09-21T00:15:16.862688+0000","last_became_peered":"2024-09-21T00:15:16.862688+0000","last_unstale":"2024-09-21T00:15:17.866062+0000","last_undegraded":"2024-09-21T00:15:17.866062+0000","last_fullsized":"2024-09-21T00:15:17.866062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:52.562904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.855893+0000","last_change":"2024-09-21T00:15:15.874143+0000","last_active":"2024-09-21T00:15:16.855893+0000","last_peered":"2024-09-21T00:15:16.855893+0000","last_clean":"2024-09-21T00:15:16.855893+0000","last_became_active":"2024-09-21T00:15:15.871902+0000","last_became_peered":"2024-09-21T00:15:15.871902+0000","last_unstale":"2024-09-21T00:15:16.855893+0000","last_undegraded":"2024-09-21T00:15:16.855893+0000","last_fullsized":"2024-09-21T00:15:16.855893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:24.299541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.884299+0000","last_change":"2024-09-21T00:15:16.876073+0000","last_active":"2024-09-21T00:15:16.884299+0000","last_peered":"2024-09-21T00:15:16.884299+0000","last_clean":"2024-09-21T00:15:16.884299+0000","last_became_active":"2024-09-21T00:15:16.875374+0000","last_became_peered":"2024-09-21T00:15:16.875374+0000","last_unstale":"2024-09-21T00:15:16.884299+0000","last_undegraded":"2024-09-21T00:15:16.884299+0000","last_fullsized":"2024-09-21T00:15:16.884299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:26:25.907755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866306+0000","last_change":"2024-09-21T00:15:15.872912+0000","last_active":"2024-09-21T00:15:16.866306+0000","last_peered":"2024-09-21T00:15:16.866306+0000","last_clean":"2024-09-21T00:15:16.866306+0000","last_became_active":"2024-09-21T00:15:15.872553+0000","last_became_peered":"2024-09-21T00:15:15.872553+0000","last_unstale":"2024-09-21T00:15:16.866306+0000","last_undegraded":"2024-09-21T00:15:16.866306+0000","last_fullsized":"2024-09-21T00:15:16.866306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:36.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.881302+0000","last_change":"2024-09-21T00:15:16.864727+0000","last_active":"2024-09-21T00:15:16.881302+0000","last_peered":"2024-09-21T00:15:16.881302+0000","last_clean":"2024-09-21T00:15:16.881302+0000","last_became_active":"2024-09-21T00:15:16.864246+0000","last_became_peered":"2024-09-21T00:15:16.864246+0000","last_unstale":"2024-09-21T00:15:16.881302+0000","last_undegraded":"2024-09-21T00:15:16.881302+0000","last_fullsized":"2024-09-21T00:15:16.881302+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:51.082466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.858347+0000","last_change":"2024-09-21T00:15:15.871490+0000","last_active":"2024-09-21T00:15:16.858347+0000","last_peered":"2024-09-21T00:15:16.858347+0000","last_clean":"2024-09-21T00:15:16.858347+0000","last_became_active":"2024-09-21T00:15:15.871156+0000","last_became_peered":"2024-09-21T00:15:15.871156+0000","last_unstale":"2024-09-21T00:15:16.858347+0000","last_undegraded":"2024-09-21T00:15:16.858347+0000","last_fullsized":"2024-09-21T00:15:16.858347+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:12.350916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889035+0000","last_change":"2024-09-21T00:15:16.876745+0000","last_active":"2024-09-21T00:15:16.889035+0000","last_peered":"2024-09-21T00:15:16.889035+0000","last_clean":"2024-09-21T00:15:16.889035+0000","last_became_active":"2024-09-21T00:15:16.876387+0000","last_became_peered":"2024-09-21T00:15:16.876387+0000","last_unstale":"2024-09-21T00:15:16.889035+0000","last_undegraded":"2024-09-21T00:15:16.889035+0000","last_fullsized":"2024-09-21T00:15:16.889035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:29.493781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866219+0000","last_change":"2024-09-21T00:15:15.861011+0000","last_active":"2024-09-21T00:15:17.866219+0000","last_peered":"2024-09-21T00:15:17.866219+0000","last_clean":"2024-09-21T00:15:17.866219+0000","last_became_active":"2024-09-21T00:15:15.859747+0000","last_became_peered":"2024-09-21T00:15:15.859747+0000","last_unstale":"2024-09-21T00:15:17.866219+0000","last_undegraded":"2024-09-21T00:15:17.866219+0000","last_fullsized":"2024-09-21T00:15:17.866219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:11.431973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879757+0000","last_change":"2024-09-21T00:15:16.871360+0000","last_active":"2024-09-21T00:15:16.879757+0000","last_peered":"2024-09-21T00:15:16.879757+0000","last_clean":"2024-09-21T00:15:16.879757+0000","last_became_active":"2024-09-21T00:15:16.871013+0000","last_became_peered":"2024-09-21T00:15:16.871013+0000","last_unstale":"2024-09-21T00:15:16.879757+0000","last_undegraded":"2024-09-21T00:15:16.879757+0000","last_fullsized":"2024-09-21T00:15:16.879757+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:13.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866222+0000","last_change":"2024-09-21T00:15:15.865177+0000","last_active":"2024-09-21T00:15:17.866222+0000","last_peered":"2024-09-21T00:15:17.866222+0000","last_clean":"2024-09-21T00:15:17.866222+0000","last_became_active":"2024-09-21T00:15:15.864924+0000","last_became_peered":"2024-09-21T00:15:15.864924+0000","last_unstale":"2024-09-21T00:15:17.866222+0000","last_undegraded":"2024-09-21T00:15:17.866222+0000","last_fullsized":"2024-09-21T00:15:17.866222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:04:53.011253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888496+0000","last_change":"2024-09-21T00:15:16.886616+0000","last_active":"2024-09-21T00:15:16.888496+0000","last_peered":"2024-09-21T00:15:16.888496+0000","last_clean":"2024-09-21T00:15:16.888496+0000","last_became_active":"2024-09-21T00:15:16.886309+0000","last_became_peered":"2024-09-21T00:15:16.886309+0000","last_unstale":"2024-09-21T00:15:16.888496+0000","last_undegraded":"2024-09-21T00:15:16.888496+0000","last_fullsized":"2024-09-21T00:15:16.888496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:22.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.907440+0000","last_change":"2024-09-21T00:15:15.872932+0000","last_active":"2024-09-21T00:15:16.907440+0000","last_peered":"2024-09-21T00:15:16.907440+0000","last_clean":"2024-09-21T00:15:16.907440+0000","last_became_active":"2024-09-21T00:15:15.872625+0000","last_became_peered":"2024-09-21T00:15:15.872625+0000","last_unstale":"2024-09-21T00:15:16.907440+0000","last_undegraded":"2024-09-21T00:15:16.907440+0000","last_fullsized":"2024-09-21T00:15:16.907440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:02.678699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.880518+0000","last_change":"2024-09-21T00:15:16.869519+0000","last_active":"2024-09-21T00:15:16.880518+0000","last_peered":"2024-09-21T00:15:16.880518+0000","last_clean":"2024-09-21T00:15:16.880518+0000","last_became_active":"2024-09-21T00:15:16.868514+0000","last_became_peered":"2024-09-21T00:15:16.868514+0000","last_unstale":"2024-09-21T00:15:16.880518+0000","last_undegraded":"2024-09-21T00:15:16.880518+0000","last_fullsized":"2024-09-21T00:15:16.880518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:04.585473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900610+0000","last_change":"2024-09-21T00:15:15.864869+0000","last_active":"2024-09-21T00:15:16.900610+0000","last_peered":"2024-09-21T00:15:16.900610+0000","last_clean":"2024-09-21T00:15:16.900610+0000","last_became_active":"2024-09-21T00:15:15.863402+0000","last_became_peered":"2024-09-21T00:15:15.863402+0000","last_unstale":"2024-09-21T00:15:16.900610+0000","last_undegraded":"2024-09-21T00:15:16.900610+0000","last_fullsized":"2024-09-21T00:15:16.900610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:15.543176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.891762+0000","last_change":"2024-09-21T00:15:16.889929+0000","last_active":"2024-09-21T00:15:16.891762+0000","last_peered":"2024-09-21T00:15:16.891762+0000","last_clean":"2024-09-21T00:15:16.891762+0000","last_became_active":"2024-09-21T00:15:16.889592+0000","last_became_peered":"2024-09-21T00:15:16.889592+0000","last_unstale":"2024-09-21T00:15:16.891762+0000","last_undegraded":"2024-09-21T00:15:16.891762+0000","last_fullsized":"2024-09-21T00:15:16.891762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:18:05.708718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.870448+0000","last_change":"2024-09-21T00:15:15.856402+0000","last_active":"2024-09-21T00:15:16.870448+0000","last_peered":"2024-09-21T00:15:16.870448+0000","last_clean":"2024-09-21T00:15:16.870448+0000","last_became_active":"2024-09-21T00:15:15.856065+0000","last_became_peered":"2024-09-21T00:15:15.856065+0000","last_unstale":"2024-09-21T00:15:16.870448+0000","last_undegraded":"2024-09-21T00:15:16.870448+0000","last_fullsized":"2024-09-21T00:15:16.870448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:34.468856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885960+0000","last_change":"2024-09-21T00:15:16.880219+0000","last_active":"2024-09-21T00:15:16.885960+0000","last_peered":"2024-09-21T00:15:16.885960+0000","last_clean":"2024-09-21T00:15:16.885960+0000","last_became_active":"2024-09-21T00:15:16.879024+0000","last_became_peered":"2024-09-21T00:15:16.879024+0000","last_unstale":"2024-09-21T00:15:16.885960+0000","last_undegraded":"2024-09-21T00:15:16.885960+0000","last_fullsized":"2024-09-21T00:15:16.885960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:12.626099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865879+0000","last_change":"2024-09-21T00:15:15.864833+0000","last_active":"2024-09-21T00:15:17.865879+0000","last_peered":"2024-09-21T00:15:17.865879+0000","last_clean":"2024-09-21T00:15:17.865879+0000","last_became_active":"2024-09-21T00:15:15.864497+0000","last_became_peered":"2024-09-21T00:15:15.864497+0000","last_unstale":"2024-09-21T00:15:17.865879+0000","last_undegraded":"2024-09-21T00:15:17.865879+0000","last_fullsized":"2024-09-21T00:15:17.865879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:49.050645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868649+0000","last_change":"2024-09-21T00:15:16.881508+0000","last_active":"2024-09-21T00:15:17.868649+0000","last_peered":"2024-09-21T00:15:17.868649+0000","last_clean":"2024-09-21T00:15:17.868649+0000","last_became_active":"2024-09-21T00:15:16.877197+0000","last_became_peered":"2024-09-21T00:15:16.877197+0000","last_unstale":"2024-09-21T00:15:17.868649+0000","last_undegraded":"2024-09-21T00:15:17.868649+0000","last_fullsized":"2024-09-21T00:15:17.868649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:39.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889411+0000","last_change":"2024-09-21T00:15:15.866587+0000","last_active":"2024-09-21T00:15:16.889411+0000","last_peered":"2024-09-21T00:15:16.889411+0000","last_clean":"2024-09-21T00:15:16.889411+0000","last_became_active":"2024-09-21T00:15:15.864940+0000","last_became_peered":"2024-09-21T00:15:15.864940+0000","last_unstale":"2024-09-21T00:15:16.889411+0000","last_undegraded":"2024-09-21T00:15:16.889411+0000","last_fullsized":"2024-09-21T00:15:16.889411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:22.127731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893356+0000","last_change":"2024-09-21T00:15:16.892157+0000","last_active":"2024-09-21T00:15:16.893356+0000","last_peered":"2024-09-21T00:15:16.893356+0000","last_clean":"2024-09-21T00:15:16.893356+0000","last_became_active":"2024-09-21T00:15:16.888127+0000","last_became_peered":"2024-09-21T00:15:16.888127+0000","last_unstale":"2024-09-21T00:15:16.893356+0000","last_undegraded":"2024-09-21T00:15:16.893356+0000","last_fullsized":"2024-09-21T00:15:16.893356+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:02.683038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889917+0000","last_change":"2024-09-21T00:15:15.873619+0000","last_active":"2024-09-21T00:15:16.889917+0000","last_peered":"2024-09-21T00:15:16.889917+0000","last_clean":"2024-09-21T00:15:16.889917+0000","last_became_active":"2024-09-21T00:15:15.873342+0000","last_became_peered":"2024-09-21T00:15:15.873342+0000","last_unstale":"2024-09-21T00:15:16.889917+0000","last_undegraded":"2024-09-21T00:15:16.889917+0000","last_fullsized":"2024-09-21T00:15:16.889917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:40.599261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900501+0000","last_change":"2024-09-21T00:15:16.894537+0000","last_active":"2024-09-21T00:15:16.900501+0000","last_peered":"2024-09-21T00:15:16.900501+0000","last_clean":"2024-09-21T00:15:16.900501+0000","last_became_active":"2024-09-21T00:15:16.894328+0000","last_became_peered":"2024-09-21T00:15:16.894328+0000","last_unstale":"2024-09-21T00:15:16.900501+0000","last_undegraded":"2024-09-21T00:15:16.900501+0000","last_fullsized":"2024-09-21T00:15:16.900501+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:32.391700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866406+0000","last_change":"2024-09-21T00:15:15.869830+0000","last_active":"2024-09-21T00:15:17.866406+0000","last_peered":"2024-09-21T00:15:17.866406+0000","last_clean":"2024-09-21T00:15:17.866406+0000","last_became_active":"2024-09-21T00:15:15.867650+0000","last_became_peered":"2024-09-21T00:15:15.867650+0000","last_unstale":"2024-09-21T00:15:17.866406+0000","last_undegraded":"2024-09-21T00:15:17.866406+0000","last_fullsized":"2024-09-21T00:15:17.866406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:28.691334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.890222+0000","last_change":"2024-09-21T00:15:16.887082+0000","last_active":"2024-09-21T00:15:16.890222+0000","last_peered":"2024-09-21T00:15:16.890222+0000","last_clean":"2024-09-21T00:15:16.890222+0000","last_became_active":"2024-09-21T00:15:16.885720+0000","last_became_peered":"2024-09-21T00:15:16.885720+0000","last_unstale":"2024-09-21T00:15:16.890222+0000","last_undegraded":"2024-09-21T00:15:16.890222+0000","last_fullsized":"2024-09-21T00:15:16.890222+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:53.816749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867676+0000","last_change":"2024-09-21T00:15:15.872212+0000","last_active":"2024-09-21T00:15:17.867676+0000","last_peered":"2024-09-21T00:15:17.867676+0000","last_clean":"2024-09-21T00:15:17.867676+0000","last_became_active":"2024-09-21T00:15:15.870779+0000","last_became_peered":"2024-09-21T00:15:15.870779+0000","last_unstale":"2024-09-21T00:15:17.867676+0000","last_undegraded":"2024-09-21T00:15:17.867676+0000","last_fullsized":"2024-09-21T00:15:17.867676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:43.736010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-21T00:15:15.864118+0000","last_change":"2024-09-21T00:15:15.864118+0000","last_active":"2024-09-21T00:15:15.838346+0000","last_peered":"2024-09-21T00:15:15.838346+0000","last_clean":"2024-09-21T00:15:15.838346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T00:15:15.864118+0000","last_undegraded":"2024-09-21T00:15:15.864118+0000","last_fullsized":"2024-09-21T00:15:15.864118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T00:15:15.876395+0000","last_change":"2024-09-21T00:15:15.873944+0000","last_active":"2024-09-21T00:15:15.876395+0000","last_peered":"2024-09-21T00:15:15.876395+0000","last_clean":"2024-09-21T00:15:15.876395+0000","last_became_active":"2024-09-21T00:15:15.873612+0000","last_became_peered":"2024-09-21T00:15:15.873612+0000","last_unstale":"2024-09-21T00:15:15.876395+0000","last_undegraded":"2024-09-21T00:15:15.876395+0000","last_fullsized":"2024-09-21T00:15:15.876395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:31.652679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865655+0000","last_change":"2024-09-21T00:15:16.878490+0000","last_active":"2024-09-21T00:15:17.865655+0000","last_peered":"2024-09-21T00:15:17.865655+0000","last_clean":"2024-09-21T00:15:17.865655+0000","last_became_active":"2024-09-21T00:15:16.878218+0000","last_became_peered":"2024-09-21T00:15:16.878218+0000","last_unstale":"2024-09-21T00:15:17.865655+0000","last_undegraded":"2024-09-21T00:15:17.865655+0000","last_fullsized":"2024-09-21T00:15:17.865655+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:58.804183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T00:15:15.875463+0000","last_change":"2024-09-21T00:15:15.869680+0000","last_active":"2024-09-21T00:15:15.875463+0000","last_peered":"2024-09-21T00:15:15.875463+0000","last_clean":"2024-09-21T00:15:15.875463+0000","last_became_active":"2024-09-21T00:15:15.869363+0000","last_became_peered":"2024-09-21T00:15:15.869363+0000","last_unstale":"2024-09-21T00:15:15.875463+0000","last_undegraded":"2024-09-21T00:15:15.875463+0000","last_fullsized":"2024-09-21T00:15:15.875463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:30.627507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893469+0000","last_change":"2024-09-21T00:15:16.881332+0000","last_active":"2024-09-21T00:15:16.893469+0000","last_peered":"2024-09-21T00:15:16.893469+0000","last_clean":"2024-09-21T00:15:16.893469+0000","last_became_active":"2024-09-21T00:15:16.881080+0000","last_became_peered":"2024-09-21T00:15:16.881080+0000","last_unstale":"2024-09-21T00:15:16.893469+0000","last_undegraded":"2024-09-21T00:15:16.893469+0000","last_fullsized":"2024-09-21T00:15:16.893469+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:34.255761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.870217+0000","last_change":"2024-09-21T00:15:15.869495+0000","last_active":"2024-09-21T00:15:16.870217+0000","last_peered":"2024-09-21T00:15:16.870217+0000","last_clean":"2024-09-21T00:15:16.870217+0000","last_became_active":"2024-09-21T00:15:15.868711+0000","last_became_peered":"2024-09-21T00:15:15.868711+0000","last_unstale":"2024-09-21T00:15:16.870217+0000","last_undegraded":"2024-09-21T00:15:16.870217+0000","last_fullsized":"2024-09-21T00:15:16.870217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:29.397639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879204+0000","last_change":"2024-09-21T00:15:16.871518+0000","last_active":"2024-09-21T00:15:16.879204+0000","last_peered":"2024-09-21T00:15:16.879204+0000","last_clean":"2024-09-21T00:15:16.879204+0000","last_became_active":"2024-09-21T00:15:16.867533+0000","last_became_peered":"2024-09-21T00:15:16.867533+0000","last_unstale":"2024-09-21T00:15:16.879204+0000","last_undegraded":"2024-09-21T00:15:16.879204+0000","last_fullsized":"2024-09-21T00:15:16.879204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:16.546077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866257+0000","last_change":"2024-09-21T00:15:15.873204+0000","last_active":"2024-09-21T00:15:16.866257+0000","last_peered":"2024-09-21T00:15:16.866257+0000","last_clean":"2024-09-21T00:15:16.866257+0000","last_became_active":"2024-09-21T00:15:15.872545+0000","last_became_peered":"2024-09-21T00:15:15.872545+0000","last_unstale":"2024-09-21T00:15:16.866257+0000","last_undegraded":"2024-09-21T00:15:16.866257+0000","last_fullsized":"2024-09-21T00:15:16.866257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:30.945225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.897267+0000","last_change":"2024-09-21T00:15:16.879831+0000","last_active":"2024-09-21T00:15:16.897267+0000","last_peered":"2024-09-21T00:15:16.897267+0000","last_clean":"2024-09-21T00:15:16.897267+0000","last_became_active":"2024-09-21T00:15:16.879538+0000","last_became_peered":"2024-09-21T00:15:16.879538+0000","last_unstale":"2024-09-21T00:15:16.897267+0000","last_undegraded":"2024-09-21T00:15:16.897267+0000","last_fullsized":"2024-09-21T00:15:16.897267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:58.449816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.867406+0000","last_change":"2024-09-21T00:15:15.868499+0000","last_active":"2024-09-21T00:15:16.867406+0000","last_peered":"2024-09-21T00:15:16.867406+0000","last_clean":"2024-09-21T00:15:16.867406+0000","last_became_active":"2024-09-21T00:15:15.868218+0000","last_became_peered":"2024-09-21T00:15:15.868218+0000","last_unstale":"2024-09-21T00:15:16.867406+0000","last_undegraded":"2024-09-21T00:15:16.867406+0000","last_fullsized":"2024-09-21T00:15:16.867406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.537075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868970+0000","last_change":"2024-09-21T00:15:16.882839+0000","last_active":"2024-09-21T00:15:17.868970+0000","last_peered":"2024-09-21T00:15:17.868970+0000","last_clean":"2024-09-21T00:15:17.868970+0000","last_became_active":"2024-09-21T00:15:16.878078+0000","last_became_peered":"2024-09-21T00:15:16.878078+0000","last_unstale":"2024-09-21T00:15:17.868970+0000","last_undegraded":"2024-09-21T00:15:17.868970+0000","last_fullsized":"2024-09-21T00:15:17.868970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:13.786819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866618+0000","last_change":"2024-09-21T00:15:15.861682+0000","last_active":"2024-09-21T00:15:17.866618+0000","last_peered":"2024-09-21T00:15:17.866618+0000","last_clean":"2024-09-21T00:15:17.866618+0000","last_became_active":"2024-09-21T00:15:15.861408+0000","last_became_peered":"2024-09-21T00:15:15.861408+0000","last_unstale":"2024-09-21T00:15:17.866618+0000","last_undegraded":"2024-09-21T00:15:17.866618+0000","last_fullsized":"2024-09-21T00:15:17.866618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:30.905194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879887+0000","last_change":"2024-09-21T00:15:16.875154+0000","last_active":"2024-09-21T00:15:16.879887+0000","last_peered":"2024-09-21T00:15:16.879887+0000","last_clean":"2024-09-21T00:15:16.879887+0000","last_became_active":"2024-09-21T00:15:16.874266+0000","last_became_peered":"2024-09-21T00:15:16.874266+0000","last_unstale":"2024-09-21T00:15:16.879887+0000","last_undegraded":"2024-09-21T00:15:16.879887+0000","last_fullsized":"2024-09-21T00:15:16.879887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:24.704654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868030+0000","last_change":"2024-09-21T00:15:15.874388+0000","last_active":"2024-09-21T00:15:17.868030+0000","last_peered":"2024-09-21T00:15:17.868030+0000","last_clean":"2024-09-21T00:15:17.868030+0000","last_became_active":"2024-09-21T00:15:15.873129+0000","last_became_peered":"2024-09-21T00:15:15.873129+0000","last_unstale":"2024-09-21T00:15:17.868030+0000","last_undegraded":"2024-09-21T00:15:17.868030+0000","last_fullsized":"2024-09-21T00:15:17.868030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:14.230132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-21T00:15:15.861246+0000","last_change":"2024-09-21T00:15:15.861246+0000","last_active":"2024-09-21T00:15:15.838346+0000","last_peered":"2024-09-21T00:15:15.838346+0000","last_clean":"2024-09-21T00:15:15.838346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T00:15:15.861246+0000","last_undegraded":"2024-09-21T00:15:15.861246+0000","last_fullsized":"2024-09-21T00:15:15.861246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867811+0000","last_change":"2024-09-21T00:15:15.863805+0000","last_active":"2024-09-21T00:15:17.867811+0000","last_peered":"2024-09-21T00:15:17.867811+0000","last_clean":"2024-09-21T00:15:17.867811+0000","last_became_active":"2024-09-21T00:15:15.863461+0000","last_became_peered":"2024-09-21T00:15:15.863461+0000","last_unstale":"2024-09-21T00:15:17.867811+0000","last_undegraded":"2024-09-21T00:15:17.867811+0000","last_fullsized":"2024-09-21T00:15:17.867811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:26.759455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867630+0000","last_change":"2024-09-21T00:15:16.864392+0000","last_active":"2024-09-21T00:15:17.867630+0000","last_peered":"2024-09-21T00:15:17.867630+0000","last_clean":"2024-09-21T00:15:17.867630+0000","last_became_active":"2024-09-21T00:15:16.864065+0000","last_became_peered":"2024-09-21T00:15:16.864065+0000","last_unstale":"2024-09-21T00:15:17.867630+0000","last_undegraded":"2024-09-21T00:15:17.867630+0000","last_fullsized":"2024-09-21T00:15:17.867630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:23.130632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.858033+0000","last_change":"2024-09-21T00:15:15.863840+0000","last_active":"2024-09-21T00:15:16.858033+0000","last_peered":"2024-09-21T00:15:16.858033+0000","last_clean":"2024-09-21T00:15:16.858033+0000","last_became_active":"2024-09-21T00:15:15.863081+0000","last_became_peered":"2024-09-21T00:15:15.863081+0000","last_unstale":"2024-09-21T00:15:16.858033+0000","last_undegraded":"2024-09-21T00:15:16.858033+0000","last_fullsized":"2024-09-21T00:15:16.858033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:23.701752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885634+0000","last_change":"2024-09-21T00:15:16.881804+0000","last_active":"2024-09-21T00:15:16.885634+0000","last_peered":"2024-09-21T00:15:16.885634+0000","last_clean":"2024-09-21T00:15:16.885634+0000","last_became_active":"2024-09-21T00:15:16.881268+0000","last_became_peered":"2024-09-21T00:15:16.881268+0000","last_unstale":"2024-09-21T00:15:16.885634+0000","last_undegraded":"2024-09-21T00:15:16.885634+0000","last_fullsized":"2024-09-21T00:15:16.885634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:36.128848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.856977+0000","last_change":"2024-09-21T00:15:15.874106+0000","last_active":"2024-09-21T00:15:16.856977+0000","last_peered":"2024-09-21T00:15:16.856977+0000","last_clean":"2024-09-21T00:15:16.856977+0000","last_became_active":"2024-09-21T00:15:15.873619+0000","last_became_peered":"2024-09-21T00:15:15.873619+0000","last_unstale":"2024-09-21T00:15:16.856977+0000","last_undegraded":"2024-09-21T00:15:16.856977+0000","last_fullsized":"2024-09-21T00:15:16.856977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:28.490880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866088+0000","last_change":"2024-09-21T00:15:16.861424+0000","last_active":"2024-09-21T00:15:17.866088+0000","last_peered":"2024-09-21T00:15:17.866088+0000","last_clean":"2024-09-21T00:15:17.866088+0000","last_became_active":"2024-09-21T00:15:16.861130+0000","last_became_peered":"2024-09-21T00:15:16.861130+0000","last_unstale":"2024-09-21T00:15:17.866088+0000","last_undegraded":"2024-09-21T00:15:17.866088+0000","last_fullsized":"2024-09-21T00:15:17.866088+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:05.839943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865885+0000","last_change":"2024-09-21T00:15:15.860701+0000","last_active":"2024-09-21T00:15:17.865885+0000","last_peered":"2024-09-21T00:15:17.865885+0000","last_clean":"2024-09-21T00:15:17.865885+0000","last_became_active":"2024-09-21T00:15:15.860434+0000","last_became_peered":"2024-09-21T00:15:15.860434+0000","last_unstale":"2024-09-21T00:15:17.865885+0000","last_undegraded":"2024-09-21T00:15:17.865885+0000","last_fullsized":"2024-09-21T00:15:17.865885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:02.081143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886058+0000","last_change":"2024-09-21T00:15:16.881672+0000","last_active":"2024-09-21T00:15:16.886058+0000","last_peered":"2024-09-21T00:15:16.886058+0000","last_clean":"2024-09-21T00:15:16.886058+0000","last_became_active":"2024-09-21T00:15:16.881337+0000","last_became_peered":"2024-09-21T00:15:16.881337+0000","last_unstale":"2024-09-21T00:15:16.886058+0000","last_undegraded":"2024-09-21T00:15:16.886058+0000","last_fullsized":"2024-09-21T00:15:16.886058+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:28.019280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.857047+0000","last_change":"2024-09-21T00:15:15.866551+0000","last_active":"2024-09-21T00:15:16.857047+0000","last_peered":"2024-09-21T00:15:16.857047+0000","last_clean":"2024-09-21T00:15:16.857047+0000","last_became_active":"2024-09-21T00:15:15.866253+0000","last_became_peered":"2024-09-21T00:15:15.866253+0000","last_unstale":"2024-09-21T00:15:16.857047+0000","last_undegraded":"2024-09-21T00:15:16.857047+0000","last_fullsized":"2024-09-21T00:15:16.857047+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:47.049937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866440+0000","last_change":"2024-09-21T00:15:16.887371+0000","last_active":"2024-09-21T00:15:17.866440+0000","last_peered":"2024-09-21T00:15:17.866440+0000","last_clean":"2024-09-21T00:15:17.866440+0000","last_became_active":"2024-09-21T00:15:16.887049+0000","last_became_peered":"2024-09-21T00:15:16.887049+0000","last_unstale":"2024-09-21T00:15:17.866440+0000","last_undegraded":"2024-09-21T00:15:17.866440+0000","last_fullsized":"2024-09-21T00:15:17.866440+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:02.733269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.854744+0000","last_change":"2024-09-21T00:15:15.874239+0000","last_active":"2024-09-21T00:15:16.854744+0000","last_peered":"2024-09-21T00:15:16.854744+0000","last_clean":"2024-09-21T00:15:16.854744+0000","last_became_active":"2024-09-21T00:15:15.873980+0000","last_became_peered":"2024-09-21T00:15:15.873980+0000","last_unstale":"2024-09-21T00:15:16.854744+0000","last_undegraded":"2024-09-21T00:15:16.854744+0000","last_fullsized":"2024-09-21T00:15:16.854744+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:12.783917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866375+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:15:16.866375+0000","last_peered":"2024-09-21T00:15:16.866375+0000","last_clean":"2024-09-21T00:15:16.866375+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:15:16.866375+0000","last_undegraded":"2024-09-21T00:15:16.866375+0000","last_fullsized":"2024-09-21T00:15:16.866375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":475136,"data_stored":194497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":194955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1052672,"data_stored":783151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":192853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":769295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:15:22.278 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-09-21T00:15:22.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-09-21T00:15:15.864138+0000', 'last_change': '2024-09-21T00:15:15.864138+0000', 'last_active': '2024-09-21T00:15:15.838346+0000', 'last_peered': '2024-09-21T00:15:15.838346+0000', 'last_clean': '2024-09-21T00:15:15.838346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T00:15:15.864138+0000', 'last_undegraded': '2024-09-21T00:15:15.864138+0000', 'last_fullsized': '2024-09-21T00:15:15.864138+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T00:15:15.838346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T00:15:15.838346+0000', 'last_clean_scrub_stamp': '2024-09-21T00:15:15.838346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T00:15:22.279 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-21T00:15:22.279 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-09-21T00:15:15.864118+0000', 'last_change': '2024-09-21T00:15:15.864118+0000', 'last_active': '2024-09-21T00:15:15.838346+0000', 'last_peered': '2024-09-21T00:15:15.838346+0000', 'last_clean': '2024-09-21T00:15:15.838346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T00:15:15.864118+0000', 'last_undegraded': '2024-09-21T00:15:15.864118+0000', 'last_fullsized': '2024-09-21T00:15:15.864118+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T00:15:15.838346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T00:15:15.838346+0000', 'last_clean_scrub_stamp': '2024-09-21T00:15:15.838346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T00:15:22.279 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-21T00:15:22.279 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-09-21T00:15:15.861246+0000', 'last_change': '2024-09-21T00:15:15.861246+0000', 'last_active': '2024-09-21T00:15:15.838346+0000', 'last_peered': '2024-09-21T00:15:15.838346+0000', 'last_clean': '2024-09-21T00:15:15.838346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T00:15:15.861246+0000', 'last_undegraded': '2024-09-21T00:15:15.861246+0000', 'last_fullsized': '2024-09-21T00:15:15.861246+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T00:15:15.838346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T00:15:15.838346+0000', 'last_clean_scrub_stamp': '2024-09-21T00:15:15.838346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T00:15:22.280 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T00:15:22.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.532+0000 7fdbd0c00640 1 -- 172.21.15.83:0/2611884889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbcc073dd0 msgr2=0x7fdbcc06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:22.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.532+0000 7fdbd0c00640 1 --2- 172.21.15.83:0/2611884889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbcc073dd0 0x7fdbcc06ddf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8005fd0 tx=0x7fdbb802a5d0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.533+0000 7fdbd0c00640 1 -- 172.21.15.83:0/2611884889 shutdown_connections 2024-09-21T00:15:22.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.533+0000 7fdbd0c00640 1 --2- 172.21.15.83:0/2611884889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbcc073dd0 0x7fdbcc06ddf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.533+0000 7fdbd0c00640 1 --2- 172.21.15.83:0/2611884889 >> v2:172.21.15.142:3300/0 conn(0x7fdbcc06e330 0x7fdbcc06ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.533+0000 7fdbd0c00640 1 -- 172.21.15.83:0/2611884889 >> 172.21.15.83:0/2611884889 conn(0x7fdbcc0cca40 msgr2=0x7fdbcc0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:22.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.533+0000 7fdbd0c00640 1 -- 172.21.15.83:0/2611884889 shutdown_connections 2024-09-21T00:15:22.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.533+0000 7fdbd0c00640 1 -- 172.21.15.83:0/2611884889 wait complete. 2024-09-21T00:15:22.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.535+0000 7fdbd0c00640 1 Processor -- start 2024-09-21T00:15:22.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.535+0000 7fdbd0c00640 1 -- start start 2024-09-21T00:15:22.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.536+0000 7fdbd0c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbcc06e330 0x7fdbcc158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:22.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbd0c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbcc073dd0 0x7fdbcc158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:22.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbd0c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc074cb0 0x7fdbcc09a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbd0c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc06f4a0 con 0x7fdbcc074cb0 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbd0c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc06f320 con 0x7fdbcc06e330 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbd0c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc06f620 con 0x7fdbcc073dd0 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbca800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc074cb0 0x7fdbcc09a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbc9e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbcc06e330 0x7fdbcc158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbca800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc074cb0 0x7fdbcc09a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43250/0 (socket says 172.21.15.83:43250) 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbca800640 1 -- 172.21.15.83:0/1669722342 learned_addr learned my addr 172.21.15.83:0/1669722342 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbc9400640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbcc073dd0 0x7fdbcc158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbca800640 1 -- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbcc073dd0 msgr2=0x7fdbcc158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbca800640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbcc073dd0 0x7fdbcc158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbca800640 1 -- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbcc06e330 msgr2=0x7fdbcc158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbca800640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbcc06e330 0x7fdbcc158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.537+0000 7fdbca800640 1 -- 172.21.15.83:0/1669722342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc09cdd0 con 0x7fdbcc074cb0 2024-09-21T00:15:22.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.538+0000 7fdbca800640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc074cb0 0x7fdbcc09a9e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400eab0 tx=0x7fdbc400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:22.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.538+0000 7fdbc2000640 1 -- 172.21.15.83:0/1669722342 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400cea0 con 0x7fdbcc074cb0 2024-09-21T00:15:22.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.538+0000 7fdbc2000640 1 -- 172.21.15.83:0/1669722342 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbc4004b20 con 0x7fdbcc074cb0 2024-09-21T00:15:22.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.538+0000 7fdbd0c00640 1 -- 172.21.15.83:0/1669722342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc09d0b0 con 0x7fdbcc074cb0 2024-09-21T00:15:22.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.538+0000 7fdbc2000640 1 -- 172.21.15.83:0/1669722342 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4005020 con 0x7fdbcc074cb0 2024-09-21T00:15:22.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.538+0000 7fdbd0c00640 1 -- 172.21.15.83:0/1669722342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc09d670 con 0x7fdbcc074cb0 2024-09-21T00:15:22.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.539+0000 7fdbd0c00640 1 -- 172.21.15.83:0/1669722342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbcc06fb60 con 0x7fdbcc074cb0 2024-09-21T00:15:22.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.540+0000 7fdbc2000640 1 -- 172.21.15.83:0/1669722342 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbc40051c0 con 0x7fdbcc074cb0 2024-09-21T00:15:22.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.541+0000 7fdbc2000640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdbac078bc0 0x7fdbac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:22.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.541+0000 7fdbc2000640 1 -- 172.21.15.83:0/1669722342 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fdbc409ba50 con 0x7fdbcc074cb0 2024-09-21T00:15:22.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.542+0000 7fdbc9e00640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdbac078bc0 0x7fdbac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:22.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.543+0000 7fdbc9e00640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdbac078bc0 0x7fdbac07b0d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc15a730 tx=0x7fdbbc009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:22.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.546+0000 7fdbc2000640 1 -- 172.21.15.83:0/1669722342 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdbc40636a0 con 0x7fdbcc074cb0 2024-09-21T00:15:22.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.800+0000 7fdbd0c00640 1 -- 172.21.15.83:0/1669722342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdbcc15eb70 con 0x7fdbcc074cb0 2024-09-21T00:15:22.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.800+0000 7fdbc2000640 1 -- 172.21.15.83:0/1669722342 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1302 (secure 0 0 0) 0x7fdbc40680d0 con 0x7fdbcc074cb0 2024-09-21T00:15:22.803 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:22.803 INFO:teuthology.orchestra.run.smithi083.stdout:{"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":101,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1726877637,"num_in_osds":8,"osd_in_since":1726877627,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":94},{"state_name":"creating+peering","count":3}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":226332672,"bytes_avail":772867780608,"bytes_total":773094113280,"inactive_pgs_ratio":0.030927835032343864,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":18,"btime":"2024-09-21T00:15:19:889534+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4918}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-21T00:15:06.865657+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T00:15:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 -- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdbac078bc0 msgr2=0x7fdbac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdbac078bc0 0x7fdbac07b0d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc15a730 tx=0x7fdbbc009040 comp rx=0 tx=0).stop 2024-09-21T00:15:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 -- 172.21.15.83:0/1669722342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc074cb0 msgr2=0x7fdbcc09a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc074cb0 0x7fdbcc09a9e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400eab0 tx=0x7fdbc400ef70 comp rx=0 tx=0).stop 2024-09-21T00:15:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 -- 172.21.15.83:0/1669722342 shutdown_connections 2024-09-21T00:15:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fdbac078bc0 0x7fdbac07b0d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc074cb0 0x7fdbcc09a9e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbcc073dd0 0x7fdbcc158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 --2- 172.21.15.83:0/1669722342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbcc06e330 0x7fdbcc158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 -- 172.21.15.83:0/1669722342 >> 172.21.15.83:0/1669722342 conn(0x7fdbcc0cca40 msgr2=0x7fdbcc159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 -- 172.21.15.83:0/1669722342 shutdown_connections 2024-09-21T00:15:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:22.803+0000 7fdbd0c00640 1 -- 172.21.15.83:0/1669722342 wait complete. 2024-09-21T00:15:22.827 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T00:15:22.828 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:15:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.048+0000 7f022f400640 1 -- 172.21.15.83:0/674041805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0228074cb0 msgr2=0x7f0228073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.048+0000 7f022f400640 1 --2- 172.21.15.83:0/674041805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0228074cb0 0x7f0228073dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0218009830 tx=0x7f021802a540 comp rx=0 tx=0).stop 2024-09-21T00:15:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.048+0000 7f022f400640 1 -- 172.21.15.83:0/674041805 shutdown_connections 2024-09-21T00:15:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.048+0000 7f022f400640 1 --2- 172.21.15.83:0/674041805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0228074cb0 0x7f0228073dd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.049+0000 7f022f400640 1 -- 172.21.15.83:0/674041805 >> 172.21.15.83:0/674041805 conn(0x7f02280cca40 msgr2=0x7f02280cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.049+0000 7f022f400640 1 -- 172.21.15.83:0/674041805 shutdown_connections 2024-09-21T00:15:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.049+0000 7f022f400640 1 -- 172.21.15.83:0/674041805 wait complete. 2024-09-21T00:15:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.051+0000 7f022f400640 1 Processor -- start 2024-09-21T00:15:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.051+0000 7f022f400640 1 -- start start 2024-09-21T00:15:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.052+0000 7f022f400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0228074cb0 0x7f02281f8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.052+0000 7f022f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02280cbc10 0x7f0228157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.052+0000 7f022f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02281578c0 0x7f02280c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.052+0000 7f022f400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f022806f670 con 0x7f02281578c0 2024-09-21T00:15:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.052+0000 7f022f400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f022806f4f0 con 0x7f02280cbc10 2024-09-21T00:15:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.052+0000 7f022f400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f022806f7f0 con 0x7f0228074cb0 2024-09-21T00:15:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.053+0000 7f022d400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02281578c0 0x7f02280c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.053+0000 7f022d400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02281578c0 0x7f02280c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43252/0 (socket says 172.21.15.83:43252) 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.053+0000 7f022d400640 1 -- 172.21.15.83:0/3616133848 learned_addr learned my addr 172.21.15.83:0/3616133848 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.053+0000 7f021fe00640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02280cbc10 0x7f0228157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.053+0000 7f022ca00640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0228074cb0 0x7f02281f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.053+0000 7f022d400640 1 -- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0228074cb0 msgr2=0x7f02281f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.053+0000 7f022d400640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0228074cb0 0x7f02281f8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.053+0000 7f022d400640 1 -- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02280cbc10 msgr2=0x7f0228157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.053+0000 7f022d400640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02280cbc10 0x7f0228157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.053+0000 7f022d400640 1 -- 172.21.15.83:0/3616133848 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02281fa1c0 con 0x7f02281578c0 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.054+0000 7f022d400640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02281578c0 0x7f02280c9580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f022000cbf0 tx=0x7f022000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.054+0000 7f0225600640 1 -- 172.21.15.83:0/3616133848 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220016020 con 0x7f02281578c0 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.054+0000 7f0225600640 1 -- 172.21.15.83:0/3616133848 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0220012420 con 0x7f02281578c0 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.054+0000 7f022f400640 1 -- 172.21.15.83:0/3616133848 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02281f9400 con 0x7f02281578c0 2024-09-21T00:15:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.054+0000 7f0225600640 1 -- 172.21.15.83:0/3616133848 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220012870 con 0x7f02281578c0 2024-09-21T00:15:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.054+0000 7f022f400640 1 -- 172.21.15.83:0/3616133848 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02281f99c0 con 0x7f02281578c0 2024-09-21T00:15:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.055+0000 7f022f400640 1 -- 172.21.15.83:0/3616133848 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0228073110 con 0x7f02281578c0 2024-09-21T00:15:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.056+0000 7f0225600640 1 -- 172.21.15.83:0/3616133848 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0220019020 con 0x7f02281578c0 2024-09-21T00:15:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.057+0000 7f0225600640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0204078bc0 0x7f020407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:23.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.057+0000 7f0225600640 1 -- 172.21.15.83:0/3616133848 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f022009b290 con 0x7f02281578c0 2024-09-21T00:15:23.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.058+0000 7f022ca00640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0204078bc0 0x7f020407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:23.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.059+0000 7f022ca00640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0204078bc0 0x7f020407b0d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0218034000 tx=0x7f0218004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:23.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.062+0000 7f0225600640 1 -- 172.21.15.83:0/3616133848 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0228073110 con 0x7f02281578c0 2024-09-21T00:15:23.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.244+0000 7f022f400640 1 -- 172.21.15.83:0/3616133848 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0228073dd0 con 0x7f0204078bc0 2024-09-21T00:15:23.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.250+0000 7f0225600640 1 -- 172.21.15.83:0/3616133848 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251939 (secure 0 0 0) 0x7f0228073dd0 con 0x7f0204078bc0 2024-09-21T00:15:23.255 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:15:23.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 -- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0204078bc0 msgr2=0x7f020407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:23.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0204078bc0 0x7f020407b0d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0218034000 tx=0x7f0218004730 comp rx=0 tx=0).stop 2024-09-21T00:15:23.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 -- 172.21.15.83:0/3616133848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02281578c0 msgr2=0x7f02280c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02281578c0 0x7f02280c9580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f022000cbf0 tx=0x7f022000a430 comp rx=0 tx=0).stop 2024-09-21T00:15:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 -- 172.21.15.83:0/3616133848 shutdown_connections 2024-09-21T00:15:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f0204078bc0 0x7f020407b0d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02281578c0 0x7f02280c9580 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02280cbc10 0x7f0228157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 --2- 172.21.15.83:0/3616133848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0228074cb0 0x7f02281f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 -- 172.21.15.83:0/3616133848 >> 172.21.15.83:0/3616133848 conn(0x7f02280cca40 msgr2=0x7f022815e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 -- 172.21.15.83:0/3616133848 shutdown_connections 2024-09-21T00:15:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:23.254+0000 7f022f400640 1 -- 172.21.15.83:0/3616133848 wait complete. 2024-09-21T00:15:23.280 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-09-21T00:15:22.869875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221076,"kb_used_data":4788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753644,"statfs":{"total":773094113280,"available":772867731456,"internally_reserved":0,"allocated":4902912,"data_stored":2734336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.024338"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893738+0000","last_change":"2024-09-21T00:15:16.887689+0000","last_active":"2024-09-21T00:15:16.893738+0000","last_peered":"2024-09-21T00:15:16.893738+0000","last_clean":"2024-09-21T00:15:16.893738+0000","last_became_active":"2024-09-21T00:15:16.886688+0000","last_became_peered":"2024-09-21T00:15:16.886688+0000","last_unstale":"2024-09-21T00:15:16.893738+0000","last_undegraded":"2024-09-21T00:15:16.893738+0000","last_fullsized":"2024-09-21T00:15:16.893738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.498683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888756+0000","last_change":"2024-09-21T00:15:16.885091+0000","last_active":"2024-09-21T00:15:16.888756+0000","last_peered":"2024-09-21T00:15:16.888756+0000","last_clean":"2024-09-21T00:15:16.888756+0000","last_became_active":"2024-09-21T00:15:16.878833+0000","last_became_peered":"2024-09-21T00:15:16.878833+0000","last_unstale":"2024-09-21T00:15:16.888756+0000","last_undegraded":"2024-09-21T00:15:16.888756+0000","last_fullsized":"2024-09-21T00:15:16.888756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:05.866795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.874244+0000","last_change":"2024-09-21T00:15:16.866321+0000","last_active":"2024-09-21T00:15:16.874244+0000","last_peered":"2024-09-21T00:15:16.874244+0000","last_clean":"2024-09-21T00:15:16.874244+0000","last_became_active":"2024-09-21T00:15:16.865947+0000","last_became_peered":"2024-09-21T00:15:16.865947+0000","last_unstale":"2024-09-21T00:15:16.874244+0000","last_undegraded":"2024-09-21T00:15:16.874244+0000","last_fullsized":"2024-09-21T00:15:16.874244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.312162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.864229+0000","last_change":"2024-09-21T00:15:16.862740+0000","last_active":"2024-09-21T00:15:16.864229+0000","last_peered":"2024-09-21T00:15:16.864229+0000","last_clean":"2024-09-21T00:15:16.864229+0000","last_became_active":"2024-09-21T00:15:16.861357+0000","last_became_peered":"2024-09-21T00:15:16.861357+0000","last_unstale":"2024-09-21T00:15:16.864229+0000","last_undegraded":"2024-09-21T00:15:16.864229+0000","last_fullsized":"2024-09-21T00:15:16.864229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:28.019280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868472+0000","last_change":"2024-09-21T00:15:16.882024+0000","last_active":"2024-09-21T00:15:17.868472+0000","last_peered":"2024-09-21T00:15:17.868472+0000","last_clean":"2024-09-21T00:15:17.868472+0000","last_became_active":"2024-09-21T00:15:16.878211+0000","last_became_peered":"2024-09-21T00:15:16.878211+0000","last_unstale":"2024-09-21T00:15:17.868472+0000","last_undegraded":"2024-09-21T00:15:17.868472+0000","last_fullsized":"2024-09-21T00:15:17.868472+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:48.635778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885291+0000","last_change":"2024-09-21T00:15:16.881989+0000","last_active":"2024-09-21T00:15:16.885291+0000","last_peered":"2024-09-21T00:15:16.885291+0000","last_clean":"2024-09-21T00:15:16.885291+0000","last_became_active":"2024-09-21T00:15:16.881672+0000","last_became_peered":"2024-09-21T00:15:16.881672+0000","last_unstale":"2024-09-21T00:15:16.885291+0000","last_undegraded":"2024-09-21T00:15:16.885291+0000","last_fullsized":"2024-09-21T00:15:16.885291+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:15.743262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.890066+0000","last_change":"2024-09-21T00:15:16.886616+0000","last_active":"2024-09-21T00:15:16.890066+0000","last_peered":"2024-09-21T00:15:16.890066+0000","last_clean":"2024-09-21T00:15:16.890066+0000","last_became_active":"2024-09-21T00:15:16.886275+0000","last_became_peered":"2024-09-21T00:15:16.886275+0000","last_unstale":"2024-09-21T00:15:16.890066+0000","last_undegraded":"2024-09-21T00:15:16.890066+0000","last_fullsized":"2024-09-21T00:15:16.890066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:02:33.652281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893560+0000","last_change":"2024-09-21T00:15:16.882497+0000","last_active":"2024-09-21T00:15:16.893560+0000","last_peered":"2024-09-21T00:15:16.893560+0000","last_clean":"2024-09-21T00:15:16.893560+0000","last_became_active":"2024-09-21T00:15:16.881675+0000","last_became_peered":"2024-09-21T00:15:16.881675+0000","last_unstale":"2024-09-21T00:15:16.893560+0000","last_undegraded":"2024-09-21T00:15:16.893560+0000","last_fullsized":"2024-09-21T00:15:16.893560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:10.585312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868290+0000","last_change":"2024-09-21T00:15:16.869075+0000","last_active":"2024-09-21T00:15:17.868290+0000","last_peered":"2024-09-21T00:15:17.868290+0000","last_clean":"2024-09-21T00:15:17.868290+0000","last_became_active":"2024-09-21T00:15:16.868688+0000","last_became_peered":"2024-09-21T00:15:16.868688+0000","last_unstale":"2024-09-21T00:15:17.868290+0000","last_undegraded":"2024-09-21T00:15:17.868290+0000","last_fullsized":"2024-09-21T00:15:17.868290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:09.707961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886006+0000","last_change":"2024-09-21T00:15:16.877674+0000","last_active":"2024-09-21T00:15:16.886006+0000","last_peered":"2024-09-21T00:15:16.886006+0000","last_clean":"2024-09-21T00:15:16.886006+0000","last_became_active":"2024-09-21T00:15:16.877348+0000","last_became_peered":"2024-09-21T00:15:16.877348+0000","last_unstale":"2024-09-21T00:15:16.886006+0000","last_undegraded":"2024-09-21T00:15:16.886006+0000","last_fullsized":"2024-09-21T00:15:16.886006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:38.180375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879914+0000","last_change":"2024-09-21T00:15:16.875449+0000","last_active":"2024-09-21T00:15:16.879914+0000","last_peered":"2024-09-21T00:15:16.879914+0000","last_clean":"2024-09-21T00:15:16.879914+0000","last_became_active":"2024-09-21T00:15:16.874660+0000","last_became_peered":"2024-09-21T00:15:16.874660+0000","last_unstale":"2024-09-21T00:15:16.879914+0000","last_undegraded":"2024-09-21T00:15:16.879914+0000","last_fullsized":"2024-09-21T00:15:16.879914+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:13.353817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868752+0000","last_change":"2024-09-21T00:15:16.880104+0000","last_active":"2024-09-21T00:15:17.868752+0000","last_peered":"2024-09-21T00:15:17.868752+0000","last_clean":"2024-09-21T00:15:17.868752+0000","last_became_active":"2024-09-21T00:15:16.877255+0000","last_became_peered":"2024-09-21T00:15:16.877255+0000","last_unstale":"2024-09-21T00:15:17.868752+0000","last_undegraded":"2024-09-21T00:15:17.868752+0000","last_fullsized":"2024-09-21T00:15:17.868752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:59.633259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888359+0000","last_change":"2024-09-21T00:15:16.886033+0000","last_active":"2024-09-21T00:15:16.888359+0000","last_peered":"2024-09-21T00:15:16.888359+0000","last_clean":"2024-09-21T00:15:16.888359+0000","last_became_active":"2024-09-21T00:15:16.885733+0000","last_became_peered":"2024-09-21T00:15:16.885733+0000","last_unstale":"2024-09-21T00:15:16.888359+0000","last_undegraded":"2024-09-21T00:15:16.888359+0000","last_fullsized":"2024-09-21T00:15:16.888359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:20:09.045667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.873226+0000","last_change":"2024-09-21T00:15:16.867951+0000","last_active":"2024-09-21T00:15:16.873226+0000","last_peered":"2024-09-21T00:15:16.873226+0000","last_clean":"2024-09-21T00:15:16.873226+0000","last_became_active":"2024-09-21T00:15:16.867657+0000","last_became_peered":"2024-09-21T00:15:16.867657+0000","last_unstale":"2024-09-21T00:15:16.873226+0000","last_undegraded":"2024-09-21T00:15:16.873226+0000","last_fullsized":"2024-09-21T00:15:16.873226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:59.633259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865646+0000","last_change":"2024-09-21T00:15:16.878574+0000","last_active":"2024-09-21T00:15:17.865646+0000","last_peered":"2024-09-21T00:15:17.865646+0000","last_clean":"2024-09-21T00:15:17.865646+0000","last_became_active":"2024-09-21T00:15:16.878228+0000","last_became_peered":"2024-09-21T00:15:16.878228+0000","last_unstale":"2024-09-21T00:15:17.865646+0000","last_undegraded":"2024-09-21T00:15:17.865646+0000","last_fullsized":"2024-09-21T00:15:17.865646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:33.038941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.876743+0000","last_change":"2024-09-21T00:15:16.868688+0000","last_active":"2024-09-21T00:15:16.876743+0000","last_peered":"2024-09-21T00:15:16.876743+0000","last_clean":"2024-09-21T00:15:16.876743+0000","last_became_active":"2024-09-21T00:15:16.868393+0000","last_became_peered":"2024-09-21T00:15:16.868393+0000","last_unstale":"2024-09-21T00:15:16.876743+0000","last_undegraded":"2024-09-21T00:15:16.876743+0000","last_fullsized":"2024-09-21T00:15:16.876743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:42.112862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866592+0000","last_change":"2024-09-21T00:15:16.872582+0000","last_active":"2024-09-21T00:15:17.866592+0000","last_peered":"2024-09-21T00:15:17.866592+0000","last_clean":"2024-09-21T00:15:17.866592+0000","last_became_active":"2024-09-21T00:15:16.872290+0000","last_became_peered":"2024-09-21T00:15:16.872290+0000","last_unstale":"2024-09-21T00:15:17.866592+0000","last_undegraded":"2024-09-21T00:15:17.866592+0000","last_fullsized":"2024-09-21T00:15:17.866592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:27.588288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866182+0000","last_change":"2024-09-21T00:15:16.869555+0000","last_active":"2024-09-21T00:15:17.866182+0000","last_peered":"2024-09-21T00:15:17.866182+0000","last_clean":"2024-09-21T00:15:17.866182+0000","last_became_active":"2024-09-21T00:15:16.869251+0000","last_became_peered":"2024-09-21T00:15:16.869251+0000","last_unstale":"2024-09-21T00:15:17.866182+0000","last_undegraded":"2024-09-21T00:15:17.866182+0000","last_fullsized":"2024-09-21T00:15:17.866182+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:27.130026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868026+0000","last_change":"2024-09-21T00:15:16.894998+0000","last_active":"2024-09-21T00:15:17.868026+0000","last_peered":"2024-09-21T00:15:17.868026+0000","last_clean":"2024-09-21T00:15:17.868026+0000","last_became_active":"2024-09-21T00:15:16.894688+0000","last_became_peered":"2024-09-21T00:15:16.894688+0000","last_unstale":"2024-09-21T00:15:17.868026+0000","last_undegraded":"2024-09-21T00:15:17.868026+0000","last_fullsized":"2024-09-21T00:15:17.868026+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:06.849923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.876036+0000","last_change":"2024-09-21T00:15:16.864289+0000","last_active":"2024-09-21T00:15:16.876036+0000","last_peered":"2024-09-21T00:15:16.876036+0000","last_clean":"2024-09-21T00:15:16.876036+0000","last_became_active":"2024-09-21T00:15:16.862950+0000","last_became_peered":"2024-09-21T00:15:16.862950+0000","last_unstale":"2024-09-21T00:15:16.876036+0000","last_undegraded":"2024-09-21T00:15:16.876036+0000","last_fullsized":"2024-09-21T00:15:16.876036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:25.302443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.877901+0000","last_change":"2024-09-21T00:15:16.865247+0000","last_active":"2024-09-21T00:15:16.877901+0000","last_peered":"2024-09-21T00:15:16.877901+0000","last_clean":"2024-09-21T00:15:16.877901+0000","last_became_active":"2024-09-21T00:15:16.864945+0000","last_became_peered":"2024-09-21T00:15:16.864945+0000","last_unstale":"2024-09-21T00:15:16.877901+0000","last_undegraded":"2024-09-21T00:15:16.877901+0000","last_fullsized":"2024-09-21T00:15:16.877901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:48.052839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885933+0000","last_change":"2024-09-21T00:15:16.880182+0000","last_active":"2024-09-21T00:15:16.885933+0000","last_peered":"2024-09-21T00:15:16.885933+0000","last_clean":"2024-09-21T00:15:16.885933+0000","last_became_active":"2024-09-21T00:15:16.874473+0000","last_became_peered":"2024-09-21T00:15:16.874473+0000","last_unstale":"2024-09-21T00:15:16.885933+0000","last_undegraded":"2024-09-21T00:15:16.885933+0000","last_fullsized":"2024-09-21T00:15:16.885933+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:03.681601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865743+0000","last_change":"2024-09-21T00:15:16.885945+0000","last_active":"2024-09-21T00:15:17.865743+0000","last_peered":"2024-09-21T00:15:17.865743+0000","last_clean":"2024-09-21T00:15:17.865743+0000","last_became_active":"2024-09-21T00:15:16.885606+0000","last_became_peered":"2024-09-21T00:15:16.885606+0000","last_unstale":"2024-09-21T00:15:17.865743+0000","last_undegraded":"2024-09-21T00:15:17.865743+0000","last_fullsized":"2024-09-21T00:15:17.865743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:14.873933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886342+0000","last_change":"2024-09-21T00:15:16.876420+0000","last_active":"2024-09-21T00:15:16.886342+0000","last_peered":"2024-09-21T00:15:16.886342+0000","last_clean":"2024-09-21T00:15:16.886342+0000","last_became_active":"2024-09-21T00:15:16.876184+0000","last_became_peered":"2024-09-21T00:15:16.876184+0000","last_unstale":"2024-09-21T00:15:16.886342+0000","last_undegraded":"2024-09-21T00:15:16.886342+0000","last_fullsized":"2024-09-21T00:15:16.886342+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:58.071856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889095+0000","last_change":"2024-09-21T00:15:16.875257+0000","last_active":"2024-09-21T00:15:16.889095+0000","last_peered":"2024-09-21T00:15:16.889095+0000","last_clean":"2024-09-21T00:15:16.889095+0000","last_became_active":"2024-09-21T00:15:16.874968+0000","last_became_peered":"2024-09-21T00:15:16.874968+0000","last_unstale":"2024-09-21T00:15:16.889095+0000","last_undegraded":"2024-09-21T00:15:16.889095+0000","last_fullsized":"2024-09-21T00:15:16.889095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:13.786819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.878361+0000","last_change":"2024-09-21T00:15:16.869118+0000","last_active":"2024-09-21T00:15:16.878361+0000","last_peered":"2024-09-21T00:15:16.878361+0000","last_clean":"2024-09-21T00:15:16.878361+0000","last_became_active":"2024-09-21T00:15:16.868763+0000","last_became_peered":"2024-09-21T00:15:16.868763+0000","last_unstale":"2024-09-21T00:15:16.878361+0000","last_undegraded":"2024-09-21T00:15:16.878361+0000","last_fullsized":"2024-09-21T00:15:16.878361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:23:49.873761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.887394+0000","last_change":"2024-09-21T00:15:16.883500+0000","last_active":"2024-09-21T00:15:16.887394+0000","last_peered":"2024-09-21T00:15:16.887394+0000","last_clean":"2024-09-21T00:15:16.887394+0000","last_became_active":"2024-09-21T00:15:16.883162+0000","last_became_peered":"2024-09-21T00:15:16.883162+0000","last_unstale":"2024-09-21T00:15:16.887394+0000","last_undegraded":"2024-09-21T00:15:16.887394+0000","last_fullsized":"2024-09-21T00:15:16.887394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:51.082466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.892774+0000","last_change":"2024-09-21T00:15:16.890105+0000","last_active":"2024-09-21T00:15:16.892774+0000","last_peered":"2024-09-21T00:15:16.892774+0000","last_clean":"2024-09-21T00:15:16.892774+0000","last_became_active":"2024-09-21T00:15:16.889782+0000","last_became_peered":"2024-09-21T00:15:16.889782+0000","last_unstale":"2024-09-21T00:15:16.892774+0000","last_undegraded":"2024-09-21T00:15:16.892774+0000","last_fullsized":"2024-09-21T00:15:16.892774+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:24.562660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866430+0000","last_change":"2024-09-21T00:15:16.883797+0000","last_active":"2024-09-21T00:15:17.866430+0000","last_peered":"2024-09-21T00:15:17.866430+0000","last_clean":"2024-09-21T00:15:17.866430+0000","last_became_active":"2024-09-21T00:15:16.882778+0000","last_became_peered":"2024-09-21T00:15:16.882778+0000","last_unstale":"2024-09-21T00:15:17.866430+0000","last_undegraded":"2024-09-21T00:15:17.866430+0000","last_fullsized":"2024-09-21T00:15:17.866430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:31.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865866+0000","last_change":"2024-09-21T00:15:16.881676+0000","last_active":"2024-09-21T00:15:17.865866+0000","last_peered":"2024-09-21T00:15:17.865866+0000","last_clean":"2024-09-21T00:15:17.865866+0000","last_became_active":"2024-09-21T00:15:16.881381+0000","last_became_peered":"2024-09-21T00:15:16.881381+0000","last_unstale":"2024-09-21T00:15:17.865866+0000","last_undegraded":"2024-09-21T00:15:17.865866+0000","last_fullsized":"2024-09-21T00:15:17.865866+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:29.864436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888158+0000","last_change":"2024-09-21T00:15:16.880582+0000","last_active":"2024-09-21T00:15:16.888158+0000","last_peered":"2024-09-21T00:15:16.888158+0000","last_clean":"2024-09-21T00:15:16.888158+0000","last_became_active":"2024-09-21T00:15:16.880298+0000","last_became_peered":"2024-09-21T00:15:16.880298+0000","last_unstale":"2024-09-21T00:15:16.888158+0000","last_undegraded":"2024-09-21T00:15:16.888158+0000","last_fullsized":"2024-09-21T00:15:16.888158+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:02.087826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893532+0000","last_change":"2024-09-21T00:15:16.881999+0000","last_active":"2024-09-21T00:15:16.893532+0000","last_peered":"2024-09-21T00:15:16.893532+0000","last_clean":"2024-09-21T00:15:16.893532+0000","last_became_active":"2024-09-21T00:15:16.881229+0000","last_became_peered":"2024-09-21T00:15:16.881229+0000","last_unstale":"2024-09-21T00:15:16.893532+0000","last_undegraded":"2024-09-21T00:15:16.893532+0000","last_fullsized":"2024-09-21T00:15:16.893532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.632208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866047+0000","last_change":"2024-09-21T00:15:16.867828+0000","last_active":"2024-09-21T00:15:17.866047+0000","last_peered":"2024-09-21T00:15:17.866047+0000","last_clean":"2024-09-21T00:15:17.866047+0000","last_became_active":"2024-09-21T00:15:16.867248+0000","last_became_peered":"2024-09-21T00:15:16.867248+0000","last_unstale":"2024-09-21T00:15:17.866047+0000","last_undegraded":"2024-09-21T00:15:17.866047+0000","last_fullsized":"2024-09-21T00:15:17.866047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:17.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889194+0000","last_change":"2024-09-21T00:15:15.871147+0000","last_active":"2024-09-21T00:15:16.889194+0000","last_peered":"2024-09-21T00:15:16.889194+0000","last_clean":"2024-09-21T00:15:16.889194+0000","last_became_active":"2024-09-21T00:15:15.870802+0000","last_became_peered":"2024-09-21T00:15:15.870802+0000","last_unstale":"2024-09-21T00:15:16.889194+0000","last_undegraded":"2024-09-21T00:15:16.889194+0000","last_fullsized":"2024-09-21T00:15:16.889194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:38.278690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885479+0000","last_change":"2024-09-21T00:15:16.883776+0000","last_active":"2024-09-21T00:15:16.885479+0000","last_peered":"2024-09-21T00:15:16.885479+0000","last_clean":"2024-09-21T00:15:16.885479+0000","last_became_active":"2024-09-21T00:15:16.881047+0000","last_became_peered":"2024-09-21T00:15:16.881047+0000","last_unstale":"2024-09-21T00:15:16.885479+0000","last_undegraded":"2024-09-21T00:15:16.885479+0000","last_fullsized":"2024-09-21T00:15:16.885479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:18.509764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885933+0000","last_change":"2024-09-21T00:15:15.865052+0000","last_active":"2024-09-21T00:15:16.885933+0000","last_peered":"2024-09-21T00:15:16.885933+0000","last_clean":"2024-09-21T00:15:16.885933+0000","last_became_active":"2024-09-21T00:15:15.864719+0000","last_became_peered":"2024-09-21T00:15:15.864719+0000","last_unstale":"2024-09-21T00:15:16.885933+0000","last_undegraded":"2024-09-21T00:15:16.885933+0000","last_fullsized":"2024-09-21T00:15:16.885933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:03.742657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866396+0000","last_change":"2024-09-21T00:15:16.875044+0000","last_active":"2024-09-21T00:15:17.866396+0000","last_peered":"2024-09-21T00:15:17.866396+0000","last_clean":"2024-09-21T00:15:17.866396+0000","last_became_active":"2024-09-21T00:15:16.869954+0000","last_became_peered":"2024-09-21T00:15:16.869954+0000","last_unstale":"2024-09-21T00:15:17.866396+0000","last_undegraded":"2024-09-21T00:15:17.866396+0000","last_fullsized":"2024-09-21T00:15:17.866396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:48.086484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900622+0000","last_change":"2024-09-21T00:15:15.869470+0000","last_active":"2024-09-21T00:15:16.900622+0000","last_peered":"2024-09-21T00:15:16.900622+0000","last_clean":"2024-09-21T00:15:16.900622+0000","last_became_active":"2024-09-21T00:15:15.869161+0000","last_became_peered":"2024-09-21T00:15:15.869161+0000","last_unstale":"2024-09-21T00:15:16.900622+0000","last_undegraded":"2024-09-21T00:15:16.900622+0000","last_fullsized":"2024-09-21T00:15:16.900622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:11.623197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.880499+0000","last_change":"2024-09-21T00:15:16.874950+0000","last_active":"2024-09-21T00:15:16.880499+0000","last_peered":"2024-09-21T00:15:16.880499+0000","last_clean":"2024-09-21T00:15:16.880499+0000","last_became_active":"2024-09-21T00:15:16.874649+0000","last_became_peered":"2024-09-21T00:15:16.874649+0000","last_unstale":"2024-09-21T00:15:16.880499+0000","last_undegraded":"2024-09-21T00:15:16.880499+0000","last_fullsized":"2024-09-21T00:15:16.880499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:00.593215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.899021+0000","last_change":"2024-09-21T00:15:15.876080+0000","last_active":"2024-09-21T00:15:16.899021+0000","last_peered":"2024-09-21T00:15:16.899021+0000","last_clean":"2024-09-21T00:15:16.899021+0000","last_became_active":"2024-09-21T00:15:15.875776+0000","last_became_peered":"2024-09-21T00:15:15.875776+0000","last_unstale":"2024-09-21T00:15:16.899021+0000","last_undegraded":"2024-09-21T00:15:16.899021+0000","last_fullsized":"2024-09-21T00:15:16.899021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:08.705060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.897229+0000","last_change":"2024-09-21T00:15:16.890109+0000","last_active":"2024-09-21T00:15:16.897229+0000","last_peered":"2024-09-21T00:15:16.897229+0000","last_clean":"2024-09-21T00:15:16.897229+0000","last_became_active":"2024-09-21T00:15:16.889670+0000","last_became_peered":"2024-09-21T00:15:16.889670+0000","last_unstale":"2024-09-21T00:15:16.897229+0000","last_undegraded":"2024-09-21T00:15:16.897229+0000","last_fullsized":"2024-09-21T00:15:16.897229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:02.210312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.887840+0000","last_change":"2024-09-21T00:15:15.863814+0000","last_active":"2024-09-21T00:15:16.887840+0000","last_peered":"2024-09-21T00:15:16.887840+0000","last_clean":"2024-09-21T00:15:16.887840+0000","last_became_active":"2024-09-21T00:15:15.862421+0000","last_became_peered":"2024-09-21T00:15:15.862421+0000","last_unstale":"2024-09-21T00:15:16.887840+0000","last_undegraded":"2024-09-21T00:15:16.887840+0000","last_fullsized":"2024-09-21T00:15:16.887840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:47.632876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888786+0000","last_change":"2024-09-21T00:15:16.885001+0000","last_active":"2024-09-21T00:15:16.888786+0000","last_peered":"2024-09-21T00:15:16.888786+0000","last_clean":"2024-09-21T00:15:16.888786+0000","last_became_active":"2024-09-21T00:15:16.884672+0000","last_became_peered":"2024-09-21T00:15:16.884672+0000","last_unstale":"2024-09-21T00:15:16.888786+0000","last_undegraded":"2024-09-21T00:15:16.888786+0000","last_fullsized":"2024-09-21T00:15:16.888786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.312162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893837+0000","last_change":"2024-09-21T00:15:15.868966+0000","last_active":"2024-09-21T00:15:16.893837+0000","last_peered":"2024-09-21T00:15:16.893837+0000","last_clean":"2024-09-21T00:15:16.893837+0000","last_became_active":"2024-09-21T00:15:15.868667+0000","last_became_peered":"2024-09-21T00:15:15.868667+0000","last_unstale":"2024-09-21T00:15:16.893837+0000","last_undegraded":"2024-09-21T00:15:16.893837+0000","last_fullsized":"2024-09-21T00:15:16.893837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:08:22.105332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866062+0000","last_change":"2024-09-21T00:15:16.863866+0000","last_active":"2024-09-21T00:15:17.866062+0000","last_peered":"2024-09-21T00:15:17.866062+0000","last_clean":"2024-09-21T00:15:17.866062+0000","last_became_active":"2024-09-21T00:15:16.862688+0000","last_became_peered":"2024-09-21T00:15:16.862688+0000","last_unstale":"2024-09-21T00:15:17.866062+0000","last_undegraded":"2024-09-21T00:15:17.866062+0000","last_fullsized":"2024-09-21T00:15:17.866062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:52.562904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.855893+0000","last_change":"2024-09-21T00:15:15.874143+0000","last_active":"2024-09-21T00:15:16.855893+0000","last_peered":"2024-09-21T00:15:16.855893+0000","last_clean":"2024-09-21T00:15:16.855893+0000","last_became_active":"2024-09-21T00:15:15.871902+0000","last_became_peered":"2024-09-21T00:15:15.871902+0000","last_unstale":"2024-09-21T00:15:16.855893+0000","last_undegraded":"2024-09-21T00:15:16.855893+0000","last_fullsized":"2024-09-21T00:15:16.855893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:24.299541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.884299+0000","last_change":"2024-09-21T00:15:16.876073+0000","last_active":"2024-09-21T00:15:16.884299+0000","last_peered":"2024-09-21T00:15:16.884299+0000","last_clean":"2024-09-21T00:15:16.884299+0000","last_became_active":"2024-09-21T00:15:16.875374+0000","last_became_peered":"2024-09-21T00:15:16.875374+0000","last_unstale":"2024-09-21T00:15:16.884299+0000","last_undegraded":"2024-09-21T00:15:16.884299+0000","last_fullsized":"2024-09-21T00:15:16.884299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:26:25.907755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866306+0000","last_change":"2024-09-21T00:15:15.872912+0000","last_active":"2024-09-21T00:15:16.866306+0000","last_peered":"2024-09-21T00:15:16.866306+0000","last_clean":"2024-09-21T00:15:16.866306+0000","last_became_active":"2024-09-21T00:15:15.872553+0000","last_became_peered":"2024-09-21T00:15:15.872553+0000","last_unstale":"2024-09-21T00:15:16.866306+0000","last_undegraded":"2024-09-21T00:15:16.866306+0000","last_fullsized":"2024-09-21T00:15:16.866306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:36.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.881302+0000","last_change":"2024-09-21T00:15:16.864727+0000","last_active":"2024-09-21T00:15:16.881302+0000","last_peered":"2024-09-21T00:15:16.881302+0000","last_clean":"2024-09-21T00:15:16.881302+0000","last_became_active":"2024-09-21T00:15:16.864246+0000","last_became_peered":"2024-09-21T00:15:16.864246+0000","last_unstale":"2024-09-21T00:15:16.881302+0000","last_undegraded":"2024-09-21T00:15:16.881302+0000","last_fullsized":"2024-09-21T00:15:16.881302+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:51.082466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.858347+0000","last_change":"2024-09-21T00:15:15.871490+0000","last_active":"2024-09-21T00:15:16.858347+0000","last_peered":"2024-09-21T00:15:16.858347+0000","last_clean":"2024-09-21T00:15:16.858347+0000","last_became_active":"2024-09-21T00:15:15.871156+0000","last_became_peered":"2024-09-21T00:15:15.871156+0000","last_unstale":"2024-09-21T00:15:16.858347+0000","last_undegraded":"2024-09-21T00:15:16.858347+0000","last_fullsized":"2024-09-21T00:15:16.858347+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:12.350916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889035+0000","last_change":"2024-09-21T00:15:16.876745+0000","last_active":"2024-09-21T00:15:16.889035+0000","last_peered":"2024-09-21T00:15:16.889035+0000","last_clean":"2024-09-21T00:15:16.889035+0000","last_became_active":"2024-09-21T00:15:16.876387+0000","last_became_peered":"2024-09-21T00:15:16.876387+0000","last_unstale":"2024-09-21T00:15:16.889035+0000","last_undegraded":"2024-09-21T00:15:16.889035+0000","last_fullsized":"2024-09-21T00:15:16.889035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:29.493781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866219+0000","last_change":"2024-09-21T00:15:15.861011+0000","last_active":"2024-09-21T00:15:17.866219+0000","last_peered":"2024-09-21T00:15:17.866219+0000","last_clean":"2024-09-21T00:15:17.866219+0000","last_became_active":"2024-09-21T00:15:15.859747+0000","last_became_peered":"2024-09-21T00:15:15.859747+0000","last_unstale":"2024-09-21T00:15:17.866219+0000","last_undegraded":"2024-09-21T00:15:17.866219+0000","last_fullsized":"2024-09-21T00:15:17.866219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:11.431973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879757+0000","last_change":"2024-09-21T00:15:16.871360+0000","last_active":"2024-09-21T00:15:16.879757+0000","last_peered":"2024-09-21T00:15:16.879757+0000","last_clean":"2024-09-21T00:15:16.879757+0000","last_became_active":"2024-09-21T00:15:16.871013+0000","last_became_peered":"2024-09-21T00:15:16.871013+0000","last_unstale":"2024-09-21T00:15:16.879757+0000","last_undegraded":"2024-09-21T00:15:16.879757+0000","last_fullsized":"2024-09-21T00:15:16.879757+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:13.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866222+0000","last_change":"2024-09-21T00:15:15.865177+0000","last_active":"2024-09-21T00:15:17.866222+0000","last_peered":"2024-09-21T00:15:17.866222+0000","last_clean":"2024-09-21T00:15:17.866222+0000","last_became_active":"2024-09-21T00:15:15.864924+0000","last_became_peered":"2024-09-21T00:15:15.864924+0000","last_unstale":"2024-09-21T00:15:17.866222+0000","last_undegraded":"2024-09-21T00:15:17.866222+0000","last_fullsized":"2024-09-21T00:15:17.866222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:04:53.011253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.888496+0000","last_change":"2024-09-21T00:15:16.886616+0000","last_active":"2024-09-21T00:15:16.888496+0000","last_peered":"2024-09-21T00:15:16.888496+0000","last_clean":"2024-09-21T00:15:16.888496+0000","last_became_active":"2024-09-21T00:15:16.886309+0000","last_became_peered":"2024-09-21T00:15:16.886309+0000","last_unstale":"2024-09-21T00:15:16.888496+0000","last_undegraded":"2024-09-21T00:15:16.888496+0000","last_fullsized":"2024-09-21T00:15:16.888496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:22.033235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.907440+0000","last_change":"2024-09-21T00:15:15.872932+0000","last_active":"2024-09-21T00:15:16.907440+0000","last_peered":"2024-09-21T00:15:16.907440+0000","last_clean":"2024-09-21T00:15:16.907440+0000","last_became_active":"2024-09-21T00:15:15.872625+0000","last_became_peered":"2024-09-21T00:15:15.872625+0000","last_unstale":"2024-09-21T00:15:16.907440+0000","last_undegraded":"2024-09-21T00:15:16.907440+0000","last_fullsized":"2024-09-21T00:15:16.907440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:02.678699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.880518+0000","last_change":"2024-09-21T00:15:16.869519+0000","last_active":"2024-09-21T00:15:16.880518+0000","last_peered":"2024-09-21T00:15:16.880518+0000","last_clean":"2024-09-21T00:15:16.880518+0000","last_became_active":"2024-09-21T00:15:16.868514+0000","last_became_peered":"2024-09-21T00:15:16.868514+0000","last_unstale":"2024-09-21T00:15:16.880518+0000","last_undegraded":"2024-09-21T00:15:16.880518+0000","last_fullsized":"2024-09-21T00:15:16.880518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:04.585473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900610+0000","last_change":"2024-09-21T00:15:15.864869+0000","last_active":"2024-09-21T00:15:16.900610+0000","last_peered":"2024-09-21T00:15:16.900610+0000","last_clean":"2024-09-21T00:15:16.900610+0000","last_became_active":"2024-09-21T00:15:15.863402+0000","last_became_peered":"2024-09-21T00:15:15.863402+0000","last_unstale":"2024-09-21T00:15:16.900610+0000","last_undegraded":"2024-09-21T00:15:16.900610+0000","last_fullsized":"2024-09-21T00:15:16.900610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:15.543176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.891762+0000","last_change":"2024-09-21T00:15:16.889929+0000","last_active":"2024-09-21T00:15:16.891762+0000","last_peered":"2024-09-21T00:15:16.891762+0000","last_clean":"2024-09-21T00:15:16.891762+0000","last_became_active":"2024-09-21T00:15:16.889592+0000","last_became_peered":"2024-09-21T00:15:16.889592+0000","last_unstale":"2024-09-21T00:15:16.891762+0000","last_undegraded":"2024-09-21T00:15:16.891762+0000","last_fullsized":"2024-09-21T00:15:16.891762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:18:05.708718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.870448+0000","last_change":"2024-09-21T00:15:15.856402+0000","last_active":"2024-09-21T00:15:16.870448+0000","last_peered":"2024-09-21T00:15:16.870448+0000","last_clean":"2024-09-21T00:15:16.870448+0000","last_became_active":"2024-09-21T00:15:15.856065+0000","last_became_peered":"2024-09-21T00:15:15.856065+0000","last_unstale":"2024-09-21T00:15:16.870448+0000","last_undegraded":"2024-09-21T00:15:16.870448+0000","last_fullsized":"2024-09-21T00:15:16.870448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:34.468856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885960+0000","last_change":"2024-09-21T00:15:16.880219+0000","last_active":"2024-09-21T00:15:16.885960+0000","last_peered":"2024-09-21T00:15:16.885960+0000","last_clean":"2024-09-21T00:15:16.885960+0000","last_became_active":"2024-09-21T00:15:16.879024+0000","last_became_peered":"2024-09-21T00:15:16.879024+0000","last_unstale":"2024-09-21T00:15:16.885960+0000","last_undegraded":"2024-09-21T00:15:16.885960+0000","last_fullsized":"2024-09-21T00:15:16.885960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:12.626099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865879+0000","last_change":"2024-09-21T00:15:15.864833+0000","last_active":"2024-09-21T00:15:17.865879+0000","last_peered":"2024-09-21T00:15:17.865879+0000","last_clean":"2024-09-21T00:15:17.865879+0000","last_became_active":"2024-09-21T00:15:15.864497+0000","last_became_peered":"2024-09-21T00:15:15.864497+0000","last_unstale":"2024-09-21T00:15:17.865879+0000","last_undegraded":"2024-09-21T00:15:17.865879+0000","last_fullsized":"2024-09-21T00:15:17.865879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:49.050645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868649+0000","last_change":"2024-09-21T00:15:16.881508+0000","last_active":"2024-09-21T00:15:17.868649+0000","last_peered":"2024-09-21T00:15:17.868649+0000","last_clean":"2024-09-21T00:15:17.868649+0000","last_became_active":"2024-09-21T00:15:16.877197+0000","last_became_peered":"2024-09-21T00:15:16.877197+0000","last_unstale":"2024-09-21T00:15:17.868649+0000","last_undegraded":"2024-09-21T00:15:17.868649+0000","last_fullsized":"2024-09-21T00:15:17.868649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:39.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889411+0000","last_change":"2024-09-21T00:15:15.866587+0000","last_active":"2024-09-21T00:15:16.889411+0000","last_peered":"2024-09-21T00:15:16.889411+0000","last_clean":"2024-09-21T00:15:16.889411+0000","last_became_active":"2024-09-21T00:15:15.864940+0000","last_became_peered":"2024-09-21T00:15:15.864940+0000","last_unstale":"2024-09-21T00:15:16.889411+0000","last_undegraded":"2024-09-21T00:15:16.889411+0000","last_fullsized":"2024-09-21T00:15:16.889411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:22.127731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893356+0000","last_change":"2024-09-21T00:15:16.892157+0000","last_active":"2024-09-21T00:15:16.893356+0000","last_peered":"2024-09-21T00:15:16.893356+0000","last_clean":"2024-09-21T00:15:16.893356+0000","last_became_active":"2024-09-21T00:15:16.888127+0000","last_became_peered":"2024-09-21T00:15:16.888127+0000","last_unstale":"2024-09-21T00:15:16.893356+0000","last_undegraded":"2024-09-21T00:15:16.893356+0000","last_fullsized":"2024-09-21T00:15:16.893356+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:02.683038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.889917+0000","last_change":"2024-09-21T00:15:15.873619+0000","last_active":"2024-09-21T00:15:16.889917+0000","last_peered":"2024-09-21T00:15:16.889917+0000","last_clean":"2024-09-21T00:15:16.889917+0000","last_became_active":"2024-09-21T00:15:15.873342+0000","last_became_peered":"2024-09-21T00:15:15.873342+0000","last_unstale":"2024-09-21T00:15:16.889917+0000","last_undegraded":"2024-09-21T00:15:16.889917+0000","last_fullsized":"2024-09-21T00:15:16.889917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:40.599261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.900501+0000","last_change":"2024-09-21T00:15:16.894537+0000","last_active":"2024-09-21T00:15:16.900501+0000","last_peered":"2024-09-21T00:15:16.900501+0000","last_clean":"2024-09-21T00:15:16.900501+0000","last_became_active":"2024-09-21T00:15:16.894328+0000","last_became_peered":"2024-09-21T00:15:16.894328+0000","last_unstale":"2024-09-21T00:15:16.900501+0000","last_undegraded":"2024-09-21T00:15:16.900501+0000","last_fullsized":"2024-09-21T00:15:16.900501+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:32.391700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866406+0000","last_change":"2024-09-21T00:15:15.869830+0000","last_active":"2024-09-21T00:15:17.866406+0000","last_peered":"2024-09-21T00:15:17.866406+0000","last_clean":"2024-09-21T00:15:17.866406+0000","last_became_active":"2024-09-21T00:15:15.867650+0000","last_became_peered":"2024-09-21T00:15:15.867650+0000","last_unstale":"2024-09-21T00:15:17.866406+0000","last_undegraded":"2024-09-21T00:15:17.866406+0000","last_fullsized":"2024-09-21T00:15:17.866406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:28.691334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.890222+0000","last_change":"2024-09-21T00:15:16.887082+0000","last_active":"2024-09-21T00:15:16.890222+0000","last_peered":"2024-09-21T00:15:16.890222+0000","last_clean":"2024-09-21T00:15:16.890222+0000","last_became_active":"2024-09-21T00:15:16.885720+0000","last_became_peered":"2024-09-21T00:15:16.885720+0000","last_unstale":"2024-09-21T00:15:16.890222+0000","last_undegraded":"2024-09-21T00:15:16.890222+0000","last_fullsized":"2024-09-21T00:15:16.890222+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:53.816749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867676+0000","last_change":"2024-09-21T00:15:15.872212+0000","last_active":"2024-09-21T00:15:17.867676+0000","last_peered":"2024-09-21T00:15:17.867676+0000","last_clean":"2024-09-21T00:15:17.867676+0000","last_became_active":"2024-09-21T00:15:15.870779+0000","last_became_peered":"2024-09-21T00:15:15.870779+0000","last_unstale":"2024-09-21T00:15:17.867676+0000","last_undegraded":"2024-09-21T00:15:17.867676+0000","last_fullsized":"2024-09-21T00:15:17.867676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:43.736010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868872+0000","last_change":"2024-09-21T00:15:16.896157+0000","last_active":"2024-09-21T00:15:17.868872+0000","last_peered":"2024-09-21T00:15:17.868872+0000","last_clean":"2024-09-21T00:15:17.868872+0000","last_became_active":"2024-09-21T00:15:16.895860+0000","last_became_peered":"2024-09-21T00:15:16.895860+0000","last_unstale":"2024-09-21T00:15:17.868872+0000","last_undegraded":"2024-09-21T00:15:17.868872+0000","last_fullsized":"2024-09-21T00:15:17.868872+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:17.443616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867799+0000","last_change":"2024-09-21T00:15:15.873944+0000","last_active":"2024-09-21T00:15:17.867799+0000","last_peered":"2024-09-21T00:15:17.867799+0000","last_clean":"2024-09-21T00:15:17.867799+0000","last_became_active":"2024-09-21T00:15:15.873612+0000","last_became_peered":"2024-09-21T00:15:15.873612+0000","last_unstale":"2024-09-21T00:15:17.867799+0000","last_undegraded":"2024-09-21T00:15:17.867799+0000","last_fullsized":"2024-09-21T00:15:17.867799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:59.162788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865655+0000","last_change":"2024-09-21T00:15:16.878490+0000","last_active":"2024-09-21T00:15:17.865655+0000","last_peered":"2024-09-21T00:15:17.865655+0000","last_clean":"2024-09-21T00:15:17.865655+0000","last_became_active":"2024-09-21T00:15:16.878218+0000","last_became_peered":"2024-09-21T00:15:16.878218+0000","last_unstale":"2024-09-21T00:15:17.865655+0000","last_undegraded":"2024-09-21T00:15:17.865655+0000","last_fullsized":"2024-09-21T00:15:17.865655+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:58.804183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867835+0000","last_change":"2024-09-21T00:15:15.869680+0000","last_active":"2024-09-21T00:15:17.867835+0000","last_peered":"2024-09-21T00:15:17.867835+0000","last_clean":"2024-09-21T00:15:17.867835+0000","last_became_active":"2024-09-21T00:15:15.869363+0000","last_became_peered":"2024-09-21T00:15:15.869363+0000","last_unstale":"2024-09-21T00:15:17.867835+0000","last_undegraded":"2024-09-21T00:15:17.867835+0000","last_fullsized":"2024-09-21T00:15:17.867835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:27.516461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.893469+0000","last_change":"2024-09-21T00:15:16.881332+0000","last_active":"2024-09-21T00:15:16.893469+0000","last_peered":"2024-09-21T00:15:16.893469+0000","last_clean":"2024-09-21T00:15:16.893469+0000","last_became_active":"2024-09-21T00:15:16.881080+0000","last_became_peered":"2024-09-21T00:15:16.881080+0000","last_unstale":"2024-09-21T00:15:16.893469+0000","last_undegraded":"2024-09-21T00:15:16.893469+0000","last_fullsized":"2024-09-21T00:15:16.893469+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:34.255761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.870217+0000","last_change":"2024-09-21T00:15:15.869495+0000","last_active":"2024-09-21T00:15:16.870217+0000","last_peered":"2024-09-21T00:15:16.870217+0000","last_clean":"2024-09-21T00:15:16.870217+0000","last_became_active":"2024-09-21T00:15:15.868711+0000","last_became_peered":"2024-09-21T00:15:15.868711+0000","last_unstale":"2024-09-21T00:15:16.870217+0000","last_undegraded":"2024-09-21T00:15:16.870217+0000","last_fullsized":"2024-09-21T00:15:16.870217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:29.397639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879204+0000","last_change":"2024-09-21T00:15:16.871518+0000","last_active":"2024-09-21T00:15:16.879204+0000","last_peered":"2024-09-21T00:15:16.879204+0000","last_clean":"2024-09-21T00:15:16.879204+0000","last_became_active":"2024-09-21T00:15:16.867533+0000","last_became_peered":"2024-09-21T00:15:16.867533+0000","last_unstale":"2024-09-21T00:15:16.879204+0000","last_undegraded":"2024-09-21T00:15:16.879204+0000","last_fullsized":"2024-09-21T00:15:16.879204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:16.546077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866257+0000","last_change":"2024-09-21T00:15:15.873204+0000","last_active":"2024-09-21T00:15:16.866257+0000","last_peered":"2024-09-21T00:15:16.866257+0000","last_clean":"2024-09-21T00:15:16.866257+0000","last_became_active":"2024-09-21T00:15:15.872545+0000","last_became_peered":"2024-09-21T00:15:15.872545+0000","last_unstale":"2024-09-21T00:15:16.866257+0000","last_undegraded":"2024-09-21T00:15:16.866257+0000","last_fullsized":"2024-09-21T00:15:16.866257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:30.945225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.897267+0000","last_change":"2024-09-21T00:15:16.879831+0000","last_active":"2024-09-21T00:15:16.897267+0000","last_peered":"2024-09-21T00:15:16.897267+0000","last_clean":"2024-09-21T00:15:16.897267+0000","last_became_active":"2024-09-21T00:15:16.879538+0000","last_became_peered":"2024-09-21T00:15:16.879538+0000","last_unstale":"2024-09-21T00:15:16.897267+0000","last_undegraded":"2024-09-21T00:15:16.897267+0000","last_fullsized":"2024-09-21T00:15:16.897267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:58.449816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.867406+0000","last_change":"2024-09-21T00:15:15.868499+0000","last_active":"2024-09-21T00:15:16.867406+0000","last_peered":"2024-09-21T00:15:16.867406+0000","last_clean":"2024-09-21T00:15:16.867406+0000","last_became_active":"2024-09-21T00:15:15.868218+0000","last_became_peered":"2024-09-21T00:15:15.868218+0000","last_unstale":"2024-09-21T00:15:16.867406+0000","last_undegraded":"2024-09-21T00:15:16.867406+0000","last_fullsized":"2024-09-21T00:15:16.867406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.537075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868970+0000","last_change":"2024-09-21T00:15:16.882839+0000","last_active":"2024-09-21T00:15:17.868970+0000","last_peered":"2024-09-21T00:15:17.868970+0000","last_clean":"2024-09-21T00:15:17.868970+0000","last_became_active":"2024-09-21T00:15:16.878078+0000","last_became_peered":"2024-09-21T00:15:16.878078+0000","last_unstale":"2024-09-21T00:15:17.868970+0000","last_undegraded":"2024-09-21T00:15:17.868970+0000","last_fullsized":"2024-09-21T00:15:17.868970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:13.786819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866618+0000","last_change":"2024-09-21T00:15:15.861682+0000","last_active":"2024-09-21T00:15:17.866618+0000","last_peered":"2024-09-21T00:15:17.866618+0000","last_clean":"2024-09-21T00:15:17.866618+0000","last_became_active":"2024-09-21T00:15:15.861408+0000","last_became_peered":"2024-09-21T00:15:15.861408+0000","last_unstale":"2024-09-21T00:15:17.866618+0000","last_undegraded":"2024-09-21T00:15:17.866618+0000","last_fullsized":"2024-09-21T00:15:17.866618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:30.905194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.879887+0000","last_change":"2024-09-21T00:15:16.875154+0000","last_active":"2024-09-21T00:15:16.879887+0000","last_peered":"2024-09-21T00:15:16.879887+0000","last_clean":"2024-09-21T00:15:16.879887+0000","last_became_active":"2024-09-21T00:15:16.874266+0000","last_became_peered":"2024-09-21T00:15:16.874266+0000","last_unstale":"2024-09-21T00:15:16.879887+0000","last_undegraded":"2024-09-21T00:15:16.879887+0000","last_fullsized":"2024-09-21T00:15:16.879887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:24.704654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868030+0000","last_change":"2024-09-21T00:15:15.874388+0000","last_active":"2024-09-21T00:15:17.868030+0000","last_peered":"2024-09-21T00:15:17.868030+0000","last_clean":"2024-09-21T00:15:17.868030+0000","last_became_active":"2024-09-21T00:15:15.873129+0000","last_became_peered":"2024-09-21T00:15:15.873129+0000","last_unstale":"2024-09-21T00:15:17.868030+0000","last_undegraded":"2024-09-21T00:15:17.868030+0000","last_fullsized":"2024-09-21T00:15:17.868030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:14.230132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868269+0000","last_change":"2024-09-21T00:15:16.889065+0000","last_active":"2024-09-21T00:15:17.868269+0000","last_peered":"2024-09-21T00:15:17.868269+0000","last_clean":"2024-09-21T00:15:17.868269+0000","last_became_active":"2024-09-21T00:15:16.888720+0000","last_became_peered":"2024-09-21T00:15:16.888720+0000","last_unstale":"2024-09-21T00:15:17.868269+0000","last_undegraded":"2024-09-21T00:15:17.868269+0000","last_fullsized":"2024-09-21T00:15:17.868269+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.858929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867811+0000","last_change":"2024-09-21T00:15:15.863805+0000","last_active":"2024-09-21T00:15:17.867811+0000","last_peered":"2024-09-21T00:15:17.867811+0000","last_clean":"2024-09-21T00:15:17.867811+0000","last_became_active":"2024-09-21T00:15:15.863461+0000","last_became_peered":"2024-09-21T00:15:15.863461+0000","last_unstale":"2024-09-21T00:15:17.867811+0000","last_undegraded":"2024-09-21T00:15:17.867811+0000","last_fullsized":"2024-09-21T00:15:17.867811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:26.759455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867630+0000","last_change":"2024-09-21T00:15:16.864392+0000","last_active":"2024-09-21T00:15:17.867630+0000","last_peered":"2024-09-21T00:15:17.867630+0000","last_clean":"2024-09-21T00:15:17.867630+0000","last_became_active":"2024-09-21T00:15:16.864065+0000","last_became_peered":"2024-09-21T00:15:16.864065+0000","last_unstale":"2024-09-21T00:15:17.867630+0000","last_undegraded":"2024-09-21T00:15:17.867630+0000","last_fullsized":"2024-09-21T00:15:17.867630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:23.130632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.858033+0000","last_change":"2024-09-21T00:15:15.863840+0000","last_active":"2024-09-21T00:15:16.858033+0000","last_peered":"2024-09-21T00:15:16.858033+0000","last_clean":"2024-09-21T00:15:16.858033+0000","last_became_active":"2024-09-21T00:15:15.863081+0000","last_became_peered":"2024-09-21T00:15:15.863081+0000","last_unstale":"2024-09-21T00:15:16.858033+0000","last_undegraded":"2024-09-21T00:15:16.858033+0000","last_fullsized":"2024-09-21T00:15:16.858033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:23.701752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.885634+0000","last_change":"2024-09-21T00:15:16.881804+0000","last_active":"2024-09-21T00:15:16.885634+0000","last_peered":"2024-09-21T00:15:16.885634+0000","last_clean":"2024-09-21T00:15:16.885634+0000","last_became_active":"2024-09-21T00:15:16.881268+0000","last_became_peered":"2024-09-21T00:15:16.881268+0000","last_unstale":"2024-09-21T00:15:16.885634+0000","last_undegraded":"2024-09-21T00:15:16.885634+0000","last_fullsized":"2024-09-21T00:15:16.885634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:36.128848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.856977+0000","last_change":"2024-09-21T00:15:15.874106+0000","last_active":"2024-09-21T00:15:16.856977+0000","last_peered":"2024-09-21T00:15:16.856977+0000","last_clean":"2024-09-21T00:15:16.856977+0000","last_became_active":"2024-09-21T00:15:15.873619+0000","last_became_peered":"2024-09-21T00:15:15.873619+0000","last_unstale":"2024-09-21T00:15:16.856977+0000","last_undegraded":"2024-09-21T00:15:16.856977+0000","last_fullsized":"2024-09-21T00:15:16.856977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:28.490880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866088+0000","last_change":"2024-09-21T00:15:16.861424+0000","last_active":"2024-09-21T00:15:17.866088+0000","last_peered":"2024-09-21T00:15:17.866088+0000","last_clean":"2024-09-21T00:15:17.866088+0000","last_became_active":"2024-09-21T00:15:16.861130+0000","last_became_peered":"2024-09-21T00:15:16.861130+0000","last_unstale":"2024-09-21T00:15:17.866088+0000","last_undegraded":"2024-09-21T00:15:17.866088+0000","last_fullsized":"2024-09-21T00:15:17.866088+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:05.839943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865885+0000","last_change":"2024-09-21T00:15:15.860701+0000","last_active":"2024-09-21T00:15:17.865885+0000","last_peered":"2024-09-21T00:15:17.865885+0000","last_clean":"2024-09-21T00:15:17.865885+0000","last_became_active":"2024-09-21T00:15:15.860434+0000","last_became_peered":"2024-09-21T00:15:15.860434+0000","last_unstale":"2024-09-21T00:15:17.865885+0000","last_undegraded":"2024-09-21T00:15:17.865885+0000","last_fullsized":"2024-09-21T00:15:17.865885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:02.081143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.886058+0000","last_change":"2024-09-21T00:15:16.881672+0000","last_active":"2024-09-21T00:15:16.886058+0000","last_peered":"2024-09-21T00:15:16.886058+0000","last_clean":"2024-09-21T00:15:16.886058+0000","last_became_active":"2024-09-21T00:15:16.881337+0000","last_became_peered":"2024-09-21T00:15:16.881337+0000","last_unstale":"2024-09-21T00:15:16.886058+0000","last_undegraded":"2024-09-21T00:15:16.886058+0000","last_fullsized":"2024-09-21T00:15:16.886058+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:28.019280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.857047+0000","last_change":"2024-09-21T00:15:15.866551+0000","last_active":"2024-09-21T00:15:16.857047+0000","last_peered":"2024-09-21T00:15:16.857047+0000","last_clean":"2024-09-21T00:15:16.857047+0000","last_became_active":"2024-09-21T00:15:15.866253+0000","last_became_peered":"2024-09-21T00:15:15.866253+0000","last_unstale":"2024-09-21T00:15:16.857047+0000","last_undegraded":"2024-09-21T00:15:16.857047+0000","last_fullsized":"2024-09-21T00:15:16.857047+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:47.049937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866440+0000","last_change":"2024-09-21T00:15:16.887371+0000","last_active":"2024-09-21T00:15:17.866440+0000","last_peered":"2024-09-21T00:15:17.866440+0000","last_clean":"2024-09-21T00:15:17.866440+0000","last_became_active":"2024-09-21T00:15:16.887049+0000","last_became_peered":"2024-09-21T00:15:16.887049+0000","last_unstale":"2024-09-21T00:15:17.866440+0000","last_undegraded":"2024-09-21T00:15:17.866440+0000","last_fullsized":"2024-09-21T00:15:17.866440+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:02.733269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.854744+0000","last_change":"2024-09-21T00:15:15.874239+0000","last_active":"2024-09-21T00:15:16.854744+0000","last_peered":"2024-09-21T00:15:16.854744+0000","last_clean":"2024-09-21T00:15:16.854744+0000","last_became_active":"2024-09-21T00:15:15.873980+0000","last_became_peered":"2024-09-21T00:15:15.873980+0000","last_unstale":"2024-09-21T00:15:16.854744+0000","last_undegraded":"2024-09-21T00:15:16.854744+0000","last_fullsized":"2024-09-21T00:15:16.854744+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:12.783917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T00:15:16.866375+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:15:16.866375+0000","last_peered":"2024-09-21T00:15:16.866375+0000","last_clean":"2024-09-21T00:15:16.866375+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:15:16.866375+0000","last_undegraded":"2024-09-21T00:15:16.866375+0000","last_fullsized":"2024-09-21T00:15:16.866375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":475136,"data_stored":194497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":192851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":194955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1052672,"data_stored":783151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":192853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1064960,"data_stored":790403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:15:26.285 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:15:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.514+0000 7fbd71000640 1 -- 172.21.15.83:0/1653914872 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6c0d0b00 msgr2=0x7fbd6c145040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.514+0000 7fbd71000640 1 --2- 172.21.15.83:0/1653914872 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6c0d0b00 0x7fbd6c145040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c071f70 tx=0x7fbd5c02a5f0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.514+0000 7fbd71000640 1 -- 172.21.15.83:0/1653914872 shutdown_connections 2024-09-21T00:15:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.514+0000 7fbd71000640 1 --2- 172.21.15.83:0/1653914872 >> v2:172.21.15.142:3300/0 conn(0x7fbd6c071870 0x7fbd6c0cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.514+0000 7fbd71000640 1 --2- 172.21.15.83:0/1653914872 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6c0d0b00 0x7fbd6c145040 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.514+0000 7fbd71000640 1 -- 172.21.15.83:0/1653914872 >> 172.21.15.83:0/1653914872 conn(0x7fbd6c0d1020 msgr2=0x7fbd6c0d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.514+0000 7fbd71000640 1 -- 172.21.15.83:0/1653914872 shutdown_connections 2024-09-21T00:15:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.514+0000 7fbd71000640 1 -- 172.21.15.83:0/1653914872 wait complete. 2024-09-21T00:15:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.516+0000 7fbd71000640 1 Processor -- start 2024-09-21T00:15:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.516+0000 7fbd71000640 1 -- start start 2024-09-21T00:15:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd71000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6c0d0b00 0x7fbd6c13e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd71000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c160990 0x7fbd6c13e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd71000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd6c1f84f0 0x7fbd6c1f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd71000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c0cdd80 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd71000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c072240 con 0x7fbd6c1f84f0 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd71000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6c0cdf00 con 0x7fbd6c160990 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd6b400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6c0d0b00 0x7fbd6c13e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd6b400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6c0d0b00 0x7fbd6c13e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43272/0 (socket says 172.21.15.83:43272) 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd6b400640 1 -- 172.21.15.83:0/348413400 learned_addr learned my addr 172.21.15.83:0/348413400 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd6b400640 1 -- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c160990 msgr2=0x7fbd6c13e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd6b400640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c160990 0x7fbd6c13e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd6b400640 1 -- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd6c1f84f0 msgr2=0x7fbd6c1f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd6b400640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd6c1f84f0 0x7fbd6c1f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd6b400640 1 -- 172.21.15.83:0/348413400 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c1f8e40 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd6b400640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6c0d0b00 0x7fbd6c13e400 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c034040 tx=0x7fbd5c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd63e00640 1 -- 172.21.15.83:0/348413400 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c03e030 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd63e00640 1 -- 172.21.15.83:0/348413400 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd5c0047a0 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd71000640 1 -- 172.21.15.83:0/348413400 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6c0b40f0 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd63e00640 1 -- 172.21.15.83:0/348413400 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c035040 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.519+0000 7fbd71000640 1 -- 172.21.15.83:0/348413400 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6c13f430 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.520+0000 7fbd71000640 1 -- 172.21.15.83:0/348413400 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6c0b44f0 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.521+0000 7fbd63e00640 1 -- 172.21.15.83:0/348413400 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd5c041030 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.522+0000 7fbd63e00640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbd48078b90 0x7fbd4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:26.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.523+0000 7fbd63e00640 1 -- 172.21.15.83:0/348413400 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fbd5c0bb760 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.523+0000 7fbd62a00640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbd48078b90 0x7fbd4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:26.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.524+0000 7fbd62a00640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbd48078b90 0x7fbd4807b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbd54000f60 tx=0x7fbd540079d0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:26.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.527+0000 7fbd63e00640 1 -- 172.21.15.83:0/348413400 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbd6c1f8e40 con 0x7fbd6c0d0b00 2024-09-21T00:15:26.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.709+0000 7fbd71000640 1 -- 172.21.15.83:0/348413400 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd6c0ce3c0 con 0x7fbd48078b90 2024-09-21T00:15:26.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.714+0000 7fbd63e00640 1 -- 172.21.15.83:0/348413400 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251922 (secure 0 0 0) 0x7fbd6c0ce3c0 con 0x7fbd48078b90 2024-09-21T00:15:26.719 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:26.720 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:15:26.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 -- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbd48078b90 msgr2=0x7fbd4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:26.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbd48078b90 0x7fbd4807b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbd54000f60 tx=0x7fbd540079d0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 -- 172.21.15.83:0/348413400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6c0d0b00 msgr2=0x7fbd6c13e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:26.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6c0d0b00 0x7fbd6c13e400 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c034040 tx=0x7fbd5c0039e0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 -- 172.21.15.83:0/348413400 shutdown_connections 2024-09-21T00:15:26.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbd48078b90 0x7fbd4807b0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd6c1f84f0 0x7fbd6c1f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd6c160990 0x7fbd6c13e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 --2- 172.21.15.83:0/348413400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6c0d0b00 0x7fbd6c13e400 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:26.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 -- 172.21.15.83:0/348413400 >> 172.21.15.83:0/348413400 conn(0x7fbd6c0d1020 msgr2=0x7fbd6c0b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:26.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 -- 172.21.15.83:0/348413400 shutdown_connections 2024-09-21T00:15:26.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:26.719+0000 7fbd71000640 1 -- 172.21.15.83:0/348413400 wait complete. 2024-09-21T00:15:26.742 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-09-21T00:15:24.870308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221104,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753616,"statfs":{"total":773094113280,"available":772867702784,"internally_reserved":0,"allocated":4988928,"data_stored":2781180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.021005"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080247+0000","last_change":"2024-09-21T00:15:16.887689+0000","last_active":"2024-09-21T00:15:18.080247+0000","last_peered":"2024-09-21T00:15:18.080247+0000","last_clean":"2024-09-21T00:15:18.080247+0000","last_became_active":"2024-09-21T00:15:16.886688+0000","last_became_peered":"2024-09-21T00:15:16.886688+0000","last_unstale":"2024-09-21T00:15:18.080247+0000","last_undegraded":"2024-09-21T00:15:18.080247+0000","last_fullsized":"2024-09-21T00:15:18.080247+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:49.906627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080304+0000","last_change":"2024-09-21T00:15:16.885091+0000","last_active":"2024-09-21T00:15:18.080304+0000","last_peered":"2024-09-21T00:15:18.080304+0000","last_clean":"2024-09-21T00:15:18.080304+0000","last_became_active":"2024-09-21T00:15:16.878833+0000","last_became_peered":"2024-09-21T00:15:16.878833+0000","last_unstale":"2024-09-21T00:15:18.080304+0000","last_undegraded":"2024-09-21T00:15:18.080304+0000","last_fullsized":"2024-09-21T00:15:18.080304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:48.380387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078756+0000","last_change":"2024-09-21T00:15:16.866321+0000","last_active":"2024-09-21T00:15:18.078756+0000","last_peered":"2024-09-21T00:15:18.078756+0000","last_clean":"2024-09-21T00:15:18.078756+0000","last_became_active":"2024-09-21T00:15:16.865947+0000","last_became_peered":"2024-09-21T00:15:16.865947+0000","last_unstale":"2024-09-21T00:15:18.078756+0000","last_undegraded":"2024-09-21T00:15:18.078756+0000","last_fullsized":"2024-09-21T00:15:18.078756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:51.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079280+0000","last_change":"2024-09-21T00:15:16.862740+0000","last_active":"2024-09-21T00:15:18.079280+0000","last_peered":"2024-09-21T00:15:18.079280+0000","last_clean":"2024-09-21T00:15:18.079280+0000","last_became_active":"2024-09-21T00:15:16.861357+0000","last_became_peered":"2024-09-21T00:15:16.861357+0000","last_unstale":"2024-09-21T00:15:18.079280+0000","last_undegraded":"2024-09-21T00:15:18.079280+0000","last_fullsized":"2024-09-21T00:15:18.079280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:31.908096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868472+0000","last_change":"2024-09-21T00:15:16.882024+0000","last_active":"2024-09-21T00:15:17.868472+0000","last_peered":"2024-09-21T00:15:17.868472+0000","last_clean":"2024-09-21T00:15:17.868472+0000","last_became_active":"2024-09-21T00:15:16.878211+0000","last_became_peered":"2024-09-21T00:15:16.878211+0000","last_unstale":"2024-09-21T00:15:17.868472+0000","last_undegraded":"2024-09-21T00:15:17.868472+0000","last_fullsized":"2024-09-21T00:15:17.868472+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:48.635778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079964+0000","last_change":"2024-09-21T00:15:16.881989+0000","last_active":"2024-09-21T00:15:18.079964+0000","last_peered":"2024-09-21T00:15:18.079964+0000","last_clean":"2024-09-21T00:15:18.079964+0000","last_became_active":"2024-09-21T00:15:16.881672+0000","last_became_peered":"2024-09-21T00:15:16.881672+0000","last_unstale":"2024-09-21T00:15:18.079964+0000","last_undegraded":"2024-09-21T00:15:18.079964+0000","last_fullsized":"2024-09-21T00:15:18.079964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:13.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078800+0000","last_change":"2024-09-21T00:15:16.886616+0000","last_active":"2024-09-21T00:15:18.078800+0000","last_peered":"2024-09-21T00:15:18.078800+0000","last_clean":"2024-09-21T00:15:18.078800+0000","last_became_active":"2024-09-21T00:15:16.886275+0000","last_became_peered":"2024-09-21T00:15:16.886275+0000","last_unstale":"2024-09-21T00:15:18.078800+0000","last_undegraded":"2024-09-21T00:15:18.078800+0000","last_fullsized":"2024-09-21T00:15:18.078800+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:23.130632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080511+0000","last_change":"2024-09-21T00:15:16.882497+0000","last_active":"2024-09-21T00:15:18.080511+0000","last_peered":"2024-09-21T00:15:18.080511+0000","last_clean":"2024-09-21T00:15:18.080511+0000","last_became_active":"2024-09-21T00:15:16.881675+0000","last_became_peered":"2024-09-21T00:15:16.881675+0000","last_unstale":"2024-09-21T00:15:18.080511+0000","last_undegraded":"2024-09-21T00:15:18.080511+0000","last_fullsized":"2024-09-21T00:15:18.080511+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:54.784118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868290+0000","last_change":"2024-09-21T00:15:16.869075+0000","last_active":"2024-09-21T00:15:17.868290+0000","last_peered":"2024-09-21T00:15:17.868290+0000","last_clean":"2024-09-21T00:15:17.868290+0000","last_became_active":"2024-09-21T00:15:16.868688+0000","last_became_peered":"2024-09-21T00:15:16.868688+0000","last_unstale":"2024-09-21T00:15:17.868290+0000","last_undegraded":"2024-09-21T00:15:17.868290+0000","last_fullsized":"2024-09-21T00:15:17.868290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:09.707961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079809+0000","last_change":"2024-09-21T00:15:16.877674+0000","last_active":"2024-09-21T00:15:18.079809+0000","last_peered":"2024-09-21T00:15:18.079809+0000","last_clean":"2024-09-21T00:15:18.079809+0000","last_became_active":"2024-09-21T00:15:16.877348+0000","last_became_peered":"2024-09-21T00:15:16.877348+0000","last_unstale":"2024-09-21T00:15:18.079809+0000","last_undegraded":"2024-09-21T00:15:18.079809+0000","last_fullsized":"2024-09-21T00:15:18.079809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:29.493781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080562+0000","last_change":"2024-09-21T00:15:16.875449+0000","last_active":"2024-09-21T00:15:18.080562+0000","last_peered":"2024-09-21T00:15:18.080562+0000","last_clean":"2024-09-21T00:15:18.080562+0000","last_became_active":"2024-09-21T00:15:16.874660+0000","last_became_peered":"2024-09-21T00:15:16.874660+0000","last_unstale":"2024-09-21T00:15:18.080562+0000","last_undegraded":"2024-09-21T00:15:18.080562+0000","last_fullsized":"2024-09-21T00:15:18.080562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:10.585312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868752+0000","last_change":"2024-09-21T00:15:16.880104+0000","last_active":"2024-09-21T00:15:17.868752+0000","last_peered":"2024-09-21T00:15:17.868752+0000","last_clean":"2024-09-21T00:15:17.868752+0000","last_became_active":"2024-09-21T00:15:16.877255+0000","last_became_peered":"2024-09-21T00:15:16.877255+0000","last_unstale":"2024-09-21T00:15:17.868752+0000","last_undegraded":"2024-09-21T00:15:17.868752+0000","last_fullsized":"2024-09-21T00:15:17.868752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:59.633259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079198+0000","last_change":"2024-09-21T00:15:16.886033+0000","last_active":"2024-09-21T00:15:18.079198+0000","last_peered":"2024-09-21T00:15:18.079198+0000","last_clean":"2024-09-21T00:15:18.079198+0000","last_became_active":"2024-09-21T00:15:16.885733+0000","last_became_peered":"2024-09-21T00:15:16.885733+0000","last_unstale":"2024-09-21T00:15:18.079198+0000","last_undegraded":"2024-09-21T00:15:18.079198+0000","last_fullsized":"2024-09-21T00:15:18.079198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:09.707961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078374+0000","last_change":"2024-09-21T00:15:16.867951+0000","last_active":"2024-09-21T00:15:18.078374+0000","last_peered":"2024-09-21T00:15:18.078374+0000","last_clean":"2024-09-21T00:15:18.078374+0000","last_became_active":"2024-09-21T00:15:16.867657+0000","last_became_peered":"2024-09-21T00:15:16.867657+0000","last_unstale":"2024-09-21T00:15:18.078374+0000","last_undegraded":"2024-09-21T00:15:18.078374+0000","last_fullsized":"2024-09-21T00:15:18.078374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:48.052839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865646+0000","last_change":"2024-09-21T00:15:16.878574+0000","last_active":"2024-09-21T00:15:17.865646+0000","last_peered":"2024-09-21T00:15:17.865646+0000","last_clean":"2024-09-21T00:15:17.865646+0000","last_became_active":"2024-09-21T00:15:16.878228+0000","last_became_peered":"2024-09-21T00:15:16.878228+0000","last_unstale":"2024-09-21T00:15:17.865646+0000","last_undegraded":"2024-09-21T00:15:17.865646+0000","last_fullsized":"2024-09-21T00:15:17.865646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:33.038941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078695+0000","last_change":"2024-09-21T00:15:16.868688+0000","last_active":"2024-09-21T00:15:18.078695+0000","last_peered":"2024-09-21T00:15:18.078695+0000","last_clean":"2024-09-21T00:15:18.078695+0000","last_became_active":"2024-09-21T00:15:16.868393+0000","last_became_peered":"2024-09-21T00:15:16.868393+0000","last_unstale":"2024-09-21T00:15:18.078695+0000","last_undegraded":"2024-09-21T00:15:18.078695+0000","last_fullsized":"2024-09-21T00:15:18.078695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:17.822778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866592+0000","last_change":"2024-09-21T00:15:16.872582+0000","last_active":"2024-09-21T00:15:17.866592+0000","last_peered":"2024-09-21T00:15:17.866592+0000","last_clean":"2024-09-21T00:15:17.866592+0000","last_became_active":"2024-09-21T00:15:16.872290+0000","last_became_peered":"2024-09-21T00:15:16.872290+0000","last_unstale":"2024-09-21T00:15:17.866592+0000","last_undegraded":"2024-09-21T00:15:17.866592+0000","last_fullsized":"2024-09-21T00:15:17.866592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:27.588288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866182+0000","last_change":"2024-09-21T00:15:16.869555+0000","last_active":"2024-09-21T00:15:17.866182+0000","last_peered":"2024-09-21T00:15:17.866182+0000","last_clean":"2024-09-21T00:15:17.866182+0000","last_became_active":"2024-09-21T00:15:16.869251+0000","last_became_peered":"2024-09-21T00:15:16.869251+0000","last_unstale":"2024-09-21T00:15:17.866182+0000","last_undegraded":"2024-09-21T00:15:17.866182+0000","last_fullsized":"2024-09-21T00:15:17.866182+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:27.130026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868026+0000","last_change":"2024-09-21T00:15:16.894998+0000","last_active":"2024-09-21T00:15:17.868026+0000","last_peered":"2024-09-21T00:15:17.868026+0000","last_clean":"2024-09-21T00:15:17.868026+0000","last_became_active":"2024-09-21T00:15:16.894688+0000","last_became_peered":"2024-09-21T00:15:16.894688+0000","last_unstale":"2024-09-21T00:15:17.868026+0000","last_undegraded":"2024-09-21T00:15:17.868026+0000","last_fullsized":"2024-09-21T00:15:17.868026+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:06.849923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080333+0000","last_change":"2024-09-21T00:15:16.864289+0000","last_active":"2024-09-21T00:15:18.080333+0000","last_peered":"2024-09-21T00:15:18.080333+0000","last_clean":"2024-09-21T00:15:18.080333+0000","last_became_active":"2024-09-21T00:15:16.862950+0000","last_became_peered":"2024-09-21T00:15:16.862950+0000","last_unstale":"2024-09-21T00:15:18.080333+0000","last_undegraded":"2024-09-21T00:15:18.080333+0000","last_fullsized":"2024-09-21T00:15:18.080333+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.632208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080070+0000","last_change":"2024-09-21T00:15:16.865247+0000","last_active":"2024-09-21T00:15:18.080070+0000","last_peered":"2024-09-21T00:15:18.080070+0000","last_clean":"2024-09-21T00:15:18.080070+0000","last_became_active":"2024-09-21T00:15:16.864945+0000","last_became_peered":"2024-09-21T00:15:16.864945+0000","last_unstale":"2024-09-21T00:15:18.080070+0000","last_undegraded":"2024-09-21T00:15:18.080070+0000","last_fullsized":"2024-09-21T00:15:18.080070+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:58.071856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079850+0000","last_change":"2024-09-21T00:15:16.880182+0000","last_active":"2024-09-21T00:15:18.079850+0000","last_peered":"2024-09-21T00:15:18.079850+0000","last_clean":"2024-09-21T00:15:18.079850+0000","last_became_active":"2024-09-21T00:15:16.874473+0000","last_became_peered":"2024-09-21T00:15:16.874473+0000","last_unstale":"2024-09-21T00:15:18.079850+0000","last_undegraded":"2024-09-21T00:15:18.079850+0000","last_fullsized":"2024-09-21T00:15:18.079850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:13.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865743+0000","last_change":"2024-09-21T00:15:16.885945+0000","last_active":"2024-09-21T00:15:17.865743+0000","last_peered":"2024-09-21T00:15:17.865743+0000","last_clean":"2024-09-21T00:15:17.865743+0000","last_became_active":"2024-09-21T00:15:16.885606+0000","last_became_peered":"2024-09-21T00:15:16.885606+0000","last_unstale":"2024-09-21T00:15:17.865743+0000","last_undegraded":"2024-09-21T00:15:17.865743+0000","last_fullsized":"2024-09-21T00:15:17.865743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:14.873933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078730+0000","last_change":"2024-09-21T00:15:16.876420+0000","last_active":"2024-09-21T00:15:18.078730+0000","last_peered":"2024-09-21T00:15:18.078730+0000","last_clean":"2024-09-21T00:15:18.078730+0000","last_became_active":"2024-09-21T00:15:16.876184+0000","last_became_peered":"2024-09-21T00:15:16.876184+0000","last_unstale":"2024-09-21T00:15:18.078730+0000","last_undegraded":"2024-09-21T00:15:18.078730+0000","last_fullsized":"2024-09-21T00:15:18.078730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:03.084045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078378+0000","last_change":"2024-09-21T00:15:16.875257+0000","last_active":"2024-09-21T00:15:18.078378+0000","last_peered":"2024-09-21T00:15:18.078378+0000","last_clean":"2024-09-21T00:15:18.078378+0000","last_became_active":"2024-09-21T00:15:16.874968+0000","last_became_peered":"2024-09-21T00:15:16.874968+0000","last_unstale":"2024-09-21T00:15:18.078378+0000","last_undegraded":"2024-09-21T00:15:18.078378+0000","last_fullsized":"2024-09-21T00:15:18.078378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:15.743262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078737+0000","last_change":"2024-09-21T00:15:16.869118+0000","last_active":"2024-09-21T00:15:18.078737+0000","last_peered":"2024-09-21T00:15:18.078737+0000","last_clean":"2024-09-21T00:15:18.078737+0000","last_became_active":"2024-09-21T00:15:16.868763+0000","last_became_peered":"2024-09-21T00:15:16.868763+0000","last_unstale":"2024-09-21T00:15:18.078737+0000","last_undegraded":"2024-09-21T00:15:18.078737+0000","last_fullsized":"2024-09-21T00:15:18.078737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:00.253961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080609+0000","last_change":"2024-09-21T00:15:16.883500+0000","last_active":"2024-09-21T00:15:18.080609+0000","last_peered":"2024-09-21T00:15:18.080609+0000","last_clean":"2024-09-21T00:15:18.080609+0000","last_became_active":"2024-09-21T00:15:16.883162+0000","last_became_peered":"2024-09-21T00:15:16.883162+0000","last_unstale":"2024-09-21T00:15:18.080609+0000","last_undegraded":"2024-09-21T00:15:18.080609+0000","last_fullsized":"2024-09-21T00:15:18.080609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.498683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079569+0000","last_change":"2024-09-21T00:15:16.890105+0000","last_active":"2024-09-21T00:15:18.079569+0000","last_peered":"2024-09-21T00:15:18.079569+0000","last_clean":"2024-09-21T00:15:18.079569+0000","last_became_active":"2024-09-21T00:15:16.889782+0000","last_became_peered":"2024-09-21T00:15:16.889782+0000","last_unstale":"2024-09-21T00:15:18.079569+0000","last_undegraded":"2024-09-21T00:15:18.079569+0000","last_fullsized":"2024-09-21T00:15:18.079569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:13.786819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866430+0000","last_change":"2024-09-21T00:15:16.883797+0000","last_active":"2024-09-21T00:15:17.866430+0000","last_peered":"2024-09-21T00:15:17.866430+0000","last_clean":"2024-09-21T00:15:17.866430+0000","last_became_active":"2024-09-21T00:15:16.882778+0000","last_became_peered":"2024-09-21T00:15:16.882778+0000","last_unstale":"2024-09-21T00:15:17.866430+0000","last_undegraded":"2024-09-21T00:15:17.866430+0000","last_fullsized":"2024-09-21T00:15:17.866430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:31.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865866+0000","last_change":"2024-09-21T00:15:16.881676+0000","last_active":"2024-09-21T00:15:17.865866+0000","last_peered":"2024-09-21T00:15:17.865866+0000","last_clean":"2024-09-21T00:15:17.865866+0000","last_became_active":"2024-09-21T00:15:16.881381+0000","last_became_peered":"2024-09-21T00:15:16.881381+0000","last_unstale":"2024-09-21T00:15:17.865866+0000","last_undegraded":"2024-09-21T00:15:17.865866+0000","last_fullsized":"2024-09-21T00:15:17.865866+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:29.864436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079313+0000","last_change":"2024-09-21T00:15:16.880582+0000","last_active":"2024-09-21T00:15:18.079313+0000","last_peered":"2024-09-21T00:15:18.079313+0000","last_clean":"2024-09-21T00:15:18.079313+0000","last_became_active":"2024-09-21T00:15:16.880298+0000","last_became_peered":"2024-09-21T00:15:16.880298+0000","last_unstale":"2024-09-21T00:15:18.079313+0000","last_undegraded":"2024-09-21T00:15:18.079313+0000","last_fullsized":"2024-09-21T00:15:18.079313+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:39.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080027+0000","last_change":"2024-09-21T00:15:16.881999+0000","last_active":"2024-09-21T00:15:18.080027+0000","last_peered":"2024-09-21T00:15:18.080027+0000","last_clean":"2024-09-21T00:15:18.080027+0000","last_became_active":"2024-09-21T00:15:16.881229+0000","last_became_peered":"2024-09-21T00:15:16.881229+0000","last_unstale":"2024-09-21T00:15:18.080027+0000","last_undegraded":"2024-09-21T00:15:18.080027+0000","last_fullsized":"2024-09-21T00:15:18.080027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:03.422152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866047+0000","last_change":"2024-09-21T00:15:16.867828+0000","last_active":"2024-09-21T00:15:17.866047+0000","last_peered":"2024-09-21T00:15:17.866047+0000","last_clean":"2024-09-21T00:15:17.866047+0000","last_became_active":"2024-09-21T00:15:16.867248+0000","last_became_peered":"2024-09-21T00:15:16.867248+0000","last_unstale":"2024-09-21T00:15:17.866047+0000","last_undegraded":"2024-09-21T00:15:17.866047+0000","last_fullsized":"2024-09-21T00:15:17.866047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:17.120417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078417+0000","last_change":"2024-09-21T00:15:15.871147+0000","last_active":"2024-09-21T00:15:18.078417+0000","last_peered":"2024-09-21T00:15:18.078417+0000","last_clean":"2024-09-21T00:15:18.078417+0000","last_became_active":"2024-09-21T00:15:15.870802+0000","last_became_peered":"2024-09-21T00:15:15.870802+0000","last_unstale":"2024-09-21T00:15:18.078417+0000","last_undegraded":"2024-09-21T00:15:18.078417+0000","last_fullsized":"2024-09-21T00:15:18.078417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:38.278690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079665+0000","last_change":"2024-09-21T00:15:16.883776+0000","last_active":"2024-09-21T00:15:18.079665+0000","last_peered":"2024-09-21T00:15:18.079665+0000","last_clean":"2024-09-21T00:15:18.079665+0000","last_became_active":"2024-09-21T00:15:16.881047+0000","last_became_peered":"2024-09-21T00:15:16.881047+0000","last_unstale":"2024-09-21T00:15:18.079665+0000","last_undegraded":"2024-09-21T00:15:18.079665+0000","last_fullsized":"2024-09-21T00:15:18.079665+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:35.311567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080319+0000","last_change":"2024-09-21T00:15:15.865052+0000","last_active":"2024-09-21T00:15:18.080319+0000","last_peered":"2024-09-21T00:15:18.080319+0000","last_clean":"2024-09-21T00:15:18.080319+0000","last_became_active":"2024-09-21T00:15:15.864719+0000","last_became_peered":"2024-09-21T00:15:15.864719+0000","last_unstale":"2024-09-21T00:15:18.080319+0000","last_undegraded":"2024-09-21T00:15:18.080319+0000","last_fullsized":"2024-09-21T00:15:18.080319+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:03.742657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866396+0000","last_change":"2024-09-21T00:15:16.875044+0000","last_active":"2024-09-21T00:15:17.866396+0000","last_peered":"2024-09-21T00:15:17.866396+0000","last_clean":"2024-09-21T00:15:17.866396+0000","last_became_active":"2024-09-21T00:15:16.869954+0000","last_became_peered":"2024-09-21T00:15:16.869954+0000","last_unstale":"2024-09-21T00:15:17.866396+0000","last_undegraded":"2024-09-21T00:15:17.866396+0000","last_fullsized":"2024-09-21T00:15:17.866396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:48.086484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079966+0000","last_change":"2024-09-21T00:15:15.869470+0000","last_active":"2024-09-21T00:15:18.079966+0000","last_peered":"2024-09-21T00:15:18.079966+0000","last_clean":"2024-09-21T00:15:18.079966+0000","last_became_active":"2024-09-21T00:15:15.869161+0000","last_became_peered":"2024-09-21T00:15:15.869161+0000","last_unstale":"2024-09-21T00:15:18.079966+0000","last_undegraded":"2024-09-21T00:15:18.079966+0000","last_fullsized":"2024-09-21T00:15:18.079966+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:11.623197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079960+0000","last_change":"2024-09-21T00:15:16.874950+0000","last_active":"2024-09-21T00:15:18.079960+0000","last_peered":"2024-09-21T00:15:18.079960+0000","last_clean":"2024-09-21T00:15:18.079960+0000","last_became_active":"2024-09-21T00:15:16.874649+0000","last_became_peered":"2024-09-21T00:15:16.874649+0000","last_unstale":"2024-09-21T00:15:18.079960+0000","last_undegraded":"2024-09-21T00:15:18.079960+0000","last_fullsized":"2024-09-21T00:15:18.079960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:27.109593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078643+0000","last_change":"2024-09-21T00:15:15.876080+0000","last_active":"2024-09-21T00:15:18.078643+0000","last_peered":"2024-09-21T00:15:18.078643+0000","last_clean":"2024-09-21T00:15:18.078643+0000","last_became_active":"2024-09-21T00:15:15.875776+0000","last_became_peered":"2024-09-21T00:15:15.875776+0000","last_unstale":"2024-09-21T00:15:18.078643+0000","last_undegraded":"2024-09-21T00:15:18.078643+0000","last_fullsized":"2024-09-21T00:15:18.078643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:08.705060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080303+0000","last_change":"2024-09-21T00:15:16.890109+0000","last_active":"2024-09-21T00:15:18.080303+0000","last_peered":"2024-09-21T00:15:18.080303+0000","last_clean":"2024-09-21T00:15:18.080303+0000","last_became_active":"2024-09-21T00:15:16.889670+0000","last_became_peered":"2024-09-21T00:15:16.889670+0000","last_unstale":"2024-09-21T00:15:18.080303+0000","last_undegraded":"2024-09-21T00:15:18.080303+0000","last_fullsized":"2024-09-21T00:15:18.080303+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:41.544609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078386+0000","last_change":"2024-09-21T00:15:15.863814+0000","last_active":"2024-09-21T00:15:18.078386+0000","last_peered":"2024-09-21T00:15:18.078386+0000","last_clean":"2024-09-21T00:15:18.078386+0000","last_became_active":"2024-09-21T00:15:15.862421+0000","last_became_peered":"2024-09-21T00:15:15.862421+0000","last_unstale":"2024-09-21T00:15:18.078386+0000","last_undegraded":"2024-09-21T00:15:18.078386+0000","last_fullsized":"2024-09-21T00:15:18.078386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:47.632876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079532+0000","last_change":"2024-09-21T00:15:16.885001+0000","last_active":"2024-09-21T00:15:18.079532+0000","last_peered":"2024-09-21T00:15:18.079532+0000","last_clean":"2024-09-21T00:15:18.079532+0000","last_became_active":"2024-09-21T00:15:16.884672+0000","last_became_peered":"2024-09-21T00:15:16.884672+0000","last_unstale":"2024-09-21T00:15:18.079532+0000","last_undegraded":"2024-09-21T00:15:18.079532+0000","last_fullsized":"2024-09-21T00:15:18.079532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:23:49.873761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079157+0000","last_change":"2024-09-21T00:15:15.868966+0000","last_active":"2024-09-21T00:15:18.079157+0000","last_peered":"2024-09-21T00:15:18.079157+0000","last_clean":"2024-09-21T00:15:18.079157+0000","last_became_active":"2024-09-21T00:15:15.868667+0000","last_became_peered":"2024-09-21T00:15:15.868667+0000","last_unstale":"2024-09-21T00:15:18.079157+0000","last_undegraded":"2024-09-21T00:15:18.079157+0000","last_fullsized":"2024-09-21T00:15:18.079157+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:08:22.105332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866062+0000","last_change":"2024-09-21T00:15:16.863866+0000","last_active":"2024-09-21T00:15:17.866062+0000","last_peered":"2024-09-21T00:15:17.866062+0000","last_clean":"2024-09-21T00:15:17.866062+0000","last_became_active":"2024-09-21T00:15:16.862688+0000","last_became_peered":"2024-09-21T00:15:16.862688+0000","last_unstale":"2024-09-21T00:15:17.866062+0000","last_undegraded":"2024-09-21T00:15:17.866062+0000","last_fullsized":"2024-09-21T00:15:17.866062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:52.562904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078618+0000","last_change":"2024-09-21T00:15:15.874143+0000","last_active":"2024-09-21T00:15:18.078618+0000","last_peered":"2024-09-21T00:15:18.078618+0000","last_clean":"2024-09-21T00:15:18.078618+0000","last_became_active":"2024-09-21T00:15:15.871902+0000","last_became_peered":"2024-09-21T00:15:15.871902+0000","last_unstale":"2024-09-21T00:15:18.078618+0000","last_undegraded":"2024-09-21T00:15:18.078618+0000","last_fullsized":"2024-09-21T00:15:18.078618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:24.299541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079313+0000","last_change":"2024-09-21T00:15:16.876073+0000","last_active":"2024-09-21T00:15:18.079313+0000","last_peered":"2024-09-21T00:15:18.079313+0000","last_clean":"2024-09-21T00:15:18.079313+0000","last_became_active":"2024-09-21T00:15:16.875374+0000","last_became_peered":"2024-09-21T00:15:16.875374+0000","last_unstale":"2024-09-21T00:15:18.079313+0000","last_undegraded":"2024-09-21T00:15:18.079313+0000","last_fullsized":"2024-09-21T00:15:18.079313+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:14.610551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078704+0000","last_change":"2024-09-21T00:15:15.872912+0000","last_active":"2024-09-21T00:15:18.078704+0000","last_peered":"2024-09-21T00:15:18.078704+0000","last_clean":"2024-09-21T00:15:18.078704+0000","last_became_active":"2024-09-21T00:15:15.872553+0000","last_became_peered":"2024-09-21T00:15:15.872553+0000","last_unstale":"2024-09-21T00:15:18.078704+0000","last_undegraded":"2024-09-21T00:15:18.078704+0000","last_fullsized":"2024-09-21T00:15:18.078704+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:36.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079430+0000","last_change":"2024-09-21T00:15:16.864727+0000","last_active":"2024-09-21T00:15:18.079430+0000","last_peered":"2024-09-21T00:15:18.079430+0000","last_clean":"2024-09-21T00:15:18.079430+0000","last_became_active":"2024-09-21T00:15:16.864246+0000","last_became_peered":"2024-09-21T00:15:16.864246+0000","last_unstale":"2024-09-21T00:15:18.079430+0000","last_undegraded":"2024-09-21T00:15:18.079430+0000","last_fullsized":"2024-09-21T00:15:18.079430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:58.807951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080204+0000","last_change":"2024-09-21T00:15:15.871490+0000","last_active":"2024-09-21T00:15:18.080204+0000","last_peered":"2024-09-21T00:15:18.080204+0000","last_clean":"2024-09-21T00:15:18.080204+0000","last_became_active":"2024-09-21T00:15:15.871156+0000","last_became_peered":"2024-09-21T00:15:15.871156+0000","last_unstale":"2024-09-21T00:15:18.080204+0000","last_undegraded":"2024-09-21T00:15:18.080204+0000","last_fullsized":"2024-09-21T00:15:18.080204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:12.350916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078838+0000","last_change":"2024-09-21T00:15:16.876745+0000","last_active":"2024-09-21T00:15:18.078838+0000","last_peered":"2024-09-21T00:15:18.078838+0000","last_clean":"2024-09-21T00:15:18.078838+0000","last_became_active":"2024-09-21T00:15:16.876387+0000","last_became_peered":"2024-09-21T00:15:16.876387+0000","last_unstale":"2024-09-21T00:15:18.078838+0000","last_undegraded":"2024-09-21T00:15:18.078838+0000","last_fullsized":"2024-09-21T00:15:18.078838+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:05.866795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866219+0000","last_change":"2024-09-21T00:15:15.861011+0000","last_active":"2024-09-21T00:15:17.866219+0000","last_peered":"2024-09-21T00:15:17.866219+0000","last_clean":"2024-09-21T00:15:17.866219+0000","last_became_active":"2024-09-21T00:15:15.859747+0000","last_became_peered":"2024-09-21T00:15:15.859747+0000","last_unstale":"2024-09-21T00:15:17.866219+0000","last_undegraded":"2024-09-21T00:15:17.866219+0000","last_fullsized":"2024-09-21T00:15:17.866219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:11.431973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079067+0000","last_change":"2024-09-21T00:15:16.871360+0000","last_active":"2024-09-21T00:15:18.079067+0000","last_peered":"2024-09-21T00:15:18.079067+0000","last_clean":"2024-09-21T00:15:18.079067+0000","last_became_active":"2024-09-21T00:15:16.871013+0000","last_became_peered":"2024-09-21T00:15:16.871013+0000","last_unstale":"2024-09-21T00:15:18.079067+0000","last_undegraded":"2024-09-21T00:15:18.079067+0000","last_fullsized":"2024-09-21T00:15:18.079067+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:01.856230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866222+0000","last_change":"2024-09-21T00:15:15.865177+0000","last_active":"2024-09-21T00:15:17.866222+0000","last_peered":"2024-09-21T00:15:17.866222+0000","last_clean":"2024-09-21T00:15:17.866222+0000","last_became_active":"2024-09-21T00:15:15.864924+0000","last_became_peered":"2024-09-21T00:15:15.864924+0000","last_unstale":"2024-09-21T00:15:17.866222+0000","last_undegraded":"2024-09-21T00:15:17.866222+0000","last_fullsized":"2024-09-21T00:15:17.866222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:04:53.011253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079194+0000","last_change":"2024-09-21T00:15:16.886616+0000","last_active":"2024-09-21T00:15:18.079194+0000","last_peered":"2024-09-21T00:15:18.079194+0000","last_clean":"2024-09-21T00:15:18.079194+0000","last_became_active":"2024-09-21T00:15:16.886309+0000","last_became_peered":"2024-09-21T00:15:16.886309+0000","last_unstale":"2024-09-21T00:15:18.079194+0000","last_undegraded":"2024-09-21T00:15:18.079194+0000","last_fullsized":"2024-09-21T00:15:18.079194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:48.635778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079533+0000","last_change":"2024-09-21T00:15:15.872932+0000","last_active":"2024-09-21T00:15:18.079533+0000","last_peered":"2024-09-21T00:15:18.079533+0000","last_clean":"2024-09-21T00:15:18.079533+0000","last_became_active":"2024-09-21T00:15:15.872625+0000","last_became_peered":"2024-09-21T00:15:15.872625+0000","last_unstale":"2024-09-21T00:15:18.079533+0000","last_undegraded":"2024-09-21T00:15:18.079533+0000","last_fullsized":"2024-09-21T00:15:18.079533+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:02.678699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080540+0000","last_change":"2024-09-21T00:15:16.869519+0000","last_active":"2024-09-21T00:15:18.080540+0000","last_peered":"2024-09-21T00:15:18.080540+0000","last_clean":"2024-09-21T00:15:18.080540+0000","last_became_active":"2024-09-21T00:15:16.868514+0000","last_became_peered":"2024-09-21T00:15:16.868514+0000","last_unstale":"2024-09-21T00:15:18.080540+0000","last_undegraded":"2024-09-21T00:15:18.080540+0000","last_fullsized":"2024-09-21T00:15:18.080540+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:58.955911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078958+0000","last_change":"2024-09-21T00:15:15.864869+0000","last_active":"2024-09-21T00:15:18.078958+0000","last_peered":"2024-09-21T00:15:18.078958+0000","last_clean":"2024-09-21T00:15:18.078958+0000","last_became_active":"2024-09-21T00:15:15.863402+0000","last_became_peered":"2024-09-21T00:15:15.863402+0000","last_unstale":"2024-09-21T00:15:18.078958+0000","last_undegraded":"2024-09-21T00:15:18.078958+0000","last_fullsized":"2024-09-21T00:15:18.078958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:15.543176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079274+0000","last_change":"2024-09-21T00:15:16.889929+0000","last_active":"2024-09-21T00:15:18.079274+0000","last_peered":"2024-09-21T00:15:18.079274+0000","last_clean":"2024-09-21T00:15:18.079274+0000","last_became_active":"2024-09-21T00:15:16.889592+0000","last_became_peered":"2024-09-21T00:15:16.889592+0000","last_unstale":"2024-09-21T00:15:18.079274+0000","last_undegraded":"2024-09-21T00:15:18.079274+0000","last_fullsized":"2024-09-21T00:15:18.079274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:20.234935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079388+0000","last_change":"2024-09-21T00:15:15.856402+0000","last_active":"2024-09-21T00:15:18.079388+0000","last_peered":"2024-09-21T00:15:18.079388+0000","last_clean":"2024-09-21T00:15:18.079388+0000","last_became_active":"2024-09-21T00:15:15.856065+0000","last_became_peered":"2024-09-21T00:15:15.856065+0000","last_unstale":"2024-09-21T00:15:18.079388+0000","last_undegraded":"2024-09-21T00:15:18.079388+0000","last_fullsized":"2024-09-21T00:15:18.079388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:34.468856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080153+0000","last_change":"2024-09-21T00:15:16.880219+0000","last_active":"2024-09-21T00:15:18.080153+0000","last_peered":"2024-09-21T00:15:18.080153+0000","last_clean":"2024-09-21T00:15:18.080153+0000","last_became_active":"2024-09-21T00:15:16.879024+0000","last_became_peered":"2024-09-21T00:15:16.879024+0000","last_unstale":"2024-09-21T00:15:18.080153+0000","last_undegraded":"2024-09-21T00:15:18.080153+0000","last_fullsized":"2024-09-21T00:15:18.080153+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:34.255761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865879+0000","last_change":"2024-09-21T00:15:15.864833+0000","last_active":"2024-09-21T00:15:17.865879+0000","last_peered":"2024-09-21T00:15:17.865879+0000","last_clean":"2024-09-21T00:15:17.865879+0000","last_became_active":"2024-09-21T00:15:15.864497+0000","last_became_peered":"2024-09-21T00:15:15.864497+0000","last_unstale":"2024-09-21T00:15:17.865879+0000","last_undegraded":"2024-09-21T00:15:17.865879+0000","last_fullsized":"2024-09-21T00:15:17.865879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:49.050645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868649+0000","last_change":"2024-09-21T00:15:16.881508+0000","last_active":"2024-09-21T00:15:17.868649+0000","last_peered":"2024-09-21T00:15:17.868649+0000","last_clean":"2024-09-21T00:15:17.868649+0000","last_became_active":"2024-09-21T00:15:16.877197+0000","last_became_peered":"2024-09-21T00:15:16.877197+0000","last_unstale":"2024-09-21T00:15:17.868649+0000","last_undegraded":"2024-09-21T00:15:17.868649+0000","last_fullsized":"2024-09-21T00:15:17.868649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:39.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078289+0000","last_change":"2024-09-21T00:15:15.866587+0000","last_active":"2024-09-21T00:15:18.078289+0000","last_peered":"2024-09-21T00:15:18.078289+0000","last_clean":"2024-09-21T00:15:18.078289+0000","last_became_active":"2024-09-21T00:15:15.864940+0000","last_became_peered":"2024-09-21T00:15:15.864940+0000","last_unstale":"2024-09-21T00:15:18.078289+0000","last_undegraded":"2024-09-21T00:15:18.078289+0000","last_fullsized":"2024-09-21T00:15:18.078289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:22.127731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079769+0000","last_change":"2024-09-21T00:15:16.892157+0000","last_active":"2024-09-21T00:15:18.079769+0000","last_peered":"2024-09-21T00:15:18.079769+0000","last_clean":"2024-09-21T00:15:18.079769+0000","last_became_active":"2024-09-21T00:15:16.888127+0000","last_became_peered":"2024-09-21T00:15:16.888127+0000","last_unstale":"2024-09-21T00:15:18.079769+0000","last_undegraded":"2024-09-21T00:15:18.079769+0000","last_fullsized":"2024-09-21T00:15:18.079769+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:51:44.952061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079398+0000","last_change":"2024-09-21T00:15:15.873619+0000","last_active":"2024-09-21T00:15:18.079398+0000","last_peered":"2024-09-21T00:15:18.079398+0000","last_clean":"2024-09-21T00:15:18.079398+0000","last_became_active":"2024-09-21T00:15:15.873342+0000","last_became_peered":"2024-09-21T00:15:15.873342+0000","last_unstale":"2024-09-21T00:15:18.079398+0000","last_undegraded":"2024-09-21T00:15:18.079398+0000","last_fullsized":"2024-09-21T00:15:18.079398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:40.599261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079479+0000","last_change":"2024-09-21T00:15:16.894537+0000","last_active":"2024-09-21T00:15:18.079479+0000","last_peered":"2024-09-21T00:15:18.079479+0000","last_clean":"2024-09-21T00:15:18.079479+0000","last_became_active":"2024-09-21T00:15:16.894328+0000","last_became_peered":"2024-09-21T00:15:16.894328+0000","last_unstale":"2024-09-21T00:15:18.079479+0000","last_undegraded":"2024-09-21T00:15:18.079479+0000","last_fullsized":"2024-09-21T00:15:18.079479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:59.633259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866406+0000","last_change":"2024-09-21T00:15:15.869830+0000","last_active":"2024-09-21T00:15:17.866406+0000","last_peered":"2024-09-21T00:15:17.866406+0000","last_clean":"2024-09-21T00:15:17.866406+0000","last_became_active":"2024-09-21T00:15:15.867650+0000","last_became_peered":"2024-09-21T00:15:15.867650+0000","last_unstale":"2024-09-21T00:15:17.866406+0000","last_undegraded":"2024-09-21T00:15:17.866406+0000","last_fullsized":"2024-09-21T00:15:17.866406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:28.691334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079810+0000","last_change":"2024-09-21T00:15:16.887082+0000","last_active":"2024-09-21T00:15:18.079810+0000","last_peered":"2024-09-21T00:15:18.079810+0000","last_clean":"2024-09-21T00:15:18.079810+0000","last_became_active":"2024-09-21T00:15:16.885720+0000","last_became_peered":"2024-09-21T00:15:16.885720+0000","last_unstale":"2024-09-21T00:15:18.079810+0000","last_undegraded":"2024-09-21T00:15:18.079810+0000","last_fullsized":"2024-09-21T00:15:18.079810+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:36.128848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867676+0000","last_change":"2024-09-21T00:15:15.872212+0000","last_active":"2024-09-21T00:15:17.867676+0000","last_peered":"2024-09-21T00:15:17.867676+0000","last_clean":"2024-09-21T00:15:17.867676+0000","last_became_active":"2024-09-21T00:15:15.870779+0000","last_became_peered":"2024-09-21T00:15:15.870779+0000","last_unstale":"2024-09-21T00:15:17.867676+0000","last_undegraded":"2024-09-21T00:15:17.867676+0000","last_fullsized":"2024-09-21T00:15:17.867676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:43.736010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868872+0000","last_change":"2024-09-21T00:15:16.896157+0000","last_active":"2024-09-21T00:15:17.868872+0000","last_peered":"2024-09-21T00:15:17.868872+0000","last_clean":"2024-09-21T00:15:17.868872+0000","last_became_active":"2024-09-21T00:15:16.895860+0000","last_became_peered":"2024-09-21T00:15:16.895860+0000","last_unstale":"2024-09-21T00:15:17.868872+0000","last_undegraded":"2024-09-21T00:15:17.868872+0000","last_fullsized":"2024-09-21T00:15:17.868872+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:17.443616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867799+0000","last_change":"2024-09-21T00:15:15.873944+0000","last_active":"2024-09-21T00:15:17.867799+0000","last_peered":"2024-09-21T00:15:17.867799+0000","last_clean":"2024-09-21T00:15:17.867799+0000","last_became_active":"2024-09-21T00:15:15.873612+0000","last_became_peered":"2024-09-21T00:15:15.873612+0000","last_unstale":"2024-09-21T00:15:17.867799+0000","last_undegraded":"2024-09-21T00:15:17.867799+0000","last_fullsized":"2024-09-21T00:15:17.867799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:59.162788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865655+0000","last_change":"2024-09-21T00:15:16.878490+0000","last_active":"2024-09-21T00:15:17.865655+0000","last_peered":"2024-09-21T00:15:17.865655+0000","last_clean":"2024-09-21T00:15:17.865655+0000","last_became_active":"2024-09-21T00:15:16.878218+0000","last_became_peered":"2024-09-21T00:15:16.878218+0000","last_unstale":"2024-09-21T00:15:17.865655+0000","last_undegraded":"2024-09-21T00:15:17.865655+0000","last_fullsized":"2024-09-21T00:15:17.865655+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:58.804183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867835+0000","last_change":"2024-09-21T00:15:15.869680+0000","last_active":"2024-09-21T00:15:17.867835+0000","last_peered":"2024-09-21T00:15:17.867835+0000","last_clean":"2024-09-21T00:15:17.867835+0000","last_became_active":"2024-09-21T00:15:15.869363+0000","last_became_peered":"2024-09-21T00:15:15.869363+0000","last_unstale":"2024-09-21T00:15:17.867835+0000","last_undegraded":"2024-09-21T00:15:17.867835+0000","last_fullsized":"2024-09-21T00:15:17.867835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:27.516461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080156+0000","last_change":"2024-09-21T00:15:16.881332+0000","last_active":"2024-09-21T00:15:18.080156+0000","last_peered":"2024-09-21T00:15:18.080156+0000","last_clean":"2024-09-21T00:15:18.080156+0000","last_became_active":"2024-09-21T00:15:16.881080+0000","last_became_peered":"2024-09-21T00:15:16.881080+0000","last_unstale":"2024-09-21T00:15:18.080156+0000","last_undegraded":"2024-09-21T00:15:18.080156+0000","last_fullsized":"2024-09-21T00:15:18.080156+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:20.097120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079258+0000","last_change":"2024-09-21T00:15:15.869495+0000","last_active":"2024-09-21T00:15:18.079258+0000","last_peered":"2024-09-21T00:15:18.079258+0000","last_clean":"2024-09-21T00:15:18.079258+0000","last_became_active":"2024-09-21T00:15:15.868711+0000","last_became_peered":"2024-09-21T00:15:15.868711+0000","last_unstale":"2024-09-21T00:15:18.079258+0000","last_undegraded":"2024-09-21T00:15:18.079258+0000","last_fullsized":"2024-09-21T00:15:18.079258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:29.397639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079850+0000","last_change":"2024-09-21T00:15:16.871518+0000","last_active":"2024-09-21T00:15:18.079850+0000","last_peered":"2024-09-21T00:15:18.079850+0000","last_clean":"2024-09-21T00:15:18.079850+0000","last_became_active":"2024-09-21T00:15:16.867533+0000","last_became_peered":"2024-09-21T00:15:16.867533+0000","last_unstale":"2024-09-21T00:15:18.079850+0000","last_undegraded":"2024-09-21T00:15:18.079850+0000","last_fullsized":"2024-09-21T00:15:18.079850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:04.585473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078995+0000","last_change":"2024-09-21T00:15:15.873204+0000","last_active":"2024-09-21T00:15:18.078995+0000","last_peered":"2024-09-21T00:15:18.078995+0000","last_clean":"2024-09-21T00:15:18.078995+0000","last_became_active":"2024-09-21T00:15:15.872545+0000","last_became_peered":"2024-09-21T00:15:15.872545+0000","last_unstale":"2024-09-21T00:15:18.078995+0000","last_undegraded":"2024-09-21T00:15:18.078995+0000","last_fullsized":"2024-09-21T00:15:18.078995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:30.945225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078675+0000","last_change":"2024-09-21T00:15:16.879831+0000","last_active":"2024-09-21T00:15:18.078675+0000","last_peered":"2024-09-21T00:15:18.078675+0000","last_clean":"2024-09-21T00:15:18.078675+0000","last_became_active":"2024-09-21T00:15:16.879538+0000","last_became_peered":"2024-09-21T00:15:16.879538+0000","last_unstale":"2024-09-21T00:15:18.078675+0000","last_undegraded":"2024-09-21T00:15:18.078675+0000","last_fullsized":"2024-09-21T00:15:18.078675+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:06.296292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078407+0000","last_change":"2024-09-21T00:15:15.868499+0000","last_active":"2024-09-21T00:15:18.078407+0000","last_peered":"2024-09-21T00:15:18.078407+0000","last_clean":"2024-09-21T00:15:18.078407+0000","last_became_active":"2024-09-21T00:15:15.868218+0000","last_became_peered":"2024-09-21T00:15:15.868218+0000","last_unstale":"2024-09-21T00:15:18.078407+0000","last_undegraded":"2024-09-21T00:15:18.078407+0000","last_fullsized":"2024-09-21T00:15:18.078407+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:54.537075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868970+0000","last_change":"2024-09-21T00:15:16.882839+0000","last_active":"2024-09-21T00:15:17.868970+0000","last_peered":"2024-09-21T00:15:17.868970+0000","last_clean":"2024-09-21T00:15:17.868970+0000","last_became_active":"2024-09-21T00:15:16.878078+0000","last_became_peered":"2024-09-21T00:15:16.878078+0000","last_unstale":"2024-09-21T00:15:17.868970+0000","last_undegraded":"2024-09-21T00:15:17.868970+0000","last_fullsized":"2024-09-21T00:15:17.868970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:13.786819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866618+0000","last_change":"2024-09-21T00:15:15.861682+0000","last_active":"2024-09-21T00:15:17.866618+0000","last_peered":"2024-09-21T00:15:17.866618+0000","last_clean":"2024-09-21T00:15:17.866618+0000","last_became_active":"2024-09-21T00:15:15.861408+0000","last_became_peered":"2024-09-21T00:15:15.861408+0000","last_unstale":"2024-09-21T00:15:17.866618+0000","last_undegraded":"2024-09-21T00:15:17.866618+0000","last_fullsized":"2024-09-21T00:15:17.866618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:30.905194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080689+0000","last_change":"2024-09-21T00:15:16.875154+0000","last_active":"2024-09-21T00:15:18.080689+0000","last_peered":"2024-09-21T00:15:18.080689+0000","last_clean":"2024-09-21T00:15:18.080689+0000","last_became_active":"2024-09-21T00:15:16.874266+0000","last_became_peered":"2024-09-21T00:15:16.874266+0000","last_unstale":"2024-09-21T00:15:18.080689+0000","last_undegraded":"2024-09-21T00:15:18.080689+0000","last_fullsized":"2024-09-21T00:15:18.080689+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:02.210312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.941718+0000","last_change":"2024-09-21T00:15:15.874388+0000","last_active":"2024-09-21T00:15:17.941718+0000","last_peered":"2024-09-21T00:15:17.941718+0000","last_clean":"2024-09-21T00:15:17.941718+0000","last_became_active":"2024-09-21T00:15:15.873129+0000","last_became_peered":"2024-09-21T00:15:15.873129+0000","last_unstale":"2024-09-21T00:15:17.941718+0000","last_undegraded":"2024-09-21T00:15:17.941718+0000","last_fullsized":"2024-09-21T00:15:17.941718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:14.230132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.868269+0000","last_change":"2024-09-21T00:15:16.889065+0000","last_active":"2024-09-21T00:15:17.868269+0000","last_peered":"2024-09-21T00:15:17.868269+0000","last_clean":"2024-09-21T00:15:17.868269+0000","last_became_active":"2024-09-21T00:15:16.888720+0000","last_became_peered":"2024-09-21T00:15:16.888720+0000","last_unstale":"2024-09-21T00:15:17.868269+0000","last_undegraded":"2024-09-21T00:15:17.868269+0000","last_fullsized":"2024-09-21T00:15:17.868269+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.858929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867811+0000","last_change":"2024-09-21T00:15:15.863805+0000","last_active":"2024-09-21T00:15:17.867811+0000","last_peered":"2024-09-21T00:15:17.867811+0000","last_clean":"2024-09-21T00:15:17.867811+0000","last_became_active":"2024-09-21T00:15:15.863461+0000","last_became_peered":"2024-09-21T00:15:15.863461+0000","last_unstale":"2024-09-21T00:15:17.867811+0000","last_undegraded":"2024-09-21T00:15:17.867811+0000","last_fullsized":"2024-09-21T00:15:17.867811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:26.759455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.867630+0000","last_change":"2024-09-21T00:15:16.864392+0000","last_active":"2024-09-21T00:15:17.867630+0000","last_peered":"2024-09-21T00:15:17.867630+0000","last_clean":"2024-09-21T00:15:17.867630+0000","last_became_active":"2024-09-21T00:15:16.864065+0000","last_became_peered":"2024-09-21T00:15:16.864065+0000","last_unstale":"2024-09-21T00:15:17.867630+0000","last_undegraded":"2024-09-21T00:15:17.867630+0000","last_fullsized":"2024-09-21T00:15:17.867630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:23.130632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079208+0000","last_change":"2024-09-21T00:15:15.863840+0000","last_active":"2024-09-21T00:15:18.079208+0000","last_peered":"2024-09-21T00:15:18.079208+0000","last_clean":"2024-09-21T00:15:18.079208+0000","last_became_active":"2024-09-21T00:15:15.863081+0000","last_became_peered":"2024-09-21T00:15:15.863081+0000","last_unstale":"2024-09-21T00:15:18.079208+0000","last_undegraded":"2024-09-21T00:15:18.079208+0000","last_fullsized":"2024-09-21T00:15:18.079208+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:23.701752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.079110+0000","last_change":"2024-09-21T00:15:16.881804+0000","last_active":"2024-09-21T00:15:18.079110+0000","last_peered":"2024-09-21T00:15:18.079110+0000","last_clean":"2024-09-21T00:15:18.079110+0000","last_became_active":"2024-09-21T00:15:16.881268+0000","last_became_peered":"2024-09-21T00:15:16.881268+0000","last_unstale":"2024-09-21T00:15:18.079110+0000","last_undegraded":"2024-09-21T00:15:18.079110+0000","last_fullsized":"2024-09-21T00:15:18.079110+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:22.078151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080125+0000","last_change":"2024-09-21T00:15:15.874106+0000","last_active":"2024-09-21T00:15:18.080125+0000","last_peered":"2024-09-21T00:15:18.080125+0000","last_clean":"2024-09-21T00:15:18.080125+0000","last_became_active":"2024-09-21T00:15:15.873619+0000","last_became_peered":"2024-09-21T00:15:15.873619+0000","last_unstale":"2024-09-21T00:15:18.080125+0000","last_undegraded":"2024-09-21T00:15:18.080125+0000","last_fullsized":"2024-09-21T00:15:18.080125+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:28.490880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866088+0000","last_change":"2024-09-21T00:15:16.861424+0000","last_active":"2024-09-21T00:15:17.866088+0000","last_peered":"2024-09-21T00:15:17.866088+0000","last_clean":"2024-09-21T00:15:17.866088+0000","last_became_active":"2024-09-21T00:15:16.861130+0000","last_became_peered":"2024-09-21T00:15:16.861130+0000","last_unstale":"2024-09-21T00:15:17.866088+0000","last_undegraded":"2024-09-21T00:15:17.866088+0000","last_fullsized":"2024-09-21T00:15:17.866088+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:05.839943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.865885+0000","last_change":"2024-09-21T00:15:15.860701+0000","last_active":"2024-09-21T00:15:17.865885+0000","last_peered":"2024-09-21T00:15:17.865885+0000","last_clean":"2024-09-21T00:15:17.865885+0000","last_became_active":"2024-09-21T00:15:15.860434+0000","last_became_peered":"2024-09-21T00:15:15.860434+0000","last_unstale":"2024-09-21T00:15:17.865885+0000","last_undegraded":"2024-09-21T00:15:17.865885+0000","last_fullsized":"2024-09-21T00:15:17.865885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:02.081143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080075+0000","last_change":"2024-09-21T00:15:16.881672+0000","last_active":"2024-09-21T00:15:18.080075+0000","last_peered":"2024-09-21T00:15:18.080075+0000","last_clean":"2024-09-21T00:15:18.080075+0000","last_became_active":"2024-09-21T00:15:16.881337+0000","last_became_peered":"2024-09-21T00:15:16.881337+0000","last_unstale":"2024-09-21T00:15:18.080075+0000","last_undegraded":"2024-09-21T00:15:18.080075+0000","last_fullsized":"2024-09-21T00:15:18.080075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:58.449816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080689+0000","last_change":"2024-09-21T00:15:15.866551+0000","last_active":"2024-09-21T00:15:18.080689+0000","last_peered":"2024-09-21T00:15:18.080689+0000","last_clean":"2024-09-21T00:15:18.080689+0000","last_became_active":"2024-09-21T00:15:15.866253+0000","last_became_peered":"2024-09-21T00:15:15.866253+0000","last_unstale":"2024-09-21T00:15:18.080689+0000","last_undegraded":"2024-09-21T00:15:18.080689+0000","last_fullsized":"2024-09-21T00:15:18.080689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:47.049937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:17.866440+0000","last_change":"2024-09-21T00:15:16.887371+0000","last_active":"2024-09-21T00:15:17.866440+0000","last_peered":"2024-09-21T00:15:17.866440+0000","last_clean":"2024-09-21T00:15:17.866440+0000","last_became_active":"2024-09-21T00:15:16.887049+0000","last_became_peered":"2024-09-21T00:15:16.887049+0000","last_unstale":"2024-09-21T00:15:17.866440+0000","last_undegraded":"2024-09-21T00:15:17.866440+0000","last_fullsized":"2024-09-21T00:15:17.866440+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:15.838346+0000","last_clean_scrub_stamp":"2024-09-21T00:15:15.838346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:02.733269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.080297+0000","last_change":"2024-09-21T00:15:15.874239+0000","last_active":"2024-09-21T00:15:18.080297+0000","last_peered":"2024-09-21T00:15:18.080297+0000","last_clean":"2024-09-21T00:15:18.080297+0000","last_became_active":"2024-09-21T00:15:15.873980+0000","last_became_peered":"2024-09-21T00:15:15.873980+0000","last_unstale":"2024-09-21T00:15:18.080297+0000","last_undegraded":"2024-09-21T00:15:18.080297+0000","last_fullsized":"2024-09-21T00:15:18.080297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:15:14.835444+0000","last_clean_scrub_stamp":"2024-09-21T00:15:14.835444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:12.783917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":144,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-21T00:15:18.078793+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:15:18.078793+0000","last_peered":"2024-09-21T00:15:18.078793+0000","last_clean":"2024-09-21T00:15:18.078793+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:15:18.078793+0000","last_undegraded":"2024-09-21T00:15:18.078793+0000","last_fullsized":"2024-09-21T00:15:18.078793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":199523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":199487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":487424,"data_stored":201189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":199543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":201647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":789843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":199545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1064960,"data_stored":790403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:15:26.747 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T00:15:26.747 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T00:15:27.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.010+0000 7f3eee800640 1 -- 172.21.15.83:0/2613103442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ee8071160 msgr2=0x7f3ee8071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:27.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.010+0000 7f3eee800640 1 --2- 172.21.15.83:0/2613103442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ee8071160 0x7f3ee8071570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8073490 tx=0x7f3ee002a980 comp rx=0 tx=0).stop 2024-09-21T00:15:27.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.010+0000 7f3eee800640 1 -- 172.21.15.83:0/2613103442 shutdown_connections 2024-09-21T00:15:27.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.010+0000 7f3eee800640 1 --2- 172.21.15.83:0/2613103442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ee8071160 0x7f3ee8071570 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.010+0000 7f3eee800640 1 --2- 172.21.15.83:0/2613103442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee815b900 0x7f3ee806e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.010+0000 7f3eee800640 1 --2- 172.21.15.83:0/2613103442 >> v2:172.21.15.142:3300/0 conn(0x7f3ee8072320 0x7f3ee8152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.010+0000 7f3eee800640 1 -- 172.21.15.83:0/2613103442 >> 172.21.15.83:0/2613103442 conn(0x7f3ee80d1020 msgr2=0x7f3ee80d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:27.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.011+0000 7f3eee800640 1 -- 172.21.15.83:0/2613103442 shutdown_connections 2024-09-21T00:15:27.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.011+0000 7f3eee800640 1 -- 172.21.15.83:0/2613103442 wait complete. 2024-09-21T00:15:27.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.013+0000 7f3eee800640 1 Processor -- start 2024-09-21T00:15:27.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.013+0000 7f3eee800640 1 -- start start 2024-09-21T00:15:27.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.014+0000 7f3eee800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ee8071160 0x7f3ee8150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.014+0000 7f3eee800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee8072320 0x7f3ee815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.014+0000 7f3eee800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee815b900 0x7f3ee815a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.014+0000 7f3eee800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee80b3f50 con 0x7f3ee8071160 2024-09-21T00:15:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.014+0000 7f3eee800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee815bf20 con 0x7f3ee815b900 2024-09-21T00:15:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.014+0000 7f3eee800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee80b40d0 con 0x7f3ee8072320 2024-09-21T00:15:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eed400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ee8071160 0x7f3ee8150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eed400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ee8071160 0x7f3ee8150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43282/0 (socket says 172.21.15.83:43282) 2024-09-21T00:15:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eed400640 1 -- 172.21.15.83:0/1380586779 learned_addr learned my addr 172.21.15.83:0/1380586779 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:27.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eede00640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee815b900 0x7f3ee815a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:27.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eeca00640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee8072320 0x7f3ee815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:27.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eed400640 1 -- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee8072320 msgr2=0x7f3ee815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eed400640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee8072320 0x7f3ee815a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eed400640 1 -- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee815b900 msgr2=0x7f3ee815a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eed400640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee815b900 0x7f3ee815a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eed400640 1 -- 172.21.15.83:0/1380586779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee81f51f0 con 0x7f3ee8071160 2024-09-21T00:15:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.015+0000 7f3eed400640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ee8071160 0x7f3ee8150660 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00d750 tx=0x7f3edc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.016+0000 7f3ee5600640 1 -- 172.21.15.83:0/1380586779 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc017070 con 0x7f3ee8071160 2024-09-21T00:15:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.016+0000 7f3ee5600640 1 -- 172.21.15.83:0/1380586779 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3edc009cc0 con 0x7f3ee8071160 2024-09-21T00:15:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.016+0000 7f3eee800640 1 -- 172.21.15.83:0/1380586779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee81f5460 con 0x7f3ee8071160 2024-09-21T00:15:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.016+0000 7f3ee5600640 1 -- 172.21.15.83:0/1380586779 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0106c0 con 0x7f3ee8071160 2024-09-21T00:15:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.016+0000 7f3eee800640 1 -- 172.21.15.83:0/1380586779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee81f5a20 con 0x7f3ee8071160 2024-09-21T00:15:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.017+0000 7f3eee800640 1 -- 172.21.15.83:0/1380586779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee80b5a00 con 0x7f3ee8071160 2024-09-21T00:15:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.018+0000 7f3ee5600640 1 -- 172.21.15.83:0/1380586779 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3edc01a070 con 0x7f3ee8071160 2024-09-21T00:15:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.019+0000 7f3ee5600640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3ec8078b90 0x7f3ec807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.019+0000 7f3ee5600640 1 -- 172.21.15.83:0/1380586779 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f3edc09b070 con 0x7f3ee8071160 2024-09-21T00:15:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.020+0000 7f3eeca00640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3ec8078b90 0x7f3ec807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.021+0000 7f3eeca00640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3ec8078b90 0x7f3ec807b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4005fd0 tx=0x7f3ed4005850 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:27.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.024+0000 7f3ee5600640 1 -- 172.21.15.83:0/1380586779 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3ee80b5a00 con 0x7f3ee8071160 2024-09-21T00:15:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.284+0000 7f3eee800640 1 -- 172.21.15.83:0/1380586779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3ee8152450 con 0x7f3ee8071160 2024-09-21T00:15:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.287+0000 7f3ee5600640 1 -- 172.21.15.83:0/1380586779 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f3edc00de60 con 0x7f3ee8071160 2024-09-21T00:15:27.289 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2024-09-21T00:15:27.289 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCPD+5mV1rxDBAAkcsI2sXp787CjEVP5Ncm1g== 2024-09-21T00:15:27.289 INFO:teuthology.orchestra.run.smithi083.stdout: caps mds = "allow" 2024-09-21T00:15:27.289 INFO:teuthology.orchestra.run.smithi083.stdout: caps mon = "allow r" 2024-09-21T00:15:27.289 INFO:teuthology.orchestra.run.smithi083.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T00:15:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:updated caps for client.0 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 -- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3ec8078b90 msgr2=0x7f3ec807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3ec8078b90 0x7f3ec807b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4005fd0 tx=0x7f3ed4005850 comp rx=0 tx=0).stop 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 -- 172.21.15.83:0/1380586779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ee8071160 msgr2=0x7f3ee8150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ee8071160 0x7f3ee8150660 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00d750 tx=0x7f3edc00dc10 comp rx=0 tx=0).stop 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 -- 172.21.15.83:0/1380586779 shutdown_connections 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3ec8078b90 0x7f3ec807b0a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee815b900 0x7f3ee815a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee8072320 0x7f3ee815a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 --2- 172.21.15.83:0/1380586779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ee8071160 0x7f3ee8150660 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 -- 172.21.15.83:0/1380586779 >> 172.21.15.83:0/1380586779 conn(0x7f3ee80d1020 msgr2=0x7f3ee806d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 -- 172.21.15.83:0/1380586779 shutdown_connections 2024-09-21T00:15:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.290+0000 7f3eee800640 1 -- 172.21.15.83:0/1380586779 wait complete. 2024-09-21T00:15:27.317 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:27.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.535+0000 7f4854600640 1 -- 172.21.15.83:0/628021300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c0cb750 msgr2=0x7f484c0af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:27.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.535+0000 7f4854600640 1 --2- 172.21.15.83:0/628021300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c0cb750 0x7f484c0af420 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f484c071cc0 tx=0x7f484002a530 comp rx=0 tx=0).stop 2024-09-21T00:15:27.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.535+0000 7f4854600640 1 -- 172.21.15.83:0/628021300 shutdown_connections 2024-09-21T00:15:27.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.535+0000 7f4854600640 1 --2- 172.21.15.83:0/628021300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f484c06e500 0x7f484c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.535+0000 7f4854600640 1 --2- 172.21.15.83:0/628021300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c0cb750 0x7f484c0af420 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.535+0000 7f4854600640 1 -- 172.21.15.83:0/628021300 >> 172.21.15.83:0/628021300 conn(0x7f484c0cca40 msgr2=0x7f484c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:27.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.535+0000 7f4854600640 1 -- 172.21.15.83:0/628021300 shutdown_connections 2024-09-21T00:15:27.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.535+0000 7f4854600640 1 -- 172.21.15.83:0/628021300 wait complete. 2024-09-21T00:15:27.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.538+0000 7f4854600640 1 Processor -- start 2024-09-21T00:15:27.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.538+0000 7f4854600640 1 -- start start 2024-09-21T00:15:27.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.539+0000 7f4854600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f484c15e7c0 0x7f484c15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:27.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.539+0000 7f4854600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c15d4f0 0x7f484c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:27.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.539+0000 7f4854600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c0b4ed0 0x7f484c0b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:27.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.539+0000 7f4854600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f484c0ce6d0 con 0x7f484c15d4f0 2024-09-21T00:15:27.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.539+0000 7f4854600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f484c0ce550 con 0x7f484c0b4ed0 2024-09-21T00:15:27.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.539+0000 7f4854600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f484c0ce850 con 0x7f484c15e7c0 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.539+0000 7f4851200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c15d4f0 0x7f484c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.539+0000 7f4851200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c15d4f0 0x7f484c15a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43310/0 (socket says 172.21.15.83:43310) 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4851200640 1 -- 172.21.15.83:0/425656364 learned_addr learned my addr 172.21.15.83:0/425656364 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4851c00640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f484c15e7c0 0x7f484c15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4852600640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c0b4ed0 0x7f484c0b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4851200640 1 -- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f484c15e7c0 msgr2=0x7f484c15eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4851200640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f484c15e7c0 0x7f484c15eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4851200640 1 -- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c0b4ed0 msgr2=0x7f484c0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4851200640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c0b4ed0 0x7f484c0b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4851200640 1 -- 172.21.15.83:0/425656364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484c0b5820 con 0x7f484c15d4f0 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4852600640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c0b4ed0 0x7f484c0b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4851200640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c15d4f0 0x7f484c15a9b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f483800b3e0 tx=0x7f483800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:27.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4849600640 1 -- 172.21.15.83:0/425656364 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838015020 con 0x7f484c15d4f0 2024-09-21T00:15:27.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4849600640 1 -- 172.21.15.83:0/425656364 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4838011940 con 0x7f484c15d4f0 2024-09-21T00:15:27.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.540+0000 7f4854600640 1 -- 172.21.15.83:0/425656364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484c1f4e90 con 0x7f484c15d4f0 2024-09-21T00:15:27.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.541+0000 7f4849600640 1 -- 172.21.15.83:0/425656364 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838011d90 con 0x7f484c15d4f0 2024-09-21T00:15:27.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.541+0000 7f4854600640 1 -- 172.21.15.83:0/425656364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f484c15f940 con 0x7f484c15d4f0 2024-09-21T00:15:27.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.542+0000 7f4854600640 1 -- 172.21.15.83:0/425656364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f484c0ced80 con 0x7f484c15d4f0 2024-09-21T00:15:27.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.543+0000 7f4849600640 1 -- 172.21.15.83:0/425656364 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4838018020 con 0x7f484c15d4f0 2024-09-21T00:15:27.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.544+0000 7f4849600640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f482c078bc0 0x7f482c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:27.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.544+0000 7f4849600640 1 -- 172.21.15.83:0/425656364 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f483809adb0 con 0x7f484c15d4f0 2024-09-21T00:15:27.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.544+0000 7f4851c00640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f482c078bc0 0x7f482c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:27.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.545+0000 7f4851c00640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f482c078bc0 0x7f482c07b0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4840033000 tx=0x7f4840004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:27.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.548+0000 7f4849600640 1 -- 172.21.15.83:0/425656364 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f483809f070 con 0x7f484c15d4f0 2024-09-21T00:15:27.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.771+0000 7f4854600640 1 -- 172.21.15.83:0/425656364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f484c15f3f0 con 0x7f484c15d4f0 2024-09-21T00:15:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.772+0000 7f4849600640 1 -- 172.21.15.83:0/425656364 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7f483801f020 con 0x7f484c15d4f0 2024-09-21T00:15:27.773 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:27.773 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":18,"btime":"2024-09-21T00:15:19:889534+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2168701718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2168701718},{"type":"v1","addr":"172.21.15.142:6836","nonce":2168701718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/399437337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":399437337},{"type":"v1","addr":"172.21.15.83:6835","nonce":399437337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4915,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/683491362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":683491362},{"type":"v1","addr":"172.21.15.83:6834","nonce":683491362}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:15:16.342714+0000","modified":"2024-09-21T00:15:19.380367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4918},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4918":{"gid":4918,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1450693530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1450693530},{"type":"v1","addr":"172.21.15.142:6837","nonce":1450693530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4918,"qdb_cluster":[4918]},"id":2}]} 2024-09-21T00:15:27.773 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 18 2024-09-21T00:15:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 -- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f482c078bc0 msgr2=0x7f482c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f482c078bc0 0x7f482c07b0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4840033000 tx=0x7f4840004730 comp rx=0 tx=0).stop 2024-09-21T00:15:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 -- 172.21.15.83:0/425656364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c15d4f0 msgr2=0x7f484c15a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:27.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c15d4f0 0x7f484c15a9b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f483800b3e0 tx=0x7f483800b8a0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 -- 172.21.15.83:0/425656364 shutdown_connections 2024-09-21T00:15:27.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f482c078bc0 0x7f482c07b0d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c0b4ed0 0x7f484c0b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c15d4f0 0x7f484c15a9b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 --2- 172.21.15.83:0/425656364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f484c15e7c0 0x7f484c15eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:27.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 -- 172.21.15.83:0/425656364 >> 172.21.15.83:0/425656364 conn(0x7f484c0cca40 msgr2=0x7f484c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:27.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 -- 172.21.15.83:0/425656364 shutdown_connections 2024-09-21T00:15:27.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:27.774+0000 7f4854600640 1 -- 172.21.15.83:0/425656364 wait complete. 2024-09-21T00:15:28.199 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T00:15:16.342714+0000', 'modified': '2024-09-21T00:15:19.380367+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4918}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4918': {'gid': 4918, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/1450693530', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 1450693530}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 1450693530}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4918, 'qdb_cluster': [4918]} 2024-09-21T00:15:28.199 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T00:15:28.200 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-21T00:15:28.338 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:15:28.342 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:15:28.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.425+0000 7f405f200640 1 -- 172.21.15.83:0/4130146687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40600cf6d0 msgr2=0x7f406015fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.425+0000 7f405f200640 1 --2- 172.21.15.83:0/4130146687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40600cf6d0 0x7f406015fee0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4060156ed0 tx=0x7f404802a560 comp rx=0 tx=0).stop 2024-09-21T00:15:28.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.425+0000 7f405f200640 1 -- 172.21.15.83:0/4130146687 shutdown_connections 2024-09-21T00:15:28.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.425+0000 7f405f200640 1 --2- 172.21.15.83:0/4130146687 >> v2:172.21.15.142:3300/0 conn(0x7f4060160420 0x7f406015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.425+0000 7f405f200640 1 --2- 172.21.15.83:0/4130146687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40600cf6d0 0x7f406015fee0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.425+0000 7f405f200640 1 --2- 172.21.15.83:0/4130146687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40600cc0e0 0x7f40600702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.425+0000 7f405f200640 1 -- 172.21.15.83:0/4130146687 >> 172.21.15.83:0/4130146687 conn(0x7f40600d05c0 msgr2=0x7f406006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:28.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.425+0000 7f405f200640 1 -- 172.21.15.83:0/4130146687 shutdown_connections 2024-09-21T00:15:28.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.425+0000 7f405f200640 1 -- 172.21.15.83:0/4130146687 wait complete. 2024-09-21T00:15:28.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.427+0000 7f405f200640 1 Processor -- start 2024-09-21T00:15:28.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.427+0000 7f405f200640 1 -- start start 2024-09-21T00:15:28.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.429+0000 7f405f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40600cc0e0 0x7f4060140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.429+0000 7f405f200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40600cf6d0 0x7f40601f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.429+0000 7f405f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4060160420 0x7f406015af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.429+0000 7f405f200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f406015d270 con 0x7f40600cf6d0 2024-09-21T00:15:28.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.429+0000 7f405f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f406015d0f0 con 0x7f4060160420 2024-09-21T00:15:28.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.429+0000 7f405f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f406015d3f0 con 0x7f40600cc0e0 2024-09-21T00:15:28.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.429+0000 7f4055400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40600cf6d0 0x7f40601f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.429+0000 7f4055400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40600cf6d0 0x7f40601f62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43332/0 (socket says 172.21.15.83:43332) 2024-09-21T00:15:28.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.429+0000 7f4055400640 1 -- 172.21.15.83:0/4029899277 learned_addr learned my addr 172.21.15.83:0/4029899277 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:28.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f405e800640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4060160420 0x7f406015af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f405de00640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40600cc0e0 0x7f4060140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f4055400640 1 -- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40600cc0e0 msgr2=0x7f4060140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f4055400640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40600cc0e0 0x7f4060140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f4055400640 1 -- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4060160420 msgr2=0x7f406015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f4055400640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4060160420 0x7f406015af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f4055400640 1 -- 172.21.15.83:0/4029899277 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4060072c10 con 0x7f40600cf6d0 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f405de00640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40600cc0e0 0x7f4060140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f4055400640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40600cf6d0 0x7f40601f62f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4048000c00 tx=0x7f40480039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f4056a00640 1 -- 172.21.15.83:0/4029899277 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404803e030 con 0x7f40600cf6d0 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f4056a00640 1 -- 172.21.15.83:0/4029899277 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40480047a0 con 0x7f40600cf6d0 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f405f200640 1 -- 172.21.15.83:0/4029899277 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4060072eb0 con 0x7f40600cf6d0 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.430+0000 7f4056a00640 1 -- 172.21.15.83:0/4029899277 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048035040 con 0x7f40600cf6d0 2024-09-21T00:15:28.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.431+0000 7f405f200640 1 -- 172.21.15.83:0/4029899277 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4060073470 con 0x7f40600cf6d0 2024-09-21T00:15:28.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.433+0000 7f4056a00640 1 -- 172.21.15.83:0/4029899277 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4048041030 con 0x7f40600cf6d0 2024-09-21T00:15:28.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.434+0000 7f4056a00640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f403c078bc0 0x7f403c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.434+0000 7f4056a00640 1 -- 172.21.15.83:0/4029899277 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f40480bb6b0 con 0x7f40600cf6d0 2024-09-21T00:15:28.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.434+0000 7f405de00640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f403c078bc0 0x7f403c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.435+0000 7f406bc03740 1 Processor -- start 2024-09-21T00:15:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.435+0000 7f406bc03740 1 -- start start 2024-09-21T00:15:28.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.435+0000 7f405de00640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f403c078bc0 0x7f403c07b0d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4050009890 tx=0x7f4050008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.436+0000 7f406bc03740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d63270 0x5634a6133b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.436+0000 7f406bc03740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d3a3b0 0x5634a61340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.436+0000 7f406bc03740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d42590 0x5634a6104150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.436+0000 7f406bc03740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5634a608d430 con 0x5634a5d3a3b0 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.436+0000 7f406bc03740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5634a607d5d0 con 0x5634a5d63270 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.436+0000 7f406bc03740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5634a606ca00 con 0x5634a5d42590 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f405de00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d63270 0x5634a6133b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f405de00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d63270 0x5634a6133b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:50612/0 (socket says 172.21.15.83:50612) 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f405de00640 1 -- 172.21.15.83:0/3230726491 learned_addr learned my addr 172.21.15.83:0/3230726491 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f405e800640 1 --2- 172.21.15.83:0/3230726491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d42590 0x5634a6104150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f4055400640 1 --2- 172.21.15.83:0/3230726491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d3a3b0 0x5634a61340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f405de00640 1 -- 172.21.15.83:0/3230726491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d42590 msgr2=0x5634a6104150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f405de00640 1 --2- 172.21.15.83:0/3230726491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d42590 0x5634a6104150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f405de00640 1 -- 172.21.15.83:0/3230726491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d3a3b0 msgr2=0x5634a61340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f405de00640 1 --2- 172.21.15.83:0/3230726491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d3a3b0 0x5634a61340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f405de00640 1 -- 172.21.15.83:0/3230726491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634a6035520 con 0x5634a5d63270 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.437+0000 7f405de00640 1 --2- 172.21.15.83:0/3230726491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d63270 0x5634a6133b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f405000d910 tx=0x7f4050010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83df661befd5e942 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.438+0000 7f404e600640 1 -- 172.21.15.83:0/3230726491 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050024070 con 0x5634a5d63270 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.438+0000 7f404e600640 1 -- 172.21.15.83:0/3230726491 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f405000de90 con 0x5634a5d63270 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.438+0000 7f404e600640 1 -- 172.21.15.83:0/3230726491 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050014e00 con 0x5634a5d63270 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.439+0000 7f406bc03740 1 -- 172.21.15.83:0/3230726491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d63270 msgr2=0x5634a6133b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.439+0000 7f406bc03740 1 --2- 172.21.15.83:0/3230726491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d63270 0x5634a6133b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f405000d910 tx=0x7f4050010000 comp rx=0 tx=0).stop 2024-09-21T00:15:28.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.439+0000 7f406bc03740 1 -- 172.21.15.83:0/3230726491 shutdown_connections 2024-09-21T00:15:28.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.439+0000 7f406bc03740 1 --2- 172.21.15.83:0/3230726491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d42590 0x5634a6104150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.439+0000 7f406bc03740 1 --2- 172.21.15.83:0/3230726491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d3a3b0 0x5634a61340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.439+0000 7f406bc03740 1 --2- 172.21.15.83:0/3230726491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d63270 0x5634a6133b60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.439+0000 7f406bc03740 1 -- 172.21.15.83:0/3230726491 >> 172.21.15.83:0/3230726491 conn(0x5634a5d573c0 msgr2=0x5634a6109b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:28.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.439+0000 7f406bc03740 1 -- 172.21.15.83:0/3230726491 shutdown_connections 2024-09-21T00:15:28.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.439+0000 7f406bc03740 1 -- 172.21.15.83:0/3230726491 wait complete. 2024-09-21T00:15:28.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.440+0000 7f406bc03740 1 -- start start 2024-09-21T00:15:28.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.440+0000 7f406bc03740 1 Processor -- start 2024-09-21T00:15:28.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.441+0000 7f406bc03740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 0x5634a6161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.441+0000 7f406bc03740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d42590 0x5634a6148180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.441+0000 7f406bc03740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a612a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.441+0000 7f406bc03740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5634a6013330 con 0x5634a5d63270 2024-09-21T00:15:28.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.441+0000 7f406bc03740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5634a6070810 con 0x5634a5d42590 2024-09-21T00:15:28.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.441+0000 7f406bc03740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5634a5ddd620 con 0x5634a5d3a3b0 2024-09-21T00:15:28.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f406bc03740 10 client.0 _ll_register_callbacks cb 0x5634a6018420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:15:28.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f405e800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a612a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f405e800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a612a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43352/0 (socket says 172.21.15.83:43352) 2024-09-21T00:15:28.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f405e800640 1 -- 172.21.15.83:0/1254005418 learned_addr learned my addr 172.21.15.83:0/1254005418 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:28.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f405de00640 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 0x5634a6161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f405e800640 1 -- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 msgr2=0x5634a6161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:28.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f405e800640 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 0x5634a6161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f405e800640 1 -- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d42590 msgr2=0x5634a6148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:28.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f405e800640 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d42590 0x5634a6148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f405e800640 1 -- 172.21.15.83:0/1254005418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634a5dce850 con 0x5634a5d63270 2024-09-21T00:15:28.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f405e800640 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a612a090 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f405800abc0 tx=0x7f4058011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d967ec8909c9aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:28.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.442+0000 7f4042a00640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T00:15:28.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f4042a00640 1 -- 172.21.15.83:0/1254005418 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405801a070 con 0x5634a5d63270 2024-09-21T00:15:28.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f4042a00640 1 -- 172.21.15.83:0/1254005418 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f4058011e10 con 0x5634a5d63270 2024-09-21T00:15:28.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f406bc03740 1 -- 172.21.15.83:0/1254005418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f405000de90 con 0x5634a5d63270 2024-09-21T00:15:28.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f4042a00640 1 -- 172.21.15.83:0/1254005418 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4058025050 con 0x5634a5d63270 2024-09-21T00:15:28.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f406bc03740 10 client.5208 fetch_fsmap learned FSMap version 18 2024-09-21T00:15:28.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f406bc03740 1 -- 172.21.15.83:0/1254005418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5634a5e456b0 con 0x5634a5d63270 2024-09-21T00:15:28.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f4042a00640 1 -- 172.21.15.83:0/1254005418 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f405000de90 con 0x5634a5d63270 2024-09-21T00:15:28.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f4042a00640 1 -- 172.21.15.83:0/1254005418 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f4058028020 con 0x5634a5d63270 2024-09-21T00:15:28.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f406bc03740 10 client.5208 fetch_fsmap finished waiting for FSMap version 18 2024-09-21T00:15:28.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f406bc03740 10 client.5208 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T00:15:28.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f406bc03740 20 client.5208 populate_metadata read hostname 'smithi083' 2024-09-21T00:15:28.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f406bc03740 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:6835/1450693530,v1:172.21.15.142:6837/1450693530] conn(0x5634a5d21e40 0x5634a612bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f406bc03740 4 client.5208 mds_command: new command op to 4918 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:15:28.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.443+0000 7f406bc03740 1 -- 172.21.15.83:0/1254005418 --> [v2:172.21.15.142:6835/1450693530,v1:172.21.15.142:6837/1450693530] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634a607f520 con 0x5634a5d21e40 2024-09-21T00:15:28.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.444+0000 7f405de00640 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:6835/1450693530,v1:172.21.15.142:6837/1450693530] conn(0x5634a5d21e40 0x5634a612bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.445+0000 7f405de00640 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:6835/1450693530,v1:172.21.15.142:6837/1450693530] conn(0x5634a5d21e40 0x5634a612bdf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4c82c51908d3a46 server_cookie=5d833bb9af80d849 in_seq=0 out_seq=0 2024-09-21T00:15:28.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.445+0000 7f4042a00640 10 client.5208 ms_handle_connect on v2:172.21.15.142:6835/1450693530 2024-09-21T00:15:28.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f4042a00640 1 -- 172.21.15.83:0/1254005418 <== mds.0 v2:172.21.15.142:6835/1450693530 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5634a607f520 con 0x5634a5d21e40 2024-09-21T00:15:28.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f4042a00640 10 client.5208 handle_command_reply: tid=0 2024-09-21T00:15:28.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 client.5208 shutdown 2024-09-21T00:15:28.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 -- 172.21.15.83:0/1254005418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 msgr2=0x5634a612a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a612a090 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f405800abc0 tx=0x7f4058011580 comp rx=0 tx=0).stop 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 -- 172.21.15.83:0/1254005418 shutdown_connections 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:6835/1450693530,v1:172.21.15.142:6837/1450693530] conn(0x5634a5d21e40 0x5634a612bdf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a612a090 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d42590 0x5634a6148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 --2- 172.21.15.83:0/1254005418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 0x5634a6161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f4042a00640 0 client.5208 ms_handle_reset on v2:172.21.15.142:6835/1450693530 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 -- 172.21.15.83:0/1254005418 >> 172.21.15.83:0/1254005418 conn(0x5634a5d573c0 msgr2=0x5634a6150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 -- 172.21.15.83:0/1254005418 shutdown_connections 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.446+0000 7f406bc03740 1 -- 172.21.15.83:0/1254005418 wait complete. 2024-09-21T00:15:28.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.447+0000 7f406bc03740 20 client.5208 trim_cache size 0 max 16384 2024-09-21T00:15:28.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.465+0000 7f406bc03740 1 Processor -- start 2024-09-21T00:15:28.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.466+0000 7f406bc03740 1 -- start start 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f406bc03740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 0x5634a61330c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f406bc03740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d42590 0x5634a6133970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f406bc03740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f406bc03740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4060201440 con 0x5634a5d63270 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f406bc03740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f40601f9d10 con 0x5634a5d42590 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f406bc03740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f406013eed0 con 0x5634a5d3a3b0 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f405e800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f405e800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43366/0 (socket says 172.21.15.83:43366) 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f405e800640 1 -- 172.21.15.83:0/2414159698 learned_addr learned my addr 172.21.15.83:0/2414159698 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f405de00640 1 --2- 172.21.15.83:0/2414159698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 0x5634a61330c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f4055400640 1 --2- 172.21.15.83:0/2414159698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d42590 0x5634a6133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f405e800640 1 -- 172.21.15.83:0/2414159698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 msgr2=0x5634a61330c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:28.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f405e800640 1 --2- 172.21.15.83:0/2414159698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 0x5634a61330c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f405e800640 1 -- 172.21.15.83:0/2414159698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d42590 msgr2=0x5634a6133970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:28.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f405e800640 1 --2- 172.21.15.83:0/2414159698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d42590 0x5634a6133970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.467+0000 7f405e800640 1 -- 172.21.15.83:0/2414159698 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634a610a840 con 0x5634a5d63270 2024-09-21T00:15:28.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.468+0000 7f405de00640 1 --2- 172.21.15.83:0/2414159698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 0x5634a61330c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:28.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.468+0000 7f405e800640 1 --2- 172.21.15.83:0/2414159698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133eb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4058016880 tx=0x7f4058011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b28d6843f963a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:28.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.468+0000 7f404dc00640 1 -- 172.21.15.83:0/2414159698 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405802e070 con 0x5634a5d63270 2024-09-21T00:15:28.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.468+0000 7f404dc00640 1 -- 172.21.15.83:0/2414159698 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40580168b0 con 0x5634a5d63270 2024-09-21T00:15:28.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.468+0000 7f404dc00640 1 -- 172.21.15.83:0/2414159698 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405801a040 con 0x5634a5d63270 2024-09-21T00:15:28.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.469+0000 7f406bc03740 1 -- 172.21.15.83:0/2414159698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 msgr2=0x5634a6133eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.469+0000 7f406bc03740 1 --2- 172.21.15.83:0/2414159698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133eb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4058016880 tx=0x7f4058011a80 comp rx=0 tx=0).stop 2024-09-21T00:15:28.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.469+0000 7f406bc03740 1 -- 172.21.15.83:0/2414159698 shutdown_connections 2024-09-21T00:15:28.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.469+0000 7f406bc03740 1 --2- 172.21.15.83:0/2414159698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133eb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.469+0000 7f406bc03740 1 --2- 172.21.15.83:0/2414159698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d42590 0x5634a6133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.469+0000 7f406bc03740 1 --2- 172.21.15.83:0/2414159698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d3a3b0 0x5634a61330c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.469+0000 7f406bc03740 1 -- 172.21.15.83:0/2414159698 >> 172.21.15.83:0/2414159698 conn(0x5634a5d573c0 msgr2=0x5634a60ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:28.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.469+0000 7f406bc03740 1 -- 172.21.15.83:0/2414159698 shutdown_connections 2024-09-21T00:15:28.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.469+0000 7f406bc03740 1 -- 172.21.15.83:0/2414159698 wait complete. 2024-09-21T00:15:28.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.470+0000 7f406bc03740 1 -- start start 2024-09-21T00:15:28.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.470+0000 7f406bc03740 1 Processor -- start 2024-09-21T00:15:28.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.471+0000 7f406bc03740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d3a3b0 0x5634a6165800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.471+0000 7f406bc03740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d42590 0x5634a60ff800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.471+0000 7f406bc03740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.471+0000 7f406bc03740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5634a6105590 con 0x5634a5d63270 2024-09-21T00:15:28.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.471+0000 7f406bc03740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5634a612a620 con 0x5634a5d3a3b0 2024-09-21T00:15:28.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.471+0000 7f406bc03740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5634a615de40 con 0x5634a5d42590 2024-09-21T00:15:28.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.471+0000 7f406bc03740 10 client.0 _ll_register_callbacks cb 0x7f405800a770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:15:28.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f405e800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f405e800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43382/0 (socket says 172.21.15.83:43382) 2024-09-21T00:15:28.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f405de00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d3a3b0 0x5634a6165800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f405e800640 1 -- 172.21.15.83:0/4040492410 learned_addr learned my addr 172.21.15.83:0/4040492410 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:28.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f4055400640 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d42590 0x5634a60ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f405e800640 1 -- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d42590 msgr2=0x5634a60ff800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:28.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f405e800640 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d42590 0x5634a60ff800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f405e800640 1 -- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d3a3b0 msgr2=0x5634a6165800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:28.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f405e800640 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d3a3b0 0x5634a6165800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f405e800640 1 -- 172.21.15.83:0/4040492410 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634a61cf490 con 0x5634a5d63270 2024-09-21T00:15:28.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f405e800640 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4058000f60 tx=0x7f405801f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c96fe28a7c8e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:28.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.472+0000 7f4042a00640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f4042a00640 1 -- 172.21.15.83:0/4040492410 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405802e030 con 0x5634a5d63270 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f4042a00640 1 -- 172.21.15.83:0/4040492410 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f4058011d10 con 0x5634a5d63270 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f406bc03740 1 -- 172.21.15.83:0/4040492410 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40580168b0 con 0x5634a5d63270 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f4042a00640 1 -- 172.21.15.83:0/4040492410 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f405801a040 con 0x5634a5d63270 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f406bc03740 10 client.5214 fetch_fsmap learned FSMap version 18 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f406bc03740 1 -- 172.21.15.83:0/4040492410 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5634a61d00e0 con 0x5634a5d63270 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f4042a00640 1 -- 172.21.15.83:0/4040492410 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40580168b0 con 0x5634a5d63270 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f4042a00640 1 -- 172.21.15.83:0/4040492410 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f4058028030 con 0x5634a5d63270 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f406bc03740 10 client.5214 fetch_fsmap finished waiting for FSMap version 18 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f406bc03740 10 client.5214 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f406bc03740 20 client.5214 populate_metadata read hostname 'smithi083' 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f406bc03740 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:6835/1450693530,v1:172.21.15.142:6837/1450693530] conn(0x5634a61d2ce0 0x5634a61d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f406bc03740 4 client.5214 mds_command: new command op to 4918 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:15:28.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.473+0000 7f406bc03740 1 -- 172.21.15.83:0/4040492410 --> [v2:172.21.15.142:6835/1450693530,v1:172.21.15.142:6837/1450693530] -- command(tid 0: {"prefix": "status"}) -- 0x5634a607afd0 con 0x5634a61d2ce0 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.474+0000 7f405de00640 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:6835/1450693530,v1:172.21.15.142:6837/1450693530] conn(0x5634a61d2ce0 0x5634a61d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.474+0000 7f405de00640 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:6835/1450693530,v1:172.21.15.142:6837/1450693530] conn(0x5634a61d2ce0 0x5634a61d05a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b031eaecf9a7f16e server_cookie=88eee4e454312de8 in_seq=0 out_seq=0 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.474+0000 7f4042a00640 10 client.5214 ms_handle_connect on v2:172.21.15.142:6835/1450693530 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f4042a00640 1 -- 172.21.15.83:0/4040492410 <== mds.0 v2:172.21.15.142:6835/1450693530 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5634a607afd0 con 0x5634a61d2ce0 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f4042a00640 10 client.5214 handle_command_reply: tid=0 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 client.5214 shutdown 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 -- 172.21.15.83:0/4040492410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 msgr2=0x5634a6133950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4058000f60 tx=0x7f405801f6f0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 -- 172.21.15.83:0/4040492410 shutdown_connections 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:6835/1450693530,v1:172.21.15.142:6837/1450693530] conn(0x5634a61d2ce0 0x5634a61d05a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5634a5d63270 0x5634a6133950 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5634a5d42590 0x5634a60ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 --2- 172.21.15.83:0/4040492410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5634a5d3a3b0 0x5634a6165800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f4042a00640 0 client.5214 ms_handle_reset on v2:172.21.15.142:6835/1450693530 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 -- 172.21.15.83:0/4040492410 >> 172.21.15.83:0/4040492410 conn(0x5634a5d573c0 msgr2=0x5634a6147e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 -- 172.21.15.83:0/4040492410 shutdown_connections 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 1 -- 172.21.15.83:0/4040492410 wait complete. 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.475+0000 7f406bc03740 20 client.5214 trim_cache size 0 max 16384 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "d4df3382-b453-41c4-9497-6203e3b4e46e", 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4918, 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-21T00:15:28.479 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-21T00:15:28.480 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 11.626819682000001, 2024-09-21T00:15:28.480 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 18, 2024-09-21T00:15:28.480 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 41, 2024-09-21T00:15:28.480 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 41, 2024-09-21T00:15:28.480 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 19.473418357 2024-09-21T00:15:28.480 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 -- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f403c078bc0 msgr2=0x7f403c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f403c078bc0 0x7f403c07b0d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4050009890 tx=0x7f4050008040 comp rx=0 tx=0).stop 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 -- 172.21.15.83:0/4029899277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40600cf6d0 msgr2=0x7f40601f62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40600cf6d0 0x7f40601f62f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4048000c00 tx=0x7f40480039e0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 -- 172.21.15.83:0/4029899277 shutdown_connections 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f403c078bc0 0x7f403c07b0d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4060160420 0x7f406015af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40600cf6d0 0x7f40601f62f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 --2- 172.21.15.83:0/4029899277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40600cc0e0 0x7f4060140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 -- 172.21.15.83:0/4029899277 >> 172.21.15.83:0/4029899277 conn(0x7f40600d05c0 msgr2=0x7f406006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 -- 172.21.15.83:0/4029899277 shutdown_connections 2024-09-21T00:15:28.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.476+0000 7f405f200640 1 -- 172.21.15.83:0/4029899277 wait complete. 2024-09-21T00:15:28.498 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T00:15:28.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.757+0000 7f995aa00640 1 -- 172.21.15.83:0/403662214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9954070030 msgr2=0x7f995406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.757+0000 7f995aa00640 1 --2- 172.21.15.83:0/403662214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9954070030 0x7f995406ddf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f994000b330 tx=0x7f994002ad90 comp rx=0 tx=0).stop 2024-09-21T00:15:28.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.757+0000 7f995aa00640 1 -- 172.21.15.83:0/403662214 shutdown_connections 2024-09-21T00:15:28.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.757+0000 7f995aa00640 1 --2- 172.21.15.83:0/403662214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9954070030 0x7f995406ddf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.757+0000 7f995aa00640 1 -- 172.21.15.83:0/403662214 >> 172.21.15.83:0/403662214 conn(0x7f99540cca40 msgr2=0x7f99540cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:28.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.757+0000 7f995aa00640 1 -- 172.21.15.83:0/403662214 shutdown_connections 2024-09-21T00:15:28.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.757+0000 7f995aa00640 1 -- 172.21.15.83:0/403662214 wait complete. 2024-09-21T00:15:28.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.759+0000 7f995aa00640 1 Processor -- start 2024-09-21T00:15:28.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.759+0000 7f995aa00640 1 -- start start 2024-09-21T00:15:28.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.760+0000 7f995aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995406e330 0x7f995409c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f995aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9954070030 0x7f99541f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f995aa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9954074d90 0x7f99540a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f995aa00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9954071000 con 0x7f9954074d90 2024-09-21T00:15:28.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f995aa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9954070e80 con 0x7f9954070030 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f995aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f99540ce2a0 con 0x7f995406e330 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9958a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9954074d90 0x7f99540a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9958a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9954074d90 0x7f99540a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43408/0 (socket says 172.21.15.83:43408) 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9958a00640 1 -- 172.21.15.83:0/3246619750 learned_addr learned my addr 172.21.15.83:0/3246619750 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9953400640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9954070030 0x7f99541f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9953e00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995406e330 0x7f995409c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9958a00640 1 -- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995406e330 msgr2=0x7f995409c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9958a00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995406e330 0x7f995409c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9958a00640 1 -- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9954070030 msgr2=0x7f99541f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9958a00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9954070030 0x7f99541f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9958a00640 1 -- 172.21.15.83:0/3246619750 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995409aa80 con 0x7f9954074d90 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9953e00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995406e330 0x7f995409c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.761+0000 7f9953400640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9954070030 0x7f99541f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:28.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.762+0000 7f9958a00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9954074d90 0x7f99540a0590 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c730 tx=0x7f994c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:28.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.762+0000 7f994be00640 1 -- 172.21.15.83:0/3246619750 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c003b70 con 0x7f9954074d90 2024-09-21T00:15:28.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.762+0000 7f994be00640 1 -- 172.21.15.83:0/3246619750 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f994c003d30 con 0x7f9954074d90 2024-09-21T00:15:28.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.762+0000 7f995aa00640 1 -- 172.21.15.83:0/3246619750 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995409acf0 con 0x7f9954074d90 2024-09-21T00:15:28.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.762+0000 7f994be00640 1 -- 172.21.15.83:0/3246619750 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c0052d0 con 0x7f9954074d90 2024-09-21T00:15:28.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.762+0000 7f995aa00640 1 -- 172.21.15.83:0/3246619750 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f995409b2b0 con 0x7f9954074d90 2024-09-21T00:15:28.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.763+0000 7f995aa00640 1 -- 172.21.15.83:0/3246619750 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99540cb1a0 con 0x7f9954074d90 2024-09-21T00:15:28.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.764+0000 7f994be00640 1 -- 172.21.15.83:0/3246619750 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f994c005680 con 0x7f9954074d90 2024-09-21T00:15:28.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.765+0000 7f994be00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9934078b90 0x7f993407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:28.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.765+0000 7f994be00640 1 -- 172.21.15.83:0/3246619750 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f994c09ae30 con 0x7f9954074d90 2024-09-21T00:15:28.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.766+0000 7f9953e00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9934078b90 0x7f993407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:28.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.766+0000 7f9953e00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9934078b90 0x7f993407b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9944007fd0 tx=0x7f9944009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.770+0000 7f994be00640 1 -- 172.21.15.83:0/3246619750 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f99540cb1a0 con 0x7f9954074d90 2024-09-21T00:15:28.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.995+0000 7f995aa00640 1 -- 172.21.15.83:0/3246619750 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f995406ddf0 con 0x7f9954074d90 2024-09-21T00:15:28.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.995+0000 7f994be00640 1 -- 172.21.15.83:0/3246619750 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f994c0630d0 con 0x7f9954074d90 2024-09-21T00:15:28.997 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T00:15:28.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 -- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9934078b90 msgr2=0x7f993407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9934078b90 0x7f993407b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9944007fd0 tx=0x7f9944009040 comp rx=0 tx=0).stop 2024-09-21T00:15:28.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 -- 172.21.15.83:0/3246619750 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9954074d90 msgr2=0x7f99540a0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:28.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9954074d90 0x7f99540a0590 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c730 tx=0x7f994c00cbf0 comp rx=0 tx=0).stop 2024-09-21T00:15:28.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 -- 172.21.15.83:0/3246619750 shutdown_connections 2024-09-21T00:15:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9934078b90 0x7f993407b0a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9954074d90 0x7f99540a0590 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9954070030 0x7f99541f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 --2- 172.21.15.83:0/3246619750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995406e330 0x7f995409c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 -- 172.21.15.83:0/3246619750 >> 172.21.15.83:0/3246619750 conn(0x7f99540cca40 msgr2=0x7f9954159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 -- 172.21.15.83:0/3246619750 shutdown_connections 2024-09-21T00:15:29.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:28.998+0000 7f995aa00640 1 -- 172.21.15.83:0/3246619750 wait complete. 2024-09-21T00:15:29.021 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T00:15:29.022 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:15:29.022 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-09-21T00:15:29.022 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T00:15:29.022 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:15:29.022 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T00:15:29.022 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T00:15:29.022 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:15:29.022 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:15:29.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:29.022 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-09-21T00:15:29.058 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:15:29.058 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:15:29.058 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:15:29.058 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:15:29.058 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-09-21T00:15:29.058 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42647sec preferred_lft 42647sec 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2024-09-21T00:15:29.059 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 9a:d0:a5:be:1f:c7 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::dc71:dfff:fe34:5f84/64 scope link 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether fe:84:23:45:d0:de brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::fc84:23ff:fe45:d0de/64 scope link 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 9a:d0:a5:be:1f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::98d0:a5ff:febe:1fc7/64 scope link 2024-09-21T00:15:29.060 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:15:29.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:29.061 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:15:29.152 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-09-21T00:15:29.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:29.156 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-09-21T00:15:29.192 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-09-21T00:15:29.192 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:15:29.192 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T00:15:29.192 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T00:15:29.192 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:15:29.194 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:15:29.194 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T00:15:29.195 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T00:15:29.195 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T00:15:29.195 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T00:15:29.195 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T00:15:29.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:15:29.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:15:29.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:29.391 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T00:15:29.427 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T00:15:29.427 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T00:15:29.427 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:15:29.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:29.427 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-09-21T00:15:29.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:15:29.523 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T00:15:29.558 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:15:29.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:15:29.559 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:15:29.633 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T00:15:29.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:29.634 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T00:15:29.826 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T00:15:29.826 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T00:15:29.826 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2024-09-21T00:15:29.846 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T00:15:29.846 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T00:15:29.847 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2024-09-21T00:15:29.847 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.83:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-09-21T00:15:29.847 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T00:15:29.877 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T00:15:29.877 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T00:15:29.877 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2024-09-21T00:15:29.877 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.83:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-09-21T00:15:29.877 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T00:15:29.877 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.83:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-09-21T00:15:29.878 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.83:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-09-21T00:15:29.878 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=d4df3382-b453-41c4-9497-6203e3b4e46e" will pass to kernel 2024-09-21T00:15:29.879 INFO:teuthology.orchestra.run.smithi083.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T00:15:29.879 INFO:teuthology.orchestra.run.smithi083.stdout: You just mounted a file system that supports labels which does not 2024-09-21T00:15:29.879 INFO:teuthology.orchestra.run.smithi083.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T00:15:29.879 INFO:teuthology.orchestra.run.smithi083.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T00:15:29.879 INFO:teuthology.orchestra.run.smithi083.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T00:15:29.882 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T00:15:29.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:29.882 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:15:29.940 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:15:30.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:15:30.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:15:30.039 INFO:teuthology.orchestra.run.smithi083.stdout:client5226 2024-09-21T00:15:30.040 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:15:30.040 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:30.075 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:15:30.076 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> stdin-killer -- python3 -c ' 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> import uuid 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> n = 1 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> create_hard_links = False 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> if 0 > 0: 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> create_hard_links = True 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> path = "/home/ubuntu/cephtest/mnt.0/file_on_fs" 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> dpath = os.path.dirname(path) 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> fnameprefix = os.path.basename(path) 2024-09-21T00:15:30.153 DEBUG:teuthology.orchestra.run.smithi083:> os.makedirs(dpath, exist_ok=True) 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> try: 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> for i in range(n): 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> f.write(f"{i}") 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> if True: 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> f.flush() 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> os.fsync(f.fileno()) 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> if False: 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> os.unlink(fpath) 2024-09-21T00:15:30.154 DEBUG:teuthology.orchestra.run.smithi083:> if False: 2024-09-21T00:15:30.155 DEBUG:teuthology.orchestra.run.smithi083:> os.fsync(dirfd) 2024-09-21T00:15:30.155 DEBUG:teuthology.orchestra.run.smithi083:> if create_hard_links: 2024-09-21T00:15:30.155 DEBUG:teuthology.orchestra.run.smithi083:> for j in range(0): 2024-09-21T00:15:30.155 DEBUG:teuthology.orchestra.run.smithi083:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T00:15:30.155 DEBUG:teuthology.orchestra.run.smithi083:> if False: 2024-09-21T00:15:30.155 DEBUG:teuthology.orchestra.run.smithi083:> os.fsync(dirfd) 2024-09-21T00:15:30.155 DEBUG:teuthology.orchestra.run.smithi083:> finally: 2024-09-21T00:15:30.155 DEBUG:teuthology.orchestra.run.smithi083:> os.close(dirfd) 2024-09-21T00:15:30.155 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-09-21T00:15:30.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:15:30.325 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T00:15:30.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.587+0000 7fd041400640 1 -- 172.21.15.83:0/2176089854 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd020004800 msgr2=0x7fd020004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:30.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.587+0000 7fd041400640 1 --2- 172.21.15.83:0/2176089854 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd020004800 0x7fd020004c10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd028009b20 tx=0x7fd020005830 comp rx=0 tx=0).stop 2024-09-21T00:15:30.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.587+0000 7fd03b200640 1 -- 172.21.15.83:0/2176089854 reap_dead start 2024-09-21T00:15:30.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.587+0000 7fd041400640 1 -- 172.21.15.83:0/2176089854 shutdown_connections 2024-09-21T00:15:30.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.587+0000 7fd041400640 1 -- 172.21.15.83:0/2176089854 >> 172.21.15.83:0/2176089854 conn(0x7fd03c0b1b90 msgr2=0x7fd03c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:30.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.588+0000 7fd041400640 1 -- 172.21.15.83:0/2176089854 shutdown_connections 2024-09-21T00:15:30.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.588+0000 7fd041400640 1 -- 172.21.15.83:0/2176089854 wait complete. 2024-09-21T00:15:30.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.590+0000 7fd041400640 1 Processor -- start 2024-09-21T00:15:30.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.590+0000 7fd041400640 1 -- start start 2024-09-21T00:15:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.591+0000 7fd041400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd020004800 0x7fd03c158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.591+0000 7fd041400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd03c0b4c60 0x7fd03c1f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.591+0000 7fd041400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd03c0af280 0x7fd03c1f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.591+0000 7fd041400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c070d20 con 0x7fd03c0b4c60 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.591+0000 7fd041400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c070ba0 con 0x7fd03c0af280 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.591+0000 7fd041400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd03c072d90 con 0x7fd020004800 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd039e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd03c0b4c60 0x7fd03c1f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd039e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd03c0b4c60 0x7fd03c1f87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43428/0 (socket says 172.21.15.83:43428) 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd039e00640 1 -- 172.21.15.83:0/3604633570 learned_addr learned my addr 172.21.15.83:0/3604633570 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd03a800640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd020004800 0x7fd03c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd03b200640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd03c0af280 0x7fd03c1f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd039e00640 1 -- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd020004800 msgr2=0x7fd03c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd039e00640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd020004800 0x7fd03c158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd039e00640 1 -- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd03c0af280 msgr2=0x7fd03c1f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd039e00640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd03c0af280 0x7fd03c1f8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd039e00640 1 -- 172.21.15.83:0/3604633570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03c1f9260 con 0x7fd03c0b4c60 2024-09-21T00:15:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.592+0000 7fd039e00640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd03c0b4c60 0x7fd03c1f87e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd028036040 tx=0x7fd028033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.593+0000 7fd032a00640 1 -- 172.21.15.83:0/3604633570 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028043070 con 0x7fd03c0b4c60 2024-09-21T00:15:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.593+0000 7fd032a00640 1 -- 172.21.15.83:0/3604633570 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd028004320 con 0x7fd03c0b4c60 2024-09-21T00:15:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.593+0000 7fd032a00640 1 -- 172.21.15.83:0/3604633570 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028038040 con 0x7fd03c0b4c60 2024-09-21T00:15:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.593+0000 7fd041400640 1 -- 172.21.15.83:0/3604633570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03c0b41c0 con 0x7fd03c0b4c60 2024-09-21T00:15:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.593+0000 7fd041400640 1 -- 172.21.15.83:0/3604633570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03c15d0a0 con 0x7fd03c0b4c60 2024-09-21T00:15:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.594+0000 7fd041400640 1 -- 172.21.15.83:0/3604633570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03c0cf290 con 0x7fd03c0b4c60 2024-09-21T00:15:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.595+0000 7fd032a00640 1 -- 172.21.15.83:0/3604633570 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd02802b8a0 con 0x7fd03c0b4c60 2024-09-21T00:15:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.596+0000 7fd032a00640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd01c078b90 0x7fd01c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.597+0000 7fd032a00640 1 -- 172.21.15.83:0/3604633570 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd0280bb5c0 con 0x7fd03c0b4c60 2024-09-21T00:15:30.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.597+0000 7fd03a800640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd01c078b90 0x7fd01c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:30.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.598+0000 7fd03a800640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd01c078b90 0x7fd01c07b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd02c001eb0 tx=0x7fd02c006040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.601+0000 7fd032a00640 1 -- 172.21.15.83:0/3604633570 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd028083180 con 0x7fd03c0b4c60 2024-09-21T00:15:30.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.826+0000 7fd041400640 1 -- 172.21.15.83:0/3604633570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd03c0b4390 con 0x7fd03c0b4c60 2024-09-21T00:15:30.828 INFO:tasks.ceph.mon.a.smithi083.stderr:2024-09-21T00:15:30.827+0000 7f6fcde00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:15:30.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.829+0000 7fd032a00640 1 -- 172.21.15.83:0/3604633570 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fd03c0b4390 con 0x7fd03c0b4c60 2024-09-21T00:15:30.830 INFO:teuthology.orchestra.run.smithi083.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T00:15:30.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 -- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd01c078b90 msgr2=0x7fd01c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:30.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd01c078b90 0x7fd01c07b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd02c001eb0 tx=0x7fd02c006040 comp rx=0 tx=0).stop 2024-09-21T00:15:30.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 -- 172.21.15.83:0/3604633570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd03c0b4c60 msgr2=0x7fd03c1f87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd03c0b4c60 0x7fd03c1f87e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd028036040 tx=0x7fd028033670 comp rx=0 tx=0).stop 2024-09-21T00:15:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 -- 172.21.15.83:0/3604633570 shutdown_connections 2024-09-21T00:15:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd01c078b90 0x7fd01c07b0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd03c0af280 0x7fd03c1f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd03c0b4c60 0x7fd03c1f87e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 --2- 172.21.15.83:0/3604633570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd020004800 0x7fd03c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 -- 172.21.15.83:0/3604633570 >> 172.21.15.83:0/3604633570 conn(0x7fd03c0b1b90 msgr2=0x7fd03c0cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 -- 172.21.15.83:0/3604633570 shutdown_connections 2024-09-21T00:15:30.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:30.832+0000 7fd041400640 1 -- 172.21.15.83:0/3604633570 wait complete. 2024-09-21T00:15:30.841 INFO:tasks.ceph.mds.d.smithi142.stderr: -2291> 2024-09-21T00:15:20.714+0000 7f48a1800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T00:15:30.859 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T00:15:30.961 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-09-21T00:15:31.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.082+0000 7fa7f1c00640 1 -- 172.21.15.83:0/2090271993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7ec06e500 msgr2=0x7fa7ec0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:31.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.082+0000 7fa7f1c00640 1 --2- 172.21.15.83:0/2090271993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7ec06e500 0x7fa7ec0ce510 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec075240 tx=0x7fa7e402aa30 comp rx=0 tx=0).stop 2024-09-21T00:15:31.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.082+0000 7fa7f1c00640 1 -- 172.21.15.83:0/2090271993 shutdown_connections 2024-09-21T00:15:31.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.082+0000 7fa7f1c00640 1 --2- 172.21.15.83:0/2090271993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7ec06e500 0x7fa7ec0ce510 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:31.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.082+0000 7fa7f1c00640 1 --2- 172.21.15.83:0/2090271993 >> v2:172.21.15.142:3300/0 conn(0x7fa7ec0cc530 0x7fa7ec15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:31.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.082+0000 7fa7f1c00640 1 -- 172.21.15.83:0/2090271993 >> 172.21.15.83:0/2090271993 conn(0x7fa7ec0b1b90 msgr2=0x7fa7ec0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:31.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.082+0000 7fa7f1c00640 1 -- 172.21.15.83:0/2090271993 shutdown_connections 2024-09-21T00:15:31.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.082+0000 7fa7f1c00640 1 -- 172.21.15.83:0/2090271993 wait complete. 2024-09-21T00:15:31.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.084+0000 7fa7f1c00640 1 Processor -- start 2024-09-21T00:15:31.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.085+0000 7fa7f1c00640 1 -- start start 2024-09-21T00:15:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.086+0000 7fa7f1c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7ec0af5b0 0x7fa7ec161f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.086+0000 7fa7f1c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7ec0cc530 0x7fa7ec15d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.086+0000 7fa7f1c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7ec15dc50 0x7fa7ec0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.086+0000 7fa7f1c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec0cec10 con 0x7fa7ec15dc50 2024-09-21T00:15:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.086+0000 7fa7f1c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec0cea90 con 0x7fa7ec0cc530 2024-09-21T00:15:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.086+0000 7fa7f1c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa7ec0ced90 con 0x7fa7ec0af5b0 2024-09-21T00:15:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.086+0000 7fa7eb400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7ec15dc50 0x7fa7ec0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.086+0000 7fa7eb400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7ec15dc50 0x7fa7ec0b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43432/0 (socket says 172.21.15.83:43432) 2024-09-21T00:15:31.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.087+0000 7fa7eb400640 1 -- 172.21.15.83:0/4196259707 learned_addr learned my addr 172.21.15.83:0/4196259707 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:31.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.087+0000 7fa7eaa00640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7ec0af5b0 0x7fa7ec161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:31.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.087+0000 7fa7ea000640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7ec0cc530 0x7fa7ec15d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:31.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.087+0000 7fa7eb400640 1 -- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7ec0af5b0 msgr2=0x7fa7ec161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:31.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.087+0000 7fa7eb400640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7ec0af5b0 0x7fa7ec161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:31.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.087+0000 7fa7eb400640 1 -- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7ec0cc530 msgr2=0x7fa7ec15d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:31.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.087+0000 7fa7eb400640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7ec0cc530 0x7fa7ec15d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:31.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.087+0000 7fa7eb400640 1 -- 172.21.15.83:0/4196259707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ec1611a0 con 0x7fa7ec15dc50 2024-09-21T00:15:31.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.087+0000 7fa7eb400640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7ec15dc50 0x7fa7ec0b3330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4005fd0 tx=0x7fa7e4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:31.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.087+0000 7fa7e2a00640 1 -- 172.21.15.83:0/4196259707 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4033050 con 0x7fa7ec15dc50 2024-09-21T00:15:31.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.088+0000 7fa7e2a00640 1 -- 172.21.15.83:0/4196259707 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7e40045f0 con 0x7fa7ec15dc50 2024-09-21T00:15:31.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.088+0000 7fa7f1c00640 1 -- 172.21.15.83:0/4196259707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ec161480 con 0x7fa7ec15dc50 2024-09-21T00:15:31.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.088+0000 7fa7e2a00640 1 -- 172.21.15.83:0/4196259707 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4038450 con 0x7fa7ec15dc50 2024-09-21T00:15:31.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.088+0000 7fa7f1c00640 1 -- 172.21.15.83:0/4196259707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ec15e430 con 0x7fa7ec15dc50 2024-09-21T00:15:31.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.089+0000 7fa7f1c00640 1 -- 172.21.15.83:0/4196259707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ec15ee20 con 0x7fa7ec15dc50 2024-09-21T00:15:31.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.090+0000 7fa7e2a00640 1 -- 172.21.15.83:0/4196259707 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa7e4036070 con 0x7fa7ec15dc50 2024-09-21T00:15:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.091+0000 7fa7e2a00640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa7cc078b90 0x7fa7cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.091+0000 7fa7e2a00640 1 -- 172.21.15.83:0/4196259707 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7fa7e40bc470 con 0x7fa7ec15dc50 2024-09-21T00:15:31.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.091+0000 7fa7eaa00640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa7cc078b90 0x7fa7cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:31.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.092+0000 7fa7eaa00640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa7cc078b90 0x7fa7cc07b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc005fd0 tx=0x7fa7dc00a250 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:31.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.095+0000 7fa7e2a00640 1 -- 172.21.15.83:0/4196259707 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa7e4084070 con 0x7fa7ec15dc50 2024-09-21T00:15:31.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.318+0000 7fa7f1c00640 1 -- 172.21.15.83:0/4196259707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa7ec0ce510 con 0x7fa7ec15dc50 2024-09-21T00:15:31.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.938+0000 7fa7e2a00640 1 -- 172.21.15.83:0/4196259707 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fa7e4088aa0 con 0x7fa7ec15dc50 2024-09-21T00:15:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.940+0000 7fa7f1c00640 1 -- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa7cc078b90 msgr2=0x7fa7cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.940+0000 7fa7f1c00640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa7cc078b90 0x7fa7cc07b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc005fd0 tx=0x7fa7dc00a250 comp rx=0 tx=0).stop 2024-09-21T00:15:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.940+0000 7fa7f1c00640 1 -- 172.21.15.83:0/4196259707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7ec15dc50 msgr2=0x7fa7ec0b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.940+0000 7fa7f1c00640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7ec15dc50 0x7fa7ec0b3330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4005fd0 tx=0x7fa7e4003f90 comp rx=0 tx=0).stop 2024-09-21T00:15:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.940+0000 7fa7f1c00640 1 -- 172.21.15.83:0/4196259707 shutdown_connections 2024-09-21T00:15:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.940+0000 7fa7f1c00640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa7cc078b90 0x7fa7cc07b0a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.940+0000 7fa7f1c00640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7ec15dc50 0x7fa7ec0b3330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.940+0000 7fa7f1c00640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7ec0cc530 0x7fa7ec15d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.940+0000 7fa7f1c00640 1 --2- 172.21.15.83:0/4196259707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7ec0af5b0 0x7fa7ec161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.940+0000 7fa7f1c00640 1 -- 172.21.15.83:0/4196259707 >> 172.21.15.83:0/4196259707 conn(0x7fa7ec0b1b90 msgr2=0x7fa7ec06f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.941+0000 7fa7f1c00640 1 -- 172.21.15.83:0/4196259707 shutdown_connections 2024-09-21T00:15:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:31.941+0000 7fa7f1c00640 1 -- 172.21.15.83:0/4196259707 wait complete. 2024-09-21T00:15:31.963 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --recover --force --fscid 2 2024-09-21T00:15:32.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.190+0000 7f99ada00640 1 -- 172.21.15.83:0/3987655800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99a8073dd0 msgr2=0x7f99a806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:32.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.190+0000 7f99ada00640 1 --2- 172.21.15.83:0/3987655800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99a8073dd0 0x7f99a806ddf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9990009830 tx=0x7f999002a510 comp rx=0 tx=0).stop 2024-09-21T00:15:32.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.191+0000 7f99ada00640 1 -- 172.21.15.83:0/3987655800 shutdown_connections 2024-09-21T00:15:32.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.191+0000 7f99ada00640 1 --2- 172.21.15.83:0/3987655800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99a8073dd0 0x7f99a806ddf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:32.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.191+0000 7f99ada00640 1 -- 172.21.15.83:0/3987655800 >> 172.21.15.83:0/3987655800 conn(0x7f99a80cca40 msgr2=0x7f99a80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:32.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.191+0000 7f99ada00640 1 -- 172.21.15.83:0/3987655800 shutdown_connections 2024-09-21T00:15:32.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.191+0000 7f99ada00640 1 -- 172.21.15.83:0/3987655800 wait complete. 2024-09-21T00:15:32.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.193+0000 7f99ada00640 1 Processor -- start 2024-09-21T00:15:32.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.193+0000 7f99ada00640 1 -- start start 2024-09-21T00:15:32.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.194+0000 7f99ada00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99a806e330 0x7f99a81f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:32.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.194+0000 7f99ada00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a8073dd0 0x7f99a80b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:32.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99ada00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99a8074cb0 0x7f99a80c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:32.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99ada00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f99a806f670 con 0x7f99a8074cb0 2024-09-21T00:15:32.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99ada00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f99a806f4f0 con 0x7f99a8073dd0 2024-09-21T00:15:32.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99ada00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f99a806f7f0 con 0x7f99a806e330 2024-09-21T00:15:32.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99a7400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99a8074cb0 0x7f99a80c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99a7400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99a8074cb0 0x7f99a80c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33404/0 (socket says 172.21.15.83:33404) 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99a7400640 1 -- 172.21.15.83:0/1062207941 learned_addr learned my addr 172.21.15.83:0/1062207941 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f999e000640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a8073dd0 0x7f99a80b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99a6a00640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99a806e330 0x7f99a81f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99a7400640 1 -- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99a806e330 msgr2=0x7f99a81f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99a7400640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99a806e330 0x7f99a81f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99a7400640 1 -- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a8073dd0 msgr2=0x7f99a80b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99a7400640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a8073dd0 0x7f99a80b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99a7400640 1 -- 172.21.15.83:0/1062207941 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a81f7230 con 0x7f99a8074cb0 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.195+0000 7f99a6a00640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99a806e330 0x7f99a81f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.196+0000 7f99a7400640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99a8074cb0 0x7f99a80c9550 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99a000b9e0 tx=0x7f99a000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:32.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.196+0000 7f999f400640 1 -- 172.21.15.83:0/1062207941 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0003b70 con 0x7f99a8074cb0 2024-09-21T00:15:32.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.196+0000 7f999f400640 1 -- 172.21.15.83:0/1062207941 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99a0003e00 con 0x7f99a8074cb0 2024-09-21T00:15:32.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.196+0000 7f999f400640 1 -- 172.21.15.83:0/1062207941 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a000cb80 con 0x7f99a8074cb0 2024-09-21T00:15:32.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.196+0000 7f99ada00640 1 -- 172.21.15.83:0/1062207941 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a80b2eb0 con 0x7f99a8074cb0 2024-09-21T00:15:32.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.196+0000 7f99ada00640 1 -- 172.21.15.83:0/1062207941 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a80b5c90 con 0x7f99a8074cb0 2024-09-21T00:15:32.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.197+0000 7f99ada00640 1 -- 172.21.15.83:0/1062207941 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a81f7400 con 0x7f99a8074cb0 2024-09-21T00:15:32.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.198+0000 7f999f400640 1 -- 172.21.15.83:0/1062207941 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99a0004000 con 0x7f99a8074cb0 2024-09-21T00:15:32.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.199+0000 7f999f400640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9984078b90 0x7f998407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:32.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.199+0000 7f999f400640 1 -- 172.21.15.83:0/1062207941 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f99a009ad90 con 0x7f99a8074cb0 2024-09-21T00:15:32.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.200+0000 7f99a6a00640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9984078b90 0x7f998407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:32.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.200+0000 7f99a6a00640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9984078b90 0x7f998407b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9998000f60 tx=0x7f9998009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:32.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.204+0000 7f999f400640 1 -- 172.21.15.83:0/1062207941 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f99a0062900 con 0x7f99a8074cb0 2024-09-21T00:15:32.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.424+0000 7f99ada00640 1 -- 172.21.15.83:0/1062207941 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "recover": true, "force": true, "fscid": 2} v 0) -- 0x7f99a806acf0 con 0x7f99a8074cb0 2024-09-21T00:15:32.939 INFO:tasks.ceph.mon.a.smithi083.stderr:2024-09-21T00:15:32.938+0000 7f6fd1000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:15:32.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.947+0000 7f999f400640 1 -- 172.21.15.83:0/1062207941 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "recover": true, "force": true, "fscid": 2}]=0 new fs with metadata pool 5 and data pool 6 v21) ==== 216+0+0 (secure 0 0 0) 0x7f99a806acf0 con 0x7f99a8074cb0 2024-09-21T00:15:32.949 INFO:teuthology.orchestra.run.smithi083.stderr:new fs with metadata pool 5 and data pool 6 2024-09-21T00:15:32.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 -- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9984078b90 msgr2=0x7f998407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:32.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9984078b90 0x7f998407b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9998000f60 tx=0x7f9998009040 comp rx=0 tx=0).stop 2024-09-21T00:15:32.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 -- 172.21.15.83:0/1062207941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99a8074cb0 msgr2=0x7f99a80c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:32.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99a8074cb0 0x7f99a80c9550 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99a000b9e0 tx=0x7f99a000bea0 comp rx=0 tx=0).stop 2024-09-21T00:15:32.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 -- 172.21.15.83:0/1062207941 shutdown_connections 2024-09-21T00:15:32.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9984078b90 0x7f998407b0a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:32.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99a8074cb0 0x7f99a80c9550 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:32.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a8073dd0 0x7f99a80b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:32.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 --2- 172.21.15.83:0/1062207941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99a806e330 0x7f99a81f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:32.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 -- 172.21.15.83:0/1062207941 >> 172.21.15.83:0/1062207941 conn(0x7f99a80cca40 msgr2=0x7f99a815b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:32.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 -- 172.21.15.83:0/1062207941 shutdown_connections 2024-09-21T00:15:32.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:32.950+0000 7f99ada00640 1 -- 172.21.15.83:0/1062207941 wait complete. 2024-09-21T00:15:32.973 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-21T00:15:33.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.196+0000 7f95b5000640 1 -- 172.21.15.83:0/1841853720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95b006e270 msgr2=0x7f95b015f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:33.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.196+0000 7f95b5000640 1 --2- 172.21.15.83:0/1841853720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95b006e270 0x7f95b015f550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9598005fd0 tx=0x7f959802a5d0 comp rx=0 tx=0).stop 2024-09-21T00:15:33.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.196+0000 7f95b5000640 1 -- 172.21.15.83:0/1841853720 shutdown_connections 2024-09-21T00:15:33.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.196+0000 7f95b5000640 1 --2- 172.21.15.83:0/1841853720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95b006e270 0x7f95b015f550 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:33.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.196+0000 7f95b5000640 1 --2- 172.21.15.83:0/1841853720 >> v2:172.21.15.142:3300/0 conn(0x7f95b015b0d0 0x7f95b015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:33.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.196+0000 7f95b5000640 1 -- 172.21.15.83:0/1841853720 >> 172.21.15.83:0/1841853720 conn(0x7f95b00cd570 msgr2=0x7f95b00cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:33.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.196+0000 7f95b5000640 1 -- 172.21.15.83:0/1841853720 shutdown_connections 2024-09-21T00:15:33.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.196+0000 7f95b5000640 1 -- 172.21.15.83:0/1841853720 wait complete. 2024-09-21T00:15:33.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.199+0000 7f95b5000640 1 Processor -- start 2024-09-21T00:15:33.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.199+0000 7f95b5000640 1 -- start start 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.200+0000 7f95b5000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95b006e270 0x7f95b014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.200+0000 7f95b5000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95b015b0d0 0x7f95b00ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.200+0000 7f95b5000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b015c480 0x7f95b00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.200+0000 7f95b5000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f95b015ba20 con 0x7f95b015c480 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.200+0000 7f95b5000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f95b015fca0 con 0x7f95b006e270 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.200+0000 7f95b5000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f95b015bba0 con 0x7f95b015b0d0 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95afe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b015c480 0x7f95b00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95afe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b015c480 0x7f95b00aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33420/0 (socket says 172.21.15.83:33420) 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95a6a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95b015b0d0 0x7f95b00ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95afe00640 1 -- 172.21.15.83:0/4205301278 learned_addr learned my addr 172.21.15.83:0/4205301278 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:33.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95af400640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95b006e270 0x7f95b014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:33.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95afe00640 1 -- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95b015b0d0 msgr2=0x7f95b00ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:33.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95afe00640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95b015b0d0 0x7f95b00ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:33.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95afe00640 1 -- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95b006e270 msgr2=0x7f95b014fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:33.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95afe00640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95b006e270 0x7f95b014fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:33.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95afe00640 1 -- 172.21.15.83:0/4205301278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b00adab0 con 0x7f95b015c480 2024-09-21T00:15:33.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.201+0000 7f95afe00640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b015c480 0x7f95b00aedb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f95a800ea70 tx=0x7f95a800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:33.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.202+0000 7f95a7e00640 1 -- 172.21.15.83:0/4205301278 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a800ce40 con 0x7f95b015c480 2024-09-21T00:15:33.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.202+0000 7f95a7e00640 1 -- 172.21.15.83:0/4205301278 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95a8004c10 con 0x7f95b015c480 2024-09-21T00:15:33.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.202+0000 7f95a7e00640 1 -- 172.21.15.83:0/4205301278 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8005020 con 0x7f95b015c480 2024-09-21T00:15:33.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.202+0000 7f95b5000640 1 -- 172.21.15.83:0/4205301278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b00add90 con 0x7f95b015c480 2024-09-21T00:15:33.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.202+0000 7f95b5000640 1 -- 172.21.15.83:0/4205301278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b00ae350 con 0x7f95b015c480 2024-09-21T00:15:33.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.203+0000 7f95b5000640 1 -- 172.21.15.83:0/4205301278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b015c020 con 0x7f95b015c480 2024-09-21T00:15:33.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.204+0000 7f95a7e00640 1 -- 172.21.15.83:0/4205301278 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95a80051c0 con 0x7f95b015c480 2024-09-21T00:15:33.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.205+0000 7f95a7e00640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f958c078b90 0x7f958c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:33.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.205+0000 7f95a7e00640 1 -- 172.21.15.83:0/4205301278 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f95a809bc30 con 0x7f95b015c480 2024-09-21T00:15:33.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.206+0000 7f95af400640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f958c078b90 0x7f958c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:33.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.206+0000 7f95af400640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f958c078b90 0x7f958c07b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f95b00cfd20 tx=0x7f95a0009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:33.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.209+0000 7f95a7e00640 1 -- 172.21.15.83:0/4205301278 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f95a8063830 con 0x7f95b015c480 2024-09-21T00:15:33.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.431+0000 7f95b5000640 1 -- 172.21.15.83:0/4205301278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f95b015a460 con 0x7f95b015c480 2024-09-21T00:15:33.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.949+0000 7f95a7e00640 1 -- 172.21.15.83:0/4205301278 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v22) ==== 162+0+0 (secure 0 0 0) 0x7f95a8068260 con 0x7f95b015c480 2024-09-21T00:15:33.951 INFO:teuthology.orchestra.run.smithi083.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-21T00:15:33.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 -- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f958c078b90 msgr2=0x7f958c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:33.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f958c078b90 0x7f958c07b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f95b00cfd20 tx=0x7f95a0009040 comp rx=0 tx=0).stop 2024-09-21T00:15:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 -- 172.21.15.83:0/4205301278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b015c480 msgr2=0x7f95b00aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b015c480 0x7f95b00aedb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f95a800ea70 tx=0x7f95a800ef30 comp rx=0 tx=0).stop 2024-09-21T00:15:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 -- 172.21.15.83:0/4205301278 shutdown_connections 2024-09-21T00:15:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f958c078b90 0x7f958c07b0a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b015c480 0x7f95b00aedb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95b015b0d0 0x7f95b00ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 --2- 172.21.15.83:0/4205301278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95b006e270 0x7f95b014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 -- 172.21.15.83:0/4205301278 >> 172.21.15.83:0/4205301278 conn(0x7f95b00cd570 msgr2=0x7f95b0156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 -- 172.21.15.83:0/4205301278 shutdown_connections 2024-09-21T00:15:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:33.952+0000 7f95b5000640 1 -- 172.21.15.83:0/4205301278 wait complete. 2024-09-21T00:15:33.981 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:34.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.199+0000 7f90c0800640 1 -- 172.21.15.83:0/2959849127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90b8073dd0 msgr2=0x7f90b806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:34.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.199+0000 7f90c0800640 1 --2- 172.21.15.83:0/2959849127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90b8073dd0 0x7f90b806ddf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f90a8005fd0 tx=0x7f90a802a680 comp rx=0 tx=0).stop 2024-09-21T00:15:34.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.199+0000 7f90c0800640 1 -- 172.21.15.83:0/2959849127 shutdown_connections 2024-09-21T00:15:34.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.199+0000 7f90c0800640 1 --2- 172.21.15.83:0/2959849127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90b8073dd0 0x7f90b806ddf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:34.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.199+0000 7f90c0800640 1 -- 172.21.15.83:0/2959849127 >> 172.21.15.83:0/2959849127 conn(0x7f90b80cca40 msgr2=0x7f90b80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:34.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.199+0000 7f90c0800640 1 -- 172.21.15.83:0/2959849127 shutdown_connections 2024-09-21T00:15:34.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.199+0000 7f90c0800640 1 -- 172.21.15.83:0/2959849127 wait complete. 2024-09-21T00:15:34.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.201+0000 7f90c0800640 1 Processor -- start 2024-09-21T00:15:34.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.202+0000 7f90c0800640 1 -- start start 2024-09-21T00:15:34.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.203+0000 7f90c0800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90b806e330 0x7f90b80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.203+0000 7f90c0800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b8073dd0 0x7f90b80cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.203+0000 7f90c0800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b8074cb0 0x7f90b80ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.203+0000 7f90c0800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f90b806f670 con 0x7f90b806e330 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.203+0000 7f90c0800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90b806f4f0 con 0x7f90b8073dd0 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.203+0000 7f90c0800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f90b806f7f0 con 0x7f90b8074cb0 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.203+0000 7f90bde00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90b806e330 0x7f90b80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.203+0000 7f90bde00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90b806e330 0x7f90b80b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33442/0 (socket says 172.21.15.83:33442) 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.203+0000 7f90bde00640 1 -- 172.21.15.83:0/4126267408 learned_addr learned my addr 172.21.15.83:0/4126267408 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90bd400640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b8073dd0 0x7f90b80cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90bde00640 1 -- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b8074cb0 msgr2=0x7f90b80ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90be800640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b8074cb0 0x7f90b80ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90bde00640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b8074cb0 0x7f90b80ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90bde00640 1 -- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b8073dd0 msgr2=0x7f90b80cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90bde00640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b8073dd0 0x7f90b80cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90bde00640 1 -- 172.21.15.83:0/4126267408 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b80b1600 con 0x7f90b806e330 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90bd400640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b8073dd0 0x7f90b80cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90be800640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b8074cb0 0x7f90b80ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90bde00640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90b806e330 0x7f90b80b10c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00c370 tx=0x7f90ac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90b2000640 1 -- 172.21.15.83:0/4126267408 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac017070 con 0x7f90b806e330 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.204+0000 7f90b2000640 1 -- 172.21.15.83:0/4126267408 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90ac0053c0 con 0x7f90b806e330 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.205+0000 7f90c0800640 1 -- 172.21.15.83:0/4126267408 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b8157470 con 0x7f90b806e330 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.205+0000 7f90b2000640 1 -- 172.21.15.83:0/4126267408 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac003850 con 0x7f90b806e330 2024-09-21T00:15:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.205+0000 7f90c0800640 1 -- 172.21.15.83:0/4126267408 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b8157a30 con 0x7f90b806e330 2024-09-21T00:15:34.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.206+0000 7f90c0800640 1 -- 172.21.15.83:0/4126267408 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b806ddf0 con 0x7f90b806e330 2024-09-21T00:15:34.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.207+0000 7f90b2000640 1 -- 172.21.15.83:0/4126267408 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90ac01a070 con 0x7f90b806e330 2024-09-21T00:15:34.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.208+0000 7f90b2000640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f909c078bc0 0x7f909c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:34.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.208+0000 7f90b2000640 1 -- 172.21.15.83:0/4126267408 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f90ac09a330 con 0x7f90b806e330 2024-09-21T00:15:34.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.208+0000 7f90bd400640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f909c078bc0 0x7f909c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.209+0000 7f90bd400640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f909c078bc0 0x7f909c07b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f90a8033000 tx=0x7f90a8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.212+0000 7f90b2000640 1 -- 172.21.15.83:0/4126267408 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f90b80b1600 con 0x7f90b806e330 2024-09-21T00:15:34.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.436+0000 7f90c0800640 1 -- 172.21.15.83:0/4126267408 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90b80b5e30 con 0x7f90b806e330 2024-09-21T00:15:34.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.437+0000 7f90b2000640 1 -- 172.21.15.83:0/4126267408 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5216 (secure 0 0 0) 0x7f90b806e740 con 0x7f90b806e330 2024-09-21T00:15:34.438 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:34.438 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"btime":"2024-09-21T00:15:33:953190+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2168701718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2168701718},{"type":"v1","addr":"172.21.15.142:6836","nonce":2168701718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/399437337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":399437337},{"type":"v1","addr":"172.21.15.83:6835","nonce":399437337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4915,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/683491362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":683491362},{"type":"v1","addr":"172.21.15.83:6834","nonce":683491362}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:15:32.426071+0000","modified":"2024-09-21T00:15:33.953174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5119},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5119":{"gid":5119,"name":"d","rank":0,"incarnation":23,"state":"up:replay","state_seq":1,"addr":"172.21.15.142:6837/2876811208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2876811208},{"type":"v1","addr":"172.21.15.142:6837","nonce":2876811208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-21T00:15:34.439 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 23 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.439+0000 7f90c0800640 1 -- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f909c078bc0 msgr2=0x7f909c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.439+0000 7f90c0800640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f909c078bc0 0x7f909c07b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f90a8033000 tx=0x7f90a8004730 comp rx=0 tx=0).stop 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.439+0000 7f90c0800640 1 -- 172.21.15.83:0/4126267408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90b806e330 msgr2=0x7f90b80b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.439+0000 7f90c0800640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90b806e330 0x7f90b80b10c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00c370 tx=0x7f90ac00c830 comp rx=0 tx=0).stop 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.439+0000 7f90c0800640 1 -- 172.21.15.83:0/4126267408 shutdown_connections 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.439+0000 7f90c0800640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f909c078bc0 0x7f909c07b0d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.439+0000 7f90c0800640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b8074cb0 0x7f90b80ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.439+0000 7f90c0800640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b8073dd0 0x7f90b80cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.439+0000 7f90c0800640 1 --2- 172.21.15.83:0/4126267408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90b806e330 0x7f90b80b10c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.439+0000 7f90c0800640 1 -- 172.21.15.83:0/4126267408 >> 172.21.15.83:0/4126267408 conn(0x7f90b80cca40 msgr2=0x7f90b8070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:34.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.440+0000 7f90c0800640 1 -- 172.21.15.83:0/4126267408 shutdown_connections 2024-09-21T00:15:34.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:34.440+0000 7f90c0800640 1 -- 172.21.15.83:0/4126267408 wait complete. 2024-09-21T00:15:34.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T00:15:32.426071+0000', 'modified': '2024-09-21T00:15:33.953174+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5119}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5119': {'gid': 5119, 'name': 'd', 'rank': 0, 'incarnation': 23, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.142:6837/2876811208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 2876811208}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 2876811208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T00:15:34.865 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5119:up:replay 2024-09-21T00:15:35.866 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:36.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.098+0000 7f9817400640 1 -- 172.21.15.83:0/1669118663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f981006e330 msgr2=0x7f981006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:36.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.098+0000 7f9817400640 1 --2- 172.21.15.83:0/1669118663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f981006e330 0x7f981006ede0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f981009e110 tx=0x7f980802a8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:36.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.098+0000 7f9817400640 1 -- 172.21.15.83:0/1669118663 shutdown_connections 2024-09-21T00:15:36.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.098+0000 7f9817400640 1 --2- 172.21.15.83:0/1669118663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f981006e330 0x7f981006ede0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:36.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.098+0000 7f9817400640 1 --2- 172.21.15.83:0/1669118663 >> v2:172.21.15.142:3300/0 conn(0x7f9810073dd0 0x7f981006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:36.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.098+0000 7f9817400640 1 -- 172.21.15.83:0/1669118663 >> 172.21.15.83:0/1669118663 conn(0x7f98100cca40 msgr2=0x7f98100cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:36.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.098+0000 7f9817400640 1 -- 172.21.15.83:0/1669118663 shutdown_connections 2024-09-21T00:15:36.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.098+0000 7f9817400640 1 -- 172.21.15.83:0/1669118663 wait complete. 2024-09-21T00:15:36.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.100+0000 7f9817400640 1 Processor -- start 2024-09-21T00:15:36.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.101+0000 7f9817400640 1 -- start start 2024-09-21T00:15:36.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.102+0000 7f9817400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f981006e330 0x7f98101f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:36.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.102+0000 7f9817400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9810073dd0 0x7f98100b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:36.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.102+0000 7f9817400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9810074cb0 0x7f981015ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:36.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.102+0000 7f9817400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f981006f4a0 con 0x7f981006e330 2024-09-21T00:15:36.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.102+0000 7f9817400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f981006f320 con 0x7f9810074cb0 2024-09-21T00:15:36.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.102+0000 7f9817400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f981006f620 con 0x7f9810073dd0 2024-09-21T00:15:36.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.102+0000 7f9814a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f981006e330 0x7f98101f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.102+0000 7f9814a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f981006e330 0x7f98101f3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33456/0 (socket says 172.21.15.83:33456) 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.102+0000 7f9814a00640 1 -- 172.21.15.83:0/1822399370 learned_addr learned my addr 172.21.15.83:0/1822399370 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f9815400640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9810074cb0 0x7f981015ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f980fe00640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9810073dd0 0x7f98100b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f9814a00640 1 -- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9810073dd0 msgr2=0x7f98100b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f9814a00640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9810073dd0 0x7f98100b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f9814a00640 1 -- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9810074cb0 msgr2=0x7f981015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f9814a00640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9810074cb0 0x7f981015ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f9814a00640 1 -- 172.21.15.83:0/1822399370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981009f5a0 con 0x7f981006e330 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f980fe00640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9810073dd0 0x7f98100b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f9815400640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9810074cb0 0x7f981015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:36.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f9814a00640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f981006e330 0x7f98101f3250 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f980400c3c0 tx=0x7f980400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:36.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f980cc00640 1 -- 172.21.15.83:0/1822399370 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804017070 con 0x7f981006e330 2024-09-21T00:15:36.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f980cc00640 1 -- 172.21.15.83:0/1822399370 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98040035f0 con 0x7f981006e330 2024-09-21T00:15:36.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.103+0000 7f980cc00640 1 -- 172.21.15.83:0/1822399370 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804003a20 con 0x7f981006e330 2024-09-21T00:15:36.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.104+0000 7f9817400640 1 -- 172.21.15.83:0/1822399370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981009f880 con 0x7f981006e330 2024-09-21T00:15:36.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.104+0000 7f9817400640 1 -- 172.21.15.83:0/1822399370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981009fe40 con 0x7f981006e330 2024-09-21T00:15:36.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.105+0000 7f9817400640 1 -- 172.21.15.83:0/1822399370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981006fba0 con 0x7f981006e330 2024-09-21T00:15:36.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.106+0000 7f980cc00640 1 -- 172.21.15.83:0/1822399370 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f980401a070 con 0x7f981006e330 2024-09-21T00:15:36.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.107+0000 7f980cc00640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f97f0078b90 0x7f97f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:36.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.107+0000 7f980cc00640 1 -- 172.21.15.83:0/1822399370 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f980409a1e0 con 0x7f981006e330 2024-09-21T00:15:36.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.108+0000 7f980fe00640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f97f0078b90 0x7f97f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:36.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.108+0000 7f980fe00640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f97f0078b90 0x7f97f007b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9810151870 tx=0x7f97fc005f10 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:36.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.111+0000 7f980cc00640 1 -- 172.21.15.83:0/1822399370 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9804062430 con 0x7f981006e330 2024-09-21T00:15:36.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.332+0000 7f9817400640 1 -- 172.21.15.83:0/1822399370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f981006df50 con 0x7f981006e330 2024-09-21T00:15:36.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.333+0000 7f980cc00640 1 -- 172.21.15.83:0/1822399370 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5216 (secure 0 0 0) 0x7f9804061d30 con 0x7f981006e330 2024-09-21T00:15:36.335 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:36.335 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":25,"btime":"2024-09-21T00:15:35:960868+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2168701718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2168701718},{"type":"v1","addr":"172.21.15.142:6836","nonce":2168701718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/399437337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":399437337},{"type":"v1","addr":"172.21.15.83:6835","nonce":399437337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4915,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/683491362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":683491362},{"type":"v1","addr":"172.21.15.83:6834","nonce":683491362}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:15:32.426071+0000","modified":"2024-09-21T00:15:34.978617+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5119},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5119":{"gid":5119,"name":"d","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.142:6837/2876811208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2876811208},{"type":"v1","addr":"172.21.15.142:6837","nonce":2876811208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-21T00:15:36.335 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 25 2024-09-21T00:15:36.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.335+0000 7f9817400640 1 -- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f97f0078b90 msgr2=0x7f97f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:36.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.335+0000 7f9817400640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f97f0078b90 0x7f97f007b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9810151870 tx=0x7f97fc005f10 comp rx=0 tx=0).stop 2024-09-21T00:15:36.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.335+0000 7f9817400640 1 -- 172.21.15.83:0/1822399370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f981006e330 msgr2=0x7f98101f3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:36.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.335+0000 7f9817400640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f981006e330 0x7f98101f3250 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f980400c3c0 tx=0x7f980400c880 comp rx=0 tx=0).stop 2024-09-21T00:15:36.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.336+0000 7f9817400640 1 -- 172.21.15.83:0/1822399370 shutdown_connections 2024-09-21T00:15:36.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.336+0000 7f9817400640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f97f0078b90 0x7f97f007b0a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:36.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.336+0000 7f9817400640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9810074cb0 0x7f981015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:36.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.336+0000 7f9817400640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9810073dd0 0x7f98100b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:36.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.336+0000 7f9817400640 1 --2- 172.21.15.83:0/1822399370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f981006e330 0x7f98101f3250 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:36.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.336+0000 7f9817400640 1 -- 172.21.15.83:0/1822399370 >> 172.21.15.83:0/1822399370 conn(0x7f98100cca40 msgr2=0x7f98100b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:36.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.336+0000 7f9817400640 1 -- 172.21.15.83:0/1822399370 shutdown_connections 2024-09-21T00:15:36.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:36.336+0000 7f9817400640 1 -- 172.21.15.83:0/1822399370 wait complete. 2024-09-21T00:15:36.764 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T00:15:32.426071+0000', 'modified': '2024-09-21T00:15:34.978617+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5119}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5119': {'gid': 5119, 'name': 'd', 'rank': 0, 'incarnation': 23, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.142:6837/2876811208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 2876811208}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 2876811208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T00:15:36.765 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5119:up:rejoin 2024-09-21T00:15:36.947 INFO:tasks.ceph.mds.d.smithi142.stderr:2024-09-21T00:15:36.946+0000 7f40ddc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T00:15:37.765 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:37.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.994+0000 7fea35400640 1 -- 172.21.15.83:0/2713184231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea300cbc10 msgr2=0x7fea300cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:37.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.994+0000 7fea35400640 1 --2- 172.21.15.83:0/2713184231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea300cbc10 0x7fea300cc020 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009830 tx=0x7fea1c02a520 comp rx=0 tx=0).stop 2024-09-21T00:15:37.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.995+0000 7fea35400640 1 -- 172.21.15.83:0/2713184231 shutdown_connections 2024-09-21T00:15:37.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.995+0000 7fea35400640 1 --2- 172.21.15.83:0/2713184231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea300cbc10 0x7fea300cc020 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:37.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.995+0000 7fea35400640 1 --2- 172.21.15.83:0/2713184231 >> v2:172.21.15.142:3300/0 conn(0x7fea30074cb0 0x7fea30073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:37.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.995+0000 7fea35400640 1 -- 172.21.15.83:0/2713184231 >> 172.21.15.83:0/2713184231 conn(0x7fea300cca40 msgr2=0x7fea300cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:37.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.995+0000 7fea35400640 1 -- 172.21.15.83:0/2713184231 shutdown_connections 2024-09-21T00:15:37.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.995+0000 7fea35400640 1 -- 172.21.15.83:0/2713184231 wait complete. 2024-09-21T00:15:37.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.997+0000 7fea35400640 1 Processor -- start 2024-09-21T00:15:37.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.997+0000 7fea35400640 1 -- start start 2024-09-21T00:15:38.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.998+0000 7fea35400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea3006ddf0 0x7fea301f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.998+0000 7fea35400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea30074cb0 0x7fea3014df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.998+0000 7fea35400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea300cbc10 0x7fea300b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.998+0000 7fea35400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fea3006f360 con 0x7fea30074cb0 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.998+0000 7fea35400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fea3006f1e0 con 0x7fea300cbc10 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.998+0000 7fea35400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fea3006f4e0 con 0x7fea3006ddf0 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2de00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea30074cb0 0x7fea3014df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2de00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea30074cb0 0x7fea3014df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33460/0 (socket says 172.21.15.83:33460) 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2de00640 1 -- 172.21.15.83:0/1610615322 learned_addr learned my addr 172.21.15.83:0/1610615322 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2e800640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea3006ddf0 0x7fea301f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2f200640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea300cbc10 0x7fea300b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2de00640 1 -- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea3006ddf0 msgr2=0x7fea301f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2de00640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea3006ddf0 0x7fea301f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2de00640 1 -- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea300cbc10 msgr2=0x7fea300b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2de00640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea300cbc10 0x7fea300b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2de00640 1 -- 172.21.15.83:0/1610615322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3014e4d0 con 0x7fea30074cb0 2024-09-21T00:15:38.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:37.999+0000 7fea2e800640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea3006ddf0 0x7fea301f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:15:38.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.000+0000 7fea2de00640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea30074cb0 0x7fea3014df90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fea1c02ab10 tx=0x7fea1c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:38.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.000+0000 7fea26a00640 1 -- 172.21.15.83:0/1610615322 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c005c90 con 0x7fea30074cb0 2024-09-21T00:15:38.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.000+0000 7fea26a00640 1 -- 172.21.15.83:0/1610615322 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea1c031e50 con 0x7fea30074cb0 2024-09-21T00:15:38.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.000+0000 7fea35400640 1 -- 172.21.15.83:0/1610615322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea3009d520 con 0x7fea30074cb0 2024-09-21T00:15:38.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.000+0000 7fea26a00640 1 -- 172.21.15.83:0/1610615322 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c005260 con 0x7fea30074cb0 2024-09-21T00:15:38.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.000+0000 7fea35400640 1 -- 172.21.15.83:0/1610615322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea3009dae0 con 0x7fea30074cb0 2024-09-21T00:15:38.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.001+0000 7fea35400640 1 -- 172.21.15.83:0/1610615322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea3009ae10 con 0x7fea30074cb0 2024-09-21T00:15:38.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.002+0000 7fea26a00640 1 -- 172.21.15.83:0/1610615322 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea1c005400 con 0x7fea30074cb0 2024-09-21T00:15:38.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.003+0000 7fea26a00640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fea10078bc0 0x7fea1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.003+0000 7fea26a00640 1 -- 172.21.15.83:0/1610615322 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7fea1c0bbef0 con 0x7fea30074cb0 2024-09-21T00:15:38.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.004+0000 7fea2e800640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fea10078bc0 0x7fea1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.004+0000 7fea2e800640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fea10078bc0 0x7fea1007b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fea200099a0 tx=0x7fea20009500 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:38.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.008+0000 7fea26a00640 1 -- 172.21.15.83:0/1610615322 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fea1c03f030 con 0x7fea30074cb0 2024-09-21T00:15:38.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.228+0000 7fea35400640 1 -- 172.21.15.83:0/1610615322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea3006fa00 con 0x7fea30074cb0 2024-09-21T00:15:38.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.229+0000 7fea26a00640 1 -- 172.21.15.83:0/1610615322 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5223 (secure 0 0 0) 0x7fea1c083b00 con 0x7fea30074cb0 2024-09-21T00:15:38.230 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:38.230 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":26,"btime":"2024-09-21T00:15:36:665966+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2168701718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2168701718},{"type":"v1","addr":"172.21.15.142:6836","nonce":2168701718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/399437337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":399437337},{"type":"v1","addr":"172.21.15.83:6835","nonce":399437337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4915,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/683491362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":683491362},{"type":"v1","addr":"172.21.15.83:6834","nonce":683491362}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:15:32.426071+0000","modified":"2024-09-21T00:15:36.665960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5119},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5119":{"gid":5119,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6837/2876811208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2876811208},{"type":"v1","addr":"172.21.15.142:6837","nonce":2876811208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5119,"qdb_cluster":[5119]},"id":2}]} 2024-09-21T00:15:38.230 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 26 2024-09-21T00:15:38.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 -- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fea10078bc0 msgr2=0x7fea1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fea10078bc0 0x7fea1007b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fea200099a0 tx=0x7fea20009500 comp rx=0 tx=0).stop 2024-09-21T00:15:38.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 -- 172.21.15.83:0/1610615322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea30074cb0 msgr2=0x7fea3014df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea30074cb0 0x7fea3014df90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fea1c02ab10 tx=0x7fea1c033c20 comp rx=0 tx=0).stop 2024-09-21T00:15:38.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 -- 172.21.15.83:0/1610615322 shutdown_connections 2024-09-21T00:15:38.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fea10078bc0 0x7fea1007b0d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea300cbc10 0x7fea300b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea30074cb0 0x7fea3014df90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 --2- 172.21.15.83:0/1610615322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea3006ddf0 0x7fea301f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 -- 172.21.15.83:0/1610615322 >> 172.21.15.83:0/1610615322 conn(0x7fea300cca40 msgr2=0x7fea300a0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:38.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 -- 172.21.15.83:0/1610615322 shutdown_connections 2024-09-21T00:15:38.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.231+0000 7fea35400640 1 -- 172.21.15.83:0/1610615322 wait complete. 2024-09-21T00:15:38.656 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T00:15:32.426071+0000', 'modified': '2024-09-21T00:15:36.665960+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5119}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5119': {'gid': 5119, 'name': 'd', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6837/2876811208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 2876811208}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 2876811208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 5119, 'qdb_cluster': [5119]} 2024-09-21T00:15:38.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T00:15:38.657 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-21T00:15:38.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.878+0000 7f7fd6800640 1 -- 172.21.15.83:0/2786501567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd00af5b0 msgr2=0x7f7fd015ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.878+0000 7f7fd6800640 1 --2- 172.21.15.83:0/2786501567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd00af5b0 0x7f7fd015ead0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8005fd0 tx=0x7f7fc802a940 comp rx=0 tx=0).stop 2024-09-21T00:15:38.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.878+0000 7f7fd6800640 1 -- 172.21.15.83:0/2786501567 shutdown_connections 2024-09-21T00:15:38.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.878+0000 7f7fd6800640 1 --2- 172.21.15.83:0/2786501567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd00af5b0 0x7f7fd015ead0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.878+0000 7f7fd6800640 1 -- 172.21.15.83:0/2786501567 >> 172.21.15.83:0/2786501567 conn(0x7f7fd00b1b90 msgr2=0x7f7fd00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:38.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.878+0000 7f7fd6800640 1 -- 172.21.15.83:0/2786501567 shutdown_connections 2024-09-21T00:15:38.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.879+0000 7f7fd6800640 1 -- 172.21.15.83:0/2786501567 wait complete. 2024-09-21T00:15:38.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.881+0000 7f7fd6800640 1 Processor -- start 2024-09-21T00:15:38.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.881+0000 7f7fd6800640 1 -- start start 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.882+0000 7f7fd6800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fd00af5b0 0x7f7fd01f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.882+0000 7f7fd6800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd00cc530 0x7f7fd01f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.882+0000 7f7fd6800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd01e3d70 0x7f7fd01f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.882+0000 7f7fd6800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd00cefb0 con 0x7f7fd00cc530 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.882+0000 7f7fd6800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd00cee30 con 0x7f7fd01e3d70 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.882+0000 7f7fd6800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd00cf130 con 0x7f7fd00af5b0 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.882+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd00cc530 0x7f7fd01f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.882+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd00cc530 0x7f7fd01f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33464/0 (socket says 172.21.15.83:33464) 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.883+0000 7f7fc7e00640 1 -- 172.21.15.83:0/2711705142 learned_addr learned my addr 172.21.15.83:0/2711705142 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.883+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd01e3d70 0x7f7fd01f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.883+0000 7f7fcf400640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fd00af5b0 0x7f7fd01f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.883+0000 7f7fc7e00640 1 -- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fd00af5b0 msgr2=0x7f7fd01f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.883+0000 7f7fc7e00640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fd00af5b0 0x7f7fd01f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.883+0000 7f7fc7e00640 1 -- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd01e3d70 msgr2=0x7f7fd01f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.883+0000 7f7fc7e00640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd01e3d70 0x7f7fd01f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.883+0000 7f7fc7e00640 1 -- 172.21.15.83:0/2711705142 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd009fa20 con 0x7f7fd00cc530 2024-09-21T00:15:38.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.883+0000 7f7fc7e00640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd00cc530 0x7f7fd01f6330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c3a0 tx=0x7f7fb800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:38.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.883+0000 7f7fc7400640 1 -- 172.21.15.83:0/2711705142 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8017070 con 0x7f7fd00cc530 2024-09-21T00:15:38.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.884+0000 7f7fc7400640 1 -- 172.21.15.83:0/2711705142 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fb80053c0 con 0x7f7fd00cc530 2024-09-21T00:15:38.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.884+0000 7f7fc7400640 1 -- 172.21.15.83:0/2711705142 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8003850 con 0x7f7fd00cc530 2024-09-21T00:15:38.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.884+0000 7f7fd6800640 1 -- 172.21.15.83:0/2711705142 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd009fcc0 con 0x7f7fd00cc530 2024-09-21T00:15:38.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.884+0000 7f7fd6800640 1 -- 172.21.15.83:0/2711705142 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd00a0280 con 0x7f7fd00cc530 2024-09-21T00:15:38.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.886+0000 7f7fc7400640 1 -- 172.21.15.83:0/2711705142 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fb801a070 con 0x7f7fd00cc530 2024-09-21T00:15:38.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.887+0000 7f7fc7400640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fac078b90 0x7f7fac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.887+0000 7f7fc7400640 1 -- 172.21.15.83:0/2711705142 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f7fb809a0e0 con 0x7f7fd00cc530 2024-09-21T00:15:38.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.888+0000 7f7fdd9f1740 1 Processor -- start 2024-09-21T00:15:38.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.888+0000 7f7fcf400640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fac078b90 0x7f7fac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.888+0000 7f7fdd9f1740 1 -- start start 2024-09-21T00:15:38.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.888+0000 7f7fcf400640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fac078b90 0x7f7fac07b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0007fd0 tx=0x7f7fc0001370 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d754b270 0x5606d791b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d75223b0 0x5606d791beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ebf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5606d7875430 con 0x5606d752a590 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5606d78655d0 con 0x5606d754b270 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5606d7854a00 con 0x5606d75223b0 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fcfe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ebf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fcfe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ebf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33470/0 (socket says 172.21.15.83:33470) 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fcfe00640 1 -- 172.21.15.83:0/4130025040 learned_addr learned my addr 172.21.15.83:0/4130025040 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fc7e00640 1 --2- 172.21.15.83:0/4130025040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d75223b0 0x5606d791beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.889+0000 7f7fcf400640 1 --2- 172.21.15.83:0/4130025040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d754b270 0x5606d791b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.890+0000 7f7fcfe00640 1 -- 172.21.15.83:0/4130025040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d75223b0 msgr2=0x5606d791beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:38.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.890+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/4130025040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d75223b0 0x5606d791beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.890+0000 7f7fcfe00640 1 -- 172.21.15.83:0/4130025040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d754b270 msgr2=0x5606d791b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:38.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.890+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/4130025040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d754b270 0x5606d791b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.890+0000 7f7fcfe00640 1 -- 172.21.15.83:0/4130025040 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d781d520 con 0x5606d752a590 2024-09-21T00:15:38.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.890+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/4130025040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ebf60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009cd0 tx=0x7f7fc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e4ff1c0ebdba36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:38.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.890+0000 7f7fbfe00640 1 -- 172.21.15.83:0/4130025040 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8003b70 con 0x5606d752a590 2024-09-21T00:15:38.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.890+0000 7f7fbfe00640 1 -- 172.21.15.83:0/4130025040 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fc8003e00 con 0x5606d752a590 2024-09-21T00:15:38.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.890+0000 7f7fbfe00640 1 -- 172.21.15.83:0/4130025040 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80308e0 con 0x5606d752a590 2024-09-21T00:15:38.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.891+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/4130025040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 msgr2=0x5606d78ebf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.891+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/4130025040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ebf60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009cd0 tx=0x7f7fc8004a40 comp rx=0 tx=0).stop 2024-09-21T00:15:38.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.891+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/4130025040 shutdown_connections 2024-09-21T00:15:38.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.891+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/4130025040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ebf60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.891+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/4130025040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d75223b0 0x5606d791beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.891+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/4130025040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d754b270 0x5606d791b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.891+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/4130025040 >> 172.21.15.83:0/4130025040 conn(0x5606d753f3c0 msgr2=0x5606d78f1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:38.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.891+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/4130025040 shutdown_connections 2024-09-21T00:15:38.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.891+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/4130025040 wait complete. 2024-09-21T00:15:38.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.892+0000 7f7fdd9f1740 1 -- start start 2024-09-21T00:15:38.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.893+0000 7f7fdd9f1740 1 Processor -- start 2024-09-21T00:15:38.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.894+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d75223b0 0x5606d7945780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.894+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d752a590 0x5606d7936bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.894+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7937130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.894+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5606d77fb330 con 0x5606d754b270 2024-09-21T00:15:38.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.894+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5606d7858810 con 0x5606d75223b0 2024-09-21T00:15:38.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.894+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5606d75c5620 con 0x5606d752a590 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.894+0000 7f7fdd9f1740 10 client.0 _ll_register_callbacks cb 0x5606d7800420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fcfe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7937130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fcfe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7937130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33484/0 (socket says 172.21.15.83:33484) 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fcfe00640 1 -- 172.21.15.83:0/3626402304 learned_addr learned my addr 172.21.15.83:0/3626402304 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fcf400640 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d75223b0 0x5606d7945780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fc7e00640 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d752a590 0x5606d7936bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fcfe00640 1 -- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d752a590 msgr2=0x5606d7936bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d752a590 0x5606d7936bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fcfe00640 1 -- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d75223b0 msgr2=0x5606d7945780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d75223b0 0x5606d7945780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fcfe00640 1 -- 172.21.15.83:0/3626402304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606d75b6850 con 0x5606d754b270 2024-09-21T00:15:38.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7937130 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7fc802af30 tx=0x7f7fc8031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab0048b093530ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:38.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.895+0000 7f7fbcc00640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T00:15:38.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3626402304 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc804a070 con 0x5606d754b270 2024-09-21T00:15:38.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3626402304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fc8003e00 con 0x5606d754b270 2024-09-21T00:15:38.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3626402304 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f7fc803c8d0 con 0x5606d754b270 2024-09-21T00:15:38.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3626402304 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7fc803cad0 con 0x5606d754b270 2024-09-21T00:15:38.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fdd9f1740 10 client.5292 fetch_fsmap learned FSMap version 26 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3626402304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5606d762d6b0 con 0x5606d754b270 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3626402304 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fc8003e00 con 0x5606d754b270 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3626402304 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f7fc8042020 con 0x5606d754b270 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fdd9f1740 10 client.5292 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fdd9f1740 10 client.5292 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fdd9f1740 20 client.5292 populate_metadata read hostname 'smithi083' 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:6835/2876811208,v1:172.21.15.142:6837/2876811208] conn(0x5606d7509e40 0x5606d79026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fdd9f1740 4 client.5292 mds_command: new command op to 5119 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.896+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3626402304 --> [v2:172.21.15.142:6835/2876811208,v1:172.21.15.142:6837/2876811208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606d7867520 con 0x5606d7509e40 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.897+0000 7f7fcf400640 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:6835/2876811208,v1:172.21.15.142:6837/2876811208] conn(0x5606d7509e40 0x5606d79026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.898+0000 7f7fbcc00640 10 client.5292 ms_handle_connect on v2:172.21.15.142:6835/2876811208 2024-09-21T00:15:38.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.898+0000 7f7fcf400640 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:6835/2876811208,v1:172.21.15.142:6837/2876811208] conn(0x5606d7509e40 0x5606d79026a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc30fd9437efbcc7 server_cookie=b3aab6964aca907d in_seq=0 out_seq=0 2024-09-21T00:15:38.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3626402304 <== mds.0 v2:172.21.15.142:6835/2876811208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606d7867520 con 0x5606d7509e40 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fbcc00640 10 client.5292 handle_command_reply: tid=0 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fdd9f1740 1 client.5292 shutdown 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3626402304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 msgr2=0x5606d7937130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7937130 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7fc802af30 tx=0x7f7fc8031980 comp rx=0 tx=0).stop 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3626402304 shutdown_connections 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:6835/2876811208,v1:172.21.15.142:6837/2876811208] conn(0x5606d7509e40 0x5606d79026a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7937130 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d752a590 0x5606d7936bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3626402304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d75223b0 0x5606d7945780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fbcc00640 0 client.5292 ms_handle_reset on v2:172.21.15.142:6835/2876811208 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.899+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3626402304 >> 172.21.15.83:0/3626402304 conn(0x5606d753f3c0 msgr2=0x5606d7939360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:38.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.900+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3626402304 shutdown_connections 2024-09-21T00:15:38.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.900+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3626402304 wait complete. 2024-09-21T00:15:38.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.900+0000 7f7fdd9f1740 20 client.5292 trim_cache size 0 max 16384 2024-09-21T00:15:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.918+0000 7f7fdd9f1740 1 Processor -- start 2024-09-21T00:15:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.919+0000 7f7fdd9f1740 1 -- start start 2024-09-21T00:15:38.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d75223b0 0x5606d78f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d752a590 0x5606d7938450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7931f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd0201410 con 0x5606d754b270 2024-09-21T00:15:38.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd02007a0 con 0x5606d752a590 2024-09-21T00:15:38.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd0200df0 con 0x5606d75223b0 2024-09-21T00:15:38.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fcfe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7931f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fcfe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7931f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33500/0 (socket says 172.21.15.83:33500) 2024-09-21T00:15:38.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fcfe00640 1 -- 172.21.15.83:0/2123111861 learned_addr learned my addr 172.21.15.83:0/2123111861 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:38.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fcfe00640 1 -- 172.21.15.83:0/2123111861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d75223b0 msgr2=0x5606d78f1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:38.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fcf400640 1 --2- 172.21.15.83:0/2123111861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d75223b0 0x5606d78f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fc7e00640 1 --2- 172.21.15.83:0/2123111861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d752a590 0x5606d7938450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.920+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/2123111861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d75223b0 0x5606d78f1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.921+0000 7f7fcfe00640 1 -- 172.21.15.83:0/2123111861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d752a590 msgr2=0x5606d7938450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:38.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.921+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/2123111861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d752a590 0x5606d7938450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.921+0000 7f7fcfe00640 1 -- 172.21.15.83:0/2123111861 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d7932970 con 0x5606d754b270 2024-09-21T00:15:38.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.921+0000 7f7fc7e00640 1 --2- 172.21.15.83:0/2123111861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d752a590 0x5606d7938450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:38.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.921+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/2123111861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7931f70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8002230 tx=0x7f7fc8009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be0b5722bce7942 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:38.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.921+0000 7f7fbf400640 1 -- 172.21.15.83:0/2123111861 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc804a070 con 0x5606d754b270 2024-09-21T00:15:38.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.921+0000 7f7fbf400640 1 -- 172.21.15.83:0/2123111861 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fc803ce30 con 0x5606d754b270 2024-09-21T00:15:38.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.921+0000 7f7fbf400640 1 -- 172.21.15.83:0/2123111861 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8031d80 con 0x5606d754b270 2024-09-21T00:15:38.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.922+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/2123111861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 msgr2=0x5606d7931f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.922+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/2123111861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7931f70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8002230 tx=0x7f7fc8009ae0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.922+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/2123111861 shutdown_connections 2024-09-21T00:15:38.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.922+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/2123111861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d754b270 0x5606d7931f70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.922+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/2123111861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d752a590 0x5606d7938450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.922+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/2123111861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d75223b0 0x5606d78f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.922+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/2123111861 >> 172.21.15.83:0/2123111861 conn(0x5606d753f3c0 msgr2=0x5606d795a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:38.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.922+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/2123111861 shutdown_connections 2024-09-21T00:15:38.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.922+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/2123111861 wait complete. 2024-09-21T00:15:38.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.923+0000 7f7fdd9f1740 1 -- start start 2024-09-21T00:15:38.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.923+0000 7f7fdd9f1740 1 Processor -- start 2024-09-21T00:15:38.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.924+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d75223b0 0x5606d799eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.924+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ecc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.924+0000 7f7fdd9f1740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d754b270 0x5606d78ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.924+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5606d7902520 con 0x5606d752a590 2024-09-21T00:15:38.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.924+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5606d79152c0 con 0x5606d75223b0 2024-09-21T00:15:38.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.924+0000 7f7fdd9f1740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5606d79119f0 con 0x5606d754b270 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fdd9f1740 10 client.0 _ll_register_callbacks cb 0x7f7fc8009310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ecc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33508/0 (socket says 172.21.15.83:33508) 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fc7e00640 1 -- 172.21.15.83:0/3216424443 learned_addr learned my addr 172.21.15.83:0/3216424443 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fcf400640 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d75223b0 0x5606d799eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fcfe00640 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d754b270 0x5606d78ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fc7e00640 1 -- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d754b270 msgr2=0x5606d78ed1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fc7e00640 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d754b270 0x5606d78ed1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fc7e00640 1 -- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d75223b0 msgr2=0x5606d799eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fc7e00640 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d75223b0 0x5606d799eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fc7e00640 1 -- 172.21.15.83:0/3216424443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606d7941ea0 con 0x5606d752a590 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fc7e00640 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ecc70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8061cb0 tx=0x7f7fb8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdfc5b8f0df2d7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fbcc00640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T00:15:38.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.925+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3216424443 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb806b650 con 0x5606d752a590 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3216424443 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f7fb80611e0 con 0x5606d752a590 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3216424443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fc803ce30 con 0x5606d752a590 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3216424443 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7fb8084080 con 0x5606d752a590 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fdd9f1740 10 client.5298 fetch_fsmap learned FSMap version 26 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3216424443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5606d79b58b0 con 0x5606d752a590 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3216424443 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fc803ce30 con 0x5606d752a590 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3216424443 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f7fb805d6c0 con 0x5606d752a590 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fdd9f1740 10 client.5298 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fdd9f1740 10 client.5298 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fdd9f1740 20 client.5298 populate_metadata read hostname 'smithi083' 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:6835/2876811208,v1:172.21.15.142:6837/2876811208] conn(0x5606d79016b0 0x5606d7936bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fdd9f1740 4 client.5298 mds_command: new command op to 5119 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.926+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3216424443 --> [v2:172.21.15.142:6835/2876811208,v1:172.21.15.142:6837/2876811208] -- command(tid 0: {"prefix": "status"}) -- 0x5606d7862fd0 con 0x5606d79016b0 2024-09-21T00:15:38.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.927+0000 7f7fcf400640 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:6835/2876811208,v1:172.21.15.142:6837/2876811208] conn(0x5606d79016b0 0x5606d7936bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.927+0000 7f7fcf400640 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:6835/2876811208,v1:172.21.15.142:6837/2876811208] conn(0x5606d79016b0 0x5606d7936bb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0a5907f28f8fec server_cookie=e28425df1997c9f2 in_seq=0 out_seq=0 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.927+0000 7f7fbcc00640 10 client.5298 ms_handle_connect on v2:172.21.15.142:6835/2876811208 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.927+0000 7f7fbcc00640 1 -- 172.21.15.83:0/3216424443 <== mds.0 v2:172.21.15.142:6835/2876811208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5606d7862fd0 con 0x5606d79016b0 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.927+0000 7f7fbcc00640 10 client.5298 handle_command_reply: tid=0 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.927+0000 7f7fdd9f1740 1 client.5298 shutdown 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3216424443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 msgr2=0x5606d78ecc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ecc70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8061cb0 tx=0x7f7fb8000ed0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3216424443 shutdown_connections 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:6835/2876811208,v1:172.21.15.142:6837/2876811208] conn(0x5606d79016b0 0x5606d7936bb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5606d754b270 0x5606d78ed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5606d752a590 0x5606d78ecc70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fbcc00640 0 client.5298 ms_handle_reset on v2:172.21.15.142:6835/2876811208 2024-09-21T00:15:38.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 1 --2- 172.21.15.83:0/3216424443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5606d75223b0 0x5606d799eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3216424443 >> 172.21.15.83:0/3216424443 conn(0x5606d753f3c0 msgr2=0x5606d7938450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:38.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3216424443 shutdown_connections 2024-09-21T00:15:38.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 1 -- 172.21.15.83:0/3216424443 wait complete. 2024-09-21T00:15:38.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.928+0000 7f7fdd9f1740 20 client.5298 trim_cache size 0 max 16384 2024-09-21T00:15:38.939 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:38.939 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "d4df3382-b453-41c4-9497-6203e3b4e46e", 2024-09-21T00:15:38.939 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-21T00:15:38.939 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 5119, 2024-09-21T00:15:38.940 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-21T00:15:38.940 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-21T00:15:38.940 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-21T00:15:38.940 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 4.9717486590000002, 2024-09-21T00:15:38.940 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 26, 2024-09-21T00:15:38.940 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 43, 2024-09-21T00:15:38.940 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 43, 2024-09-21T00:15:38.940 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 7.9641589890000004 2024-09-21T00:15:38.940 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:38.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 -- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fac078b90 msgr2=0x7f7fac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fac078b90 0x7f7fac07b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0007fd0 tx=0x7f7fc0001370 comp rx=0 tx=0).stop 2024-09-21T00:15:38.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 -- 172.21.15.83:0/2711705142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd00cc530 msgr2=0x7f7fd01f6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:38.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd00cc530 0x7f7fd01f6330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c3a0 tx=0x7f7fb800c860 comp rx=0 tx=0).stop 2024-09-21T00:15:38.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 -- 172.21.15.83:0/2711705142 shutdown_connections 2024-09-21T00:15:38.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7fac078b90 0x7f7fac07b0a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd01e3d70 0x7f7fd01f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd00cc530 0x7f7fd01f6330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 --2- 172.21.15.83:0/2711705142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fd00af5b0 0x7f7fd01f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:38.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 -- 172.21.15.83:0/2711705142 >> 172.21.15.83:0/2711705142 conn(0x7f7fd00b1b90 msgr2=0x7f7fd015df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:38.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 -- 172.21.15.83:0/2711705142 shutdown_connections 2024-09-21T00:15:38.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:38.929+0000 7f7fd6800640 1 -- 172.21.15.83:0/2711705142 wait complete. 2024-09-21T00:15:38.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:38.951 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/file_on_fs_0) 2024-09-21T00:15:38.992 INFO:teuthology.orchestra.run.smithi083.stdout:0 2024-09-21T00:15:38.992 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T00:15:38.992 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T00:15:39.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T00:15:39.205 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T00:15:39.205 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T00:15:39.205 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:15:39.206 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:39.241 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:15:39.241 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:39.316 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T00:15:39.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.575+0000 7f6d09200640 1 -- 172.21.15.83:0/4210615366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d04156a50 msgr2=0x7f6d04074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:39.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.575+0000 7f6d09200640 1 --2- 172.21.15.83:0/4210615366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d04156a50 0x7f6d04074620 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009830 tx=0x7f6cf402a510 comp rx=0 tx=0).stop 2024-09-21T00:15:39.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.575+0000 7f6d09200640 1 -- 172.21.15.83:0/4210615366 shutdown_connections 2024-09-21T00:15:39.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.575+0000 7f6d09200640 1 --2- 172.21.15.83:0/4210615366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d04074b60 0x7f6d0406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:39.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.575+0000 7f6d09200640 1 --2- 172.21.15.83:0/4210615366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d04156a50 0x7f6d04074620 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:39.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.575+0000 7f6d09200640 1 -- 172.21.15.83:0/4210615366 >> 172.21.15.83:0/4210615366 conn(0x7f6d040b1b90 msgr2=0x7f6d040b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:39.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.575+0000 7f6d09200640 1 -- 172.21.15.83:0/4210615366 shutdown_connections 2024-09-21T00:15:39.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.576+0000 7f6d09200640 1 -- 172.21.15.83:0/4210615366 wait complete. 2024-09-21T00:15:39.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.578+0000 7f6d09200640 1 Processor -- start 2024-09-21T00:15:39.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.578+0000 7f6d09200640 1 -- start start 2024-09-21T00:15:39.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.579+0000 7f6d09200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0406e330 0x7f6d040c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:39.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.579+0000 7f6d09200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d04074b60 0x7f6d040b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:39.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.579+0000 7f6d09200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d04156a50 0x7f6d041f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:39.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.579+0000 7f6d09200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6d040ce500 con 0x7f6d04074b60 2024-09-21T00:15:39.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.579+0000 7f6d09200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6d040ce380 con 0x7f6d0406e330 2024-09-21T00:15:39.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.579+0000 7f6d09200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6d040ce680 con 0x7f6d04156a50 2024-09-21T00:15:39.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.579+0000 7f6d01400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d04074b60 0x7f6d040b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d01400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d04074b60 0x7f6d040b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33520/0 (socket says 172.21.15.83:33520) 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d01400640 1 -- 172.21.15.83:0/2621959814 learned_addr learned my addr 172.21.15.83:0/2621959814 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d01e00640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0406e330 0x7f6d040c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d02800640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d04156a50 0x7f6d041f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d01400640 1 -- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d04156a50 msgr2=0x7f6d041f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d01400640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d04156a50 0x7f6d041f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d01400640 1 -- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0406e330 msgr2=0x7f6d040c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d01400640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0406e330 0x7f6d040c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d01400640 1 -- 172.21.15.83:0/2621959814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d041f93b0 con 0x7f6d04074b60 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d02800640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d04156a50 0x7f6d041f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:39.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6d01400640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d04074b60 0x7f6d040b3e10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000c970 tx=0x7f6cf000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:39.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.580+0000 7f6cfa000640 1 -- 172.21.15.83:0/2621959814 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0007bb0 con 0x7f6d04074b60 2024-09-21T00:15:39.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.581+0000 7f6cfa000640 1 -- 172.21.15.83:0/2621959814 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf0007e40 con 0x7f6d04074b60 2024-09-21T00:15:39.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.581+0000 7f6d09200640 1 -- 172.21.15.83:0/2621959814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d041f9690 con 0x7f6d04074b60 2024-09-21T00:15:39.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.581+0000 7f6cfa000640 1 -- 172.21.15.83:0/2621959814 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf000f690 con 0x7f6d04074b60 2024-09-21T00:15:39.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.581+0000 7f6d09200640 1 -- 172.21.15.83:0/2621959814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d04159670 con 0x7f6d04074b60 2024-09-21T00:15:39.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.582+0000 7f6d09200640 1 -- 172.21.15.83:0/2621959814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d0406ddf0 con 0x7f6d04074b60 2024-09-21T00:15:39.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.583+0000 7f6cfa000640 1 -- 172.21.15.83:0/2621959814 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6cf000f830 con 0x7f6d04074b60 2024-09-21T00:15:39.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.584+0000 7f6cfa000640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6ce4078b90 0x7f6ce407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:39.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.584+0000 7f6cfa000640 1 -- 172.21.15.83:0/2621959814 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f6cf009b700 con 0x7f6d04074b60 2024-09-21T00:15:39.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.584+0000 7f6d01e00640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6ce4078b90 0x7f6ce407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:39.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.585+0000 7f6d01e00640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6ce4078b90 0x7f6ce407b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4034000 tx=0x7f6cf4004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:39.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.588+0000 7f6cfa000640 1 -- 172.21.15.83:0/2621959814 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6cf0014030 con 0x7f6d04074b60 2024-09-21T00:15:39.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.787+0000 7f6d09200640 1 -- 172.21.15.83:0/2621959814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6d041f9860 con 0x7f6d04074b60 2024-09-21T00:15:39.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.787+0000 7f6cfa000640 1 -- 172.21.15.83:0/2621959814 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v43) ==== 80+0+124 (secure 0 0 0) 0x7f6cf0063960 con 0x7f6d04074b60 2024-09-21T00:15:39.789 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.142:6837/1450693530 2024-09-22T00:15:30.827804+0000 2024-09-21T00:15:39.789 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.142:6835/1450693530 2024-09-22T00:15:30.827804+0000 2024-09-21T00:15:39.789 INFO:teuthology.orchestra.run.smithi083.stderr:listed 2 entries 2024-09-21T00:15:39.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 -- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6ce4078b90 msgr2=0x7f6ce407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:39.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6ce4078b90 0x7f6ce407b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4034000 tx=0x7f6cf4004730 comp rx=0 tx=0).stop 2024-09-21T00:15:39.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 -- 172.21.15.83:0/2621959814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d04074b60 msgr2=0x7f6d040b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:39.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d04074b60 0x7f6d040b3e10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000c970 tx=0x7f6cf000ce30 comp rx=0 tx=0).stop 2024-09-21T00:15:39.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 -- 172.21.15.83:0/2621959814 shutdown_connections 2024-09-21T00:15:39.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6ce4078b90 0x7f6ce407b0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:39.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d04156a50 0x7f6d041f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:39.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d04074b60 0x7f6d040b3e10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:39.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 --2- 172.21.15.83:0/2621959814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0406e330 0x7f6d040c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:39.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 -- 172.21.15.83:0/2621959814 >> 172.21.15.83:0/2621959814 conn(0x7f6d040b1b90 msgr2=0x7f6d0415a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:39.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 -- 172.21.15.83:0/2621959814 shutdown_connections 2024-09-21T00:15:39.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:39.790+0000 7f6d09200640 1 -- 172.21.15.83:0/2621959814 wait complete. 2024-09-21T00:15:39.816 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T00:15:39.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:39.817 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T00:15:39.880 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:15:39.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:39.881 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T00:15:39.917 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T00:15:39.917 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:15:39.917 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:39.957 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T00:15:39.957 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T00:15:39.958 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:15:39.958 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:39.993 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052627,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T00:15:39.993 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T00:15:39.993 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:15:39.993 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:40.035 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T00:15:40.035 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:40.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.254+0000 7f66b9400640 1 -- 172.21.15.83:0/3315738482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b415dfe0 msgr2=0x7f66b4160a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:40.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.254+0000 7f66b9400640 1 --2- 172.21.15.83:0/3315738482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b415dfe0 0x7f66b4160a40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f66a4005fd0 tx=0x7f66a402a820 comp rx=0 tx=0).stop 2024-09-21T00:15:40.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.254+0000 7f66b9400640 1 -- 172.21.15.83:0/3315738482 shutdown_connections 2024-09-21T00:15:40.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.254+0000 7f66b9400640 1 --2- 172.21.15.83:0/3315738482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b40ccfe0 0x7f66b406e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.254+0000 7f66b9400640 1 --2- 172.21.15.83:0/3315738482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b415dfe0 0x7f66b4160a40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.254+0000 7f66b9400640 1 -- 172.21.15.83:0/3315738482 >> 172.21.15.83:0/3315738482 conn(0x7f66b406f940 msgr2=0x7f66b40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:40.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.254+0000 7f66b9400640 1 -- 172.21.15.83:0/3315738482 shutdown_connections 2024-09-21T00:15:40.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.254+0000 7f66b9400640 1 -- 172.21.15.83:0/3315738482 wait complete. 2024-09-21T00:15:40.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.256+0000 7f66b9400640 1 Processor -- start 2024-09-21T00:15:40.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.256+0000 7f66b9400640 1 -- start start 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b9400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b406e160 0x7f66b41ef710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b415dfe0 0x7f66b4073f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b9400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b4074460 0x7f66b4156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b9400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f66b40b4bd0 con 0x7f66b406e160 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b9400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f66b40b4a50 con 0x7f66b4074460 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f66b40b4d50 con 0x7f66b415dfe0 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b406e160 0x7f66b41ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b406e160 0x7f66b41ef710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33536/0 (socket says 172.21.15.83:33536) 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b3e00640 1 -- 172.21.15.83:0/3590593837 learned_addr learned my addr 172.21.15.83:0/3590593837 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66ab400640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b415dfe0 0x7f66b4073f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b8a00640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b4074460 0x7f66b4156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:40.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b3e00640 1 -- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b415dfe0 msgr2=0x7f66b4073f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:40.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b3e00640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b415dfe0 0x7f66b4073f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b3e00640 1 -- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b4074460 msgr2=0x7f66b4156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:40.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.258+0000 7f66b3e00640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b4074460 0x7f66b4156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.259+0000 7f66b3e00640 1 -- 172.21.15.83:0/3590593837 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b4074c30 con 0x7f66b406e160 2024-09-21T00:15:40.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.259+0000 7f66b8a00640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b4074460 0x7f66b4156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:40.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.259+0000 7f66b3e00640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b406e160 0x7f66b41ef710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f66a4006010 tx=0x7f66a4032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:40.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.259+0000 7f66b0c00640 1 -- 172.21.15.83:0/3590593837 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4037040 con 0x7f66b406e160 2024-09-21T00:15:40.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.259+0000 7f66b0c00640 1 -- 172.21.15.83:0/3590593837 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66a4042070 con 0x7f66b406e160 2024-09-21T00:15:40.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.259+0000 7f66b9400640 1 -- 172.21.15.83:0/3590593837 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b41f9c80 con 0x7f66b406e160 2024-09-21T00:15:40.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.259+0000 7f66b0c00640 1 -- 172.21.15.83:0/3590593837 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a40042a0 con 0x7f66b406e160 2024-09-21T00:15:40.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.259+0000 7f66b9400640 1 -- 172.21.15.83:0/3590593837 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b41f8ec0 con 0x7f66b406e160 2024-09-21T00:15:40.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.260+0000 7f66b9400640 1 -- 172.21.15.83:0/3590593837 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b40b5200 con 0x7f66b406e160 2024-09-21T00:15:40.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.261+0000 7f66b0c00640 1 -- 172.21.15.83:0/3590593837 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66a4004440 con 0x7f66b406e160 2024-09-21T00:15:40.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.263+0000 7f66b0c00640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6690078bc0 0x7f669007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:40.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.263+0000 7f66b0c00640 1 -- 172.21.15.83:0/3590593837 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f66a40bbe00 con 0x7f66b406e160 2024-09-21T00:15:40.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.263+0000 7f66ab400640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6690078bc0 0x7f669007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:40.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.264+0000 7f66ab400640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6690078bc0 0x7f669007b0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66b40d0580 tx=0x7f669c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:40.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.268+0000 7f66b0c00640 1 -- 172.21.15.83:0/3590593837 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f66b4074c30 con 0x7f66b406e160 2024-09-21T00:15:40.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.486+0000 7f66b9400640 1 -- 172.21.15.83:0/3590593837 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66b40cc0e0 con 0x7f66b406e160 2024-09-21T00:15:40.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.487+0000 7f66b0c00640 1 -- 172.21.15.83:0/3590593837 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5223 (secure 0 0 0) 0x7f66a4084050 con 0x7f66b406e160 2024-09-21T00:15:40.488 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:40.488 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":26,"btime":"2024-09-21T00:15:36:665966+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2168701718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2168701718},{"type":"v1","addr":"172.21.15.142:6836","nonce":2168701718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/399437337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":399437337},{"type":"v1","addr":"172.21.15.83:6835","nonce":399437337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4915,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/683491362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":683491362},{"type":"v1","addr":"172.21.15.83:6834","nonce":683491362}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:15:32.426071+0000","modified":"2024-09-21T00:15:36.665960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5119},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5119":{"gid":5119,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6837/2876811208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2876811208},{"type":"v1","addr":"172.21.15.142:6837","nonce":2876811208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5119,"qdb_cluster":[5119]},"id":2}]} 2024-09-21T00:15:40.489 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 26 2024-09-21T00:15:40.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.489+0000 7f66b9400640 1 -- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6690078bc0 msgr2=0x7f669007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:40.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.489+0000 7f66b9400640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6690078bc0 0x7f669007b0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66b40d0580 tx=0x7f669c009040 comp rx=0 tx=0).stop 2024-09-21T00:15:40.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.489+0000 7f66b9400640 1 -- 172.21.15.83:0/3590593837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b406e160 msgr2=0x7f66b41ef710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:40.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.489+0000 7f66b9400640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b406e160 0x7f66b41ef710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f66a4006010 tx=0x7f66a4032c90 comp rx=0 tx=0).stop 2024-09-21T00:15:40.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.490+0000 7f66b9400640 1 -- 172.21.15.83:0/3590593837 shutdown_connections 2024-09-21T00:15:40.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.490+0000 7f66b9400640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6690078bc0 0x7f669007b0d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.490+0000 7f66b9400640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b4074460 0x7f66b4156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.490+0000 7f66b9400640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b415dfe0 0x7f66b4073f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.490+0000 7f66b9400640 1 --2- 172.21.15.83:0/3590593837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66b406e160 0x7f66b41ef710 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.490+0000 7f66b9400640 1 -- 172.21.15.83:0/3590593837 >> 172.21.15.83:0/3590593837 conn(0x7f66b406f940 msgr2=0x7f66b4160a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:40.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.490+0000 7f66b9400640 1 -- 172.21.15.83:0/3590593837 shutdown_connections 2024-09-21T00:15:40.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.490+0000 7f66b9400640 1 -- 172.21.15.83:0/3590593837 wait complete. 2024-09-21T00:15:40.512 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:40.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.733+0000 7fb368c00640 1 -- 172.21.15.83:0/494223991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb36415dfe0 msgr2=0x7fb364160a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:40.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.733+0000 7fb368c00640 1 --2- 172.21.15.83:0/494223991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb36415dfe0 0x7fb364160a40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb354009830 tx=0x7fb35402a530 comp rx=0 tx=0).stop 2024-09-21T00:15:40.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.733+0000 7fb368c00640 1 -- 172.21.15.83:0/494223991 shutdown_connections 2024-09-21T00:15:40.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.733+0000 7fb368c00640 1 --2- 172.21.15.83:0/494223991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb36415dfe0 0x7fb364160a40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.733+0000 7fb368c00640 1 -- 172.21.15.83:0/494223991 >> 172.21.15.83:0/494223991 conn(0x7fb36406f940 msgr2=0x7fb3640b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:40.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.733+0000 7fb368c00640 1 -- 172.21.15.83:0/494223991 shutdown_connections 2024-09-21T00:15:40.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.733+0000 7fb368c00640 1 -- 172.21.15.83:0/494223991 wait complete. 2024-09-21T00:15:40.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.735+0000 7fb368c00640 1 Processor -- start 2024-09-21T00:15:40.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.736+0000 7fb368c00640 1 -- start start 2024-09-21T00:15:40.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.737+0000 7fb368c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36406e160 0x7fb36413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:40.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.737+0000 7fb368c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb36415dfe0 0x7fb3641407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:40.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.737+0000 7fb368c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3640d0840 0x7fb364140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:40.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.737+0000 7fb368c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb3640b4f20 con 0x7fb36415dfe0 2024-09-21T00:15:40.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.737+0000 7fb368c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb3640b4da0 con 0x7fb3640d0840 2024-09-21T00:15:40.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.737+0000 7fb368c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb3640b50a0 con 0x7fb36406e160 2024-09-21T00:15:40.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.737+0000 7fb362a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb36415dfe0 0x7fb3641407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.737+0000 7fb362a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb36415dfe0 0x7fb3641407c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33558/0 (socket says 172.21.15.83:33558) 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.737+0000 7fb362a00640 1 -- 172.21.15.83:0/859029925 learned_addr learned my addr 172.21.15.83:0/859029925 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb363400640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36406e160 0x7fb36413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb363e00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3640d0840 0x7fb364140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb362a00640 1 -- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36406e160 msgr2=0x7fb36413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb362a00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36406e160 0x7fb36413dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb362a00640 1 -- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3640d0840 msgr2=0x7fb364140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb362a00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3640d0840 0x7fb364140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb362a00640 1 -- 172.21.15.83:0/859029925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb364141490 con 0x7fb36415dfe0 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb363e00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3640d0840 0x7fb364140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:40.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb362a00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb36415dfe0 0x7fb3641407c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb35000c340 tx=0x7fb35000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:40.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb35b400640 1 -- 172.21.15.83:0/859029925 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350011790 con 0x7fb36415dfe0 2024-09-21T00:15:40.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.738+0000 7fb35b400640 1 -- 172.21.15.83:0/859029925 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb350017070 con 0x7fb36415dfe0 2024-09-21T00:15:40.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.739+0000 7fb368c00640 1 -- 172.21.15.83:0/859029925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb364141770 con 0x7fb36415dfe0 2024-09-21T00:15:40.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.739+0000 7fb35b400640 1 -- 172.21.15.83:0/859029925 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350011cc0 con 0x7fb36415dfe0 2024-09-21T00:15:40.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.739+0000 7fb368c00640 1 -- 172.21.15.83:0/859029925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb364153c20 con 0x7fb36415dfe0 2024-09-21T00:15:40.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.740+0000 7fb368c00640 1 -- 172.21.15.83:0/859029925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb364160a40 con 0x7fb36415dfe0 2024-09-21T00:15:40.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.741+0000 7fb35b400640 1 -- 172.21.15.83:0/859029925 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb35001c460 con 0x7fb36415dfe0 2024-09-21T00:15:40.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.742+0000 7fb35b400640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb344078bf0 0x7fb34407b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:40.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.742+0000 7fb35b400640 1 -- 172.21.15.83:0/859029925 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7fb35009abf0 con 0x7fb36415dfe0 2024-09-21T00:15:40.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.742+0000 7fb363400640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb344078bf0 0x7fb34407b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:40.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.743+0000 7fb363400640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb344078bf0 0x7fb34407b100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb354034000 tx=0x7fb354004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:40.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.747+0000 7fb35b400640 1 -- 172.21.15.83:0/859029925 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb350062e40 con 0x7fb36415dfe0 2024-09-21T00:15:40.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.972+0000 7fb368c00640 1 -- 172.21.15.83:0/859029925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb364145bb0 con 0x7fb36415dfe0 2024-09-21T00:15:40.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.973+0000 7fb35b400640 1 -- 172.21.15.83:0/859029925 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5223 (secure 0 0 0) 0x7fb350062740 con 0x7fb36415dfe0 2024-09-21T00:15:40.974 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:40.974 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":26,"btime":"2024-09-21T00:15:36:665966+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2168701718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2168701718},{"type":"v1","addr":"172.21.15.142:6836","nonce":2168701718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/399437337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":399437337},{"type":"v1","addr":"172.21.15.83:6835","nonce":399437337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4915,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/683491362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":683491362},{"type":"v1","addr":"172.21.15.83:6834","nonce":683491362}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:15:32.426071+0000","modified":"2024-09-21T00:15:36.665960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5119},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5119":{"gid":5119,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6837/2876811208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2876811208},{"type":"v1","addr":"172.21.15.142:6837","nonce":2876811208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5119,"qdb_cluster":[5119]},"id":2}]} 2024-09-21T00:15:40.975 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 26 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.975+0000 7fb368c00640 1 -- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb344078bf0 msgr2=0x7fb34407b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.975+0000 7fb368c00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb344078bf0 0x7fb34407b100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb354034000 tx=0x7fb354004730 comp rx=0 tx=0).stop 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.975+0000 7fb368c00640 1 -- 172.21.15.83:0/859029925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb36415dfe0 msgr2=0x7fb3641407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.975+0000 7fb368c00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb36415dfe0 0x7fb3641407c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb35000c340 tx=0x7fb35000c800 comp rx=0 tx=0).stop 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.975+0000 7fb368c00640 1 -- 172.21.15.83:0/859029925 shutdown_connections 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.975+0000 7fb368c00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb344078bf0 0x7fb34407b100 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.975+0000 7fb368c00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3640d0840 0x7fb364140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.975+0000 7fb368c00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb36415dfe0 0x7fb3641407c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.975+0000 7fb368c00640 1 --2- 172.21.15.83:0/859029925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36406e160 0x7fb36413dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.975+0000 7fb368c00640 1 -- 172.21.15.83:0/859029925 >> 172.21.15.83:0/859029925 conn(0x7fb36406f940 msgr2=0x7fb3640b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.976+0000 7fb368c00640 1 -- 172.21.15.83:0/859029925 shutdown_connections 2024-09-21T00:15:40.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:40.976+0000 7fb368c00640 1 -- 172.21.15.83:0/859029925 wait complete. 2024-09-21T00:15:40.999 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:15:41.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.218+0000 7f49bd000640 1 -- 172.21.15.83:0/2061216564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49b8073dd0 msgr2=0x7f49b815c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:41.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.218+0000 7f49bd000640 1 --2- 172.21.15.83:0/2061216564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49b8073dd0 0x7f49b815c3b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f49a8005fd0 tx=0x7f49a802a5c0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.218+0000 7f49bd000640 1 -- 172.21.15.83:0/2061216564 shutdown_connections 2024-09-21T00:15:41.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.218+0000 7f49bd000640 1 --2- 172.21.15.83:0/2061216564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49b806def0 0x7f49b806e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.218+0000 7f49bd000640 1 --2- 172.21.15.83:0/2061216564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49b8073dd0 0x7f49b815c3b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.218+0000 7f49bd000640 1 -- 172.21.15.83:0/2061216564 >> 172.21.15.83:0/2061216564 conn(0x7f49b806f940 msgr2=0x7f49b80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:41.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.218+0000 7f49bd000640 1 -- 172.21.15.83:0/2061216564 shutdown_connections 2024-09-21T00:15:41.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.218+0000 7f49bd000640 1 -- 172.21.15.83:0/2061216564 wait complete. 2024-09-21T00:15:41.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.220+0000 7f49bd000640 1 Processor -- start 2024-09-21T00:15:41.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.220+0000 7f49bd000640 1 -- start start 2024-09-21T00:15:41.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.222+0000 7f49bd000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49b806def0 0x7f49b81f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:41.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.222+0000 7f49bd000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49b8073dd0 0x7f49b814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:41.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.222+0000 7f49bd000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49b8152530 0x7f49b80afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:41.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.222+0000 7f49bd000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f49b80cf5f0 con 0x7f49b8152530 2024-09-21T00:15:41.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.222+0000 7f49bd000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f49b80cf470 con 0x7f49b8073dd0 2024-09-21T00:15:41.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.222+0000 7f49bd000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f49b80cf770 con 0x7f49b806def0 2024-09-21T00:15:41.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.222+0000 7f49b7e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49b8152530 0x7f49b80afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:41.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.222+0000 7f49b7e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49b8152530 0x7f49b80afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33578/0 (socket says 172.21.15.83:33578) 2024-09-21T00:15:41.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.222+0000 7f49b7e00640 1 -- 172.21.15.83:0/3284999624 learned_addr learned my addr 172.21.15.83:0/3284999624 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:41.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49b7400640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49b806def0 0x7f49b81f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:41.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49aea00640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49b8073dd0 0x7f49b814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:41.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49b7e00640 1 -- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49b806def0 msgr2=0x7f49b81f9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:41.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49b7e00640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49b806def0 0x7f49b81f9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49b7e00640 1 -- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49b8073dd0 msgr2=0x7f49b814dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:41.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49b7e00640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49b8073dd0 0x7f49b814dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49b7e00640 1 -- 172.21.15.83:0/3284999624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b81f9d60 con 0x7f49b8152530 2024-09-21T00:15:41.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49b7e00640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49b8152530 0x7f49b80afb40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f49b000e960 tx=0x7f49b000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49afe00640 1 -- 172.21.15.83:0/3284999624 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0004d20 con 0x7f49b8152530 2024-09-21T00:15:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49afe00640 1 -- 172.21.15.83:0/3284999624 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49b000cb20 con 0x7f49b8152530 2024-09-21T00:15:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49afe00640 1 -- 172.21.15.83:0/3284999624 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0005020 con 0x7f49b8152530 2024-09-21T00:15:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49bd000640 1 -- 172.21.15.83:0/3284999624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b81ea430 con 0x7f49b8152530 2024-09-21T00:15:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.223+0000 7f49bd000640 1 -- 172.21.15.83:0/3284999624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b81f9020 con 0x7f49b8152530 2024-09-21T00:15:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.224+0000 7f49bd000640 1 -- 172.21.15.83:0/3284999624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b80cfc20 con 0x7f49b8152530 2024-09-21T00:15:41.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.226+0000 7f49afe00640 1 -- 172.21.15.83:0/3284999624 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49b00051c0 con 0x7f49b8152530 2024-09-21T00:15:41.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.227+0000 7f49afe00640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4994078b90 0x7f499407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:41.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.227+0000 7f49afe00640 1 -- 172.21.15.83:0/3284999624 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f49b009b8e0 con 0x7f49b8152530 2024-09-21T00:15:41.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.227+0000 7f49b7400640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4994078b90 0x7f499407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:41.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.228+0000 7f49b7400640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4994078b90 0x7f499407b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f49a8033000 tx=0x7f49a8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:41.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.231+0000 7f49afe00640 1 -- 172.21.15.83:0/3284999624 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f49b0016030 con 0x7f49b8152530 2024-09-21T00:15:41.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.418+0000 7f49bd000640 1 -- 172.21.15.83:0/3284999624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49b815f430 con 0x7f49b8152530 2024-09-21T00:15:41.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.419+0000 7f49afe00640 1 -- 172.21.15.83:0/3284999624 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+17157 (secure 0 0 0) 0x7f49b0063aa0 con 0x7f49b8152530 2024-09-21T00:15:41.421 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:41.421 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":43,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:15:32.426112+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:15:14.312079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T00:15:15.307562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6837/1450693530":"2024-09-22T00:15:30.827804+0000","172.21.15.142:6835/1450693530":"2024-09-22T00:15:30.827804+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:15:41.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.421+0000 7f49bd000640 1 -- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4994078b90 msgr2=0x7f499407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:41.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.421+0000 7f49bd000640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4994078b90 0x7f499407b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f49a8033000 tx=0x7f49a8004730 comp rx=0 tx=0).stop 2024-09-21T00:15:41.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.421+0000 7f49bd000640 1 -- 172.21.15.83:0/3284999624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49b8152530 msgr2=0x7f49b80afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:41.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.421+0000 7f49bd000640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49b8152530 0x7f49b80afb40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f49b000e960 tx=0x7f49b000ee20 comp rx=0 tx=0).stop 2024-09-21T00:15:41.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.421+0000 7f49bd000640 1 -- 172.21.15.83:0/3284999624 shutdown_connections 2024-09-21T00:15:41.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.421+0000 7f49bd000640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4994078b90 0x7f499407b0a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.421+0000 7f49bd000640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49b8152530 0x7f49b80afb40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.421+0000 7f49bd000640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49b8073dd0 0x7f49b814dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.421+0000 7f49bd000640 1 --2- 172.21.15.83:0/3284999624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49b806def0 0x7f49b81f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.422+0000 7f49bd000640 1 -- 172.21.15.83:0/3284999624 >> 172.21.15.83:0/3284999624 conn(0x7f49b806f940 msgr2=0x7f49b81eb050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:41.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.422+0000 7f49bd000640 1 -- 172.21.15.83:0/3284999624 shutdown_connections 2024-09-21T00:15:41.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.422+0000 7f49bd000640 1 -- 172.21.15.83:0/3284999624 wait complete. 2024-09-21T00:15:41.449 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T00:15:41.449 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.669+0000 7fcb03800640 1 -- 172.21.15.83:0/3052323346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcafc0ce860 msgr2=0x7fcafc15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.669+0000 7fcb03800640 1 --2- 172.21.15.83:0/3052323346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcafc0ce860 0x7fcafc15f5a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcafc072560 tx=0x7fcaf402aa30 comp rx=0 tx=0).stop 2024-09-21T00:15:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.669+0000 7fcb03800640 1 -- 172.21.15.83:0/3052323346 shutdown_connections 2024-09-21T00:15:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.669+0000 7fcb03800640 1 --2- 172.21.15.83:0/3052323346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcafc0ce860 0x7fcafc15f5a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.669+0000 7fcb03800640 1 --2- 172.21.15.83:0/3052323346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcafc0cefa0 0x7fcafc0ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.669+0000 7fcb03800640 1 --2- 172.21.15.83:0/3052323346 >> v2:172.21.15.142:3300/0 conn(0x7fcafc15b9f0 0x7fcafc0cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.669+0000 7fcb03800640 1 -- 172.21.15.83:0/3052323346 >> 172.21.15.83:0/3052323346 conn(0x7fcafc0cca40 msgr2=0x7fcafc0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.669+0000 7fcb03800640 1 -- 172.21.15.83:0/3052323346 shutdown_connections 2024-09-21T00:15:41.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.669+0000 7fcb03800640 1 -- 172.21.15.83:0/3052323346 wait complete. 2024-09-21T00:15:41.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.672+0000 7fcb03800640 1 Processor -- start 2024-09-21T00:15:41.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.672+0000 7fcb03800640 1 -- start start 2024-09-21T00:15:41.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.673+0000 7fcb03800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcafc0ce860 0x7fcafc09edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:41.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.673+0000 7fcb03800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcafc0cefa0 0x7fcafc15e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:41.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.673+0000 7fcb03800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcafc15b9f0 0x7fcafc0c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:41.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.673+0000 7fcb03800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc15fe70 con 0x7fcafc0cefa0 2024-09-21T00:15:41.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.673+0000 7fcb03800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc15fcf0 con 0x7fcafc0ce860 2024-09-21T00:15:41.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.673+0000 7fcb03800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcafc06ddf0 con 0x7fcafc15b9f0 2024-09-21T00:15:41.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.673+0000 7fcaf3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcafc0cefa0 0x7fcafc15e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:41.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.674+0000 7fcaf3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcafc0cefa0 0x7fcafc15e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33596/0 (socket says 172.21.15.83:33596) 2024-09-21T00:15:41.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.674+0000 7fcaf3e00640 1 -- 172.21.15.83:0/4265102973 learned_addr learned my addr 172.21.15.83:0/4265102973 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:41.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.674+0000 7fcb00e00640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcafc0ce860 0x7fcafc09edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:41.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.674+0000 7fcb01800640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcafc15b9f0 0x7fcafc0c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:41.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.674+0000 7fcaf3e00640 1 -- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcafc15b9f0 msgr2=0x7fcafc0c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:41.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.674+0000 7fcaf3e00640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcafc15b9f0 0x7fcafc0c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.674+0000 7fcaf3e00640 1 -- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcafc0ce860 msgr2=0x7fcafc09edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:41.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.674+0000 7fcaf3e00640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcafc0ce860 0x7fcafc09edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.674+0000 7fcaf3e00640 1 -- 172.21.15.83:0/4265102973 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc0ae060 con 0x7fcafc0cefa0 2024-09-21T00:15:41.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.674+0000 7fcaf3e00640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcafc0cefa0 0x7fcafc15e150 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcae400d700 tx=0x7fcae400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:41.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.675+0000 7fcaf9600640 1 -- 172.21.15.83:0/4265102973 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae4017070 con 0x7fcafc0cefa0 2024-09-21T00:15:41.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.675+0000 7fcaf9600640 1 -- 172.21.15.83:0/4265102973 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcae4009b10 con 0x7fcafc0cefa0 2024-09-21T00:15:41.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.675+0000 7fcaf9600640 1 -- 172.21.15.83:0/4265102973 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae4010460 con 0x7fcafc0cefa0 2024-09-21T00:15:41.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.675+0000 7fcb03800640 1 -- 172.21.15.83:0/4265102973 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc0ae560 con 0x7fcafc0cefa0 2024-09-21T00:15:41.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.675+0000 7fcb03800640 1 -- 172.21.15.83:0/4265102973 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc0c1f10 con 0x7fcafc0cefa0 2024-09-21T00:15:41.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.676+0000 7fcb03800640 1 -- 172.21.15.83:0/4265102973 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcafc0ae2d0 con 0x7fcafc0cefa0 2024-09-21T00:15:41.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.677+0000 7fcaf9600640 1 -- 172.21.15.83:0/4265102973 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcae401a070 con 0x7fcafc0cefa0 2024-09-21T00:15:41.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.678+0000 7fcaf9600640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcad8078bc0 0x7fcad807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:41.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.678+0000 7fcaf9600640 1 -- 172.21.15.83:0/4265102973 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7fcae409b010 con 0x7fcafc0cefa0 2024-09-21T00:15:41.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.679+0000 7fcb00e00640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcad8078bc0 0x7fcad807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:41.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.679+0000 7fcb00e00640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcad8078bc0 0x7fcad807b0d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00bad0 tx=0x7fcaec00b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:41.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.683+0000 7fcaf9600640 1 -- 172.21.15.83:0/4265102973 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcae4062b90 con 0x7fcafc0cefa0 2024-09-21T00:15:41.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.906+0000 7fcb03800640 1 -- 172.21.15.83:0/4265102973 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcafc15f760 con 0x7fcafc0cefa0 2024-09-21T00:15:41.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.907+0000 7fcaf9600640 1 -- 172.21.15.83:0/4265102973 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5223 (secure 0 0 0) 0x7fcae40675c0 con 0x7fcafc0cefa0 2024-09-21T00:15:41.908 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:41.908 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":26,"btime":"2024-09-21T00:15:36:665966+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2168701718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2168701718},{"type":"v1","addr":"172.21.15.142:6836","nonce":2168701718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/399437337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":399437337},{"type":"v1","addr":"172.21.15.83:6835","nonce":399437337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4915,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/683491362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":683491362},{"type":"v1","addr":"172.21.15.83:6834","nonce":683491362}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:15:32.426071+0000","modified":"2024-09-21T00:15:36.665960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5119},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5119":{"gid":5119,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6837/2876811208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2876811208},{"type":"v1","addr":"172.21.15.142:6837","nonce":2876811208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5119,"qdb_cluster":[5119]},"id":2}]} 2024-09-21T00:15:41.908 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 26 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.909+0000 7fcb03800640 1 -- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcad8078bc0 msgr2=0x7fcad807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.909+0000 7fcb03800640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcad8078bc0 0x7fcad807b0d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00bad0 tx=0x7fcaec00b2e0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.909+0000 7fcb03800640 1 -- 172.21.15.83:0/4265102973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcafc0cefa0 msgr2=0x7fcafc15e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.909+0000 7fcb03800640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcafc0cefa0 0x7fcafc15e150 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcae400d700 tx=0x7fcae400dbc0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.909+0000 7fcb03800640 1 -- 172.21.15.83:0/4265102973 shutdown_connections 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.909+0000 7fcb03800640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fcad8078bc0 0x7fcad807b0d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.909+0000 7fcb03800640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcafc15b9f0 0x7fcafc0c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.909+0000 7fcb03800640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcafc0cefa0 0x7fcafc15e150 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.909+0000 7fcb03800640 1 --2- 172.21.15.83:0/4265102973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcafc0ce860 0x7fcafc09edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.909+0000 7fcb03800640 1 -- 172.21.15.83:0/4265102973 >> 172.21.15.83:0/4265102973 conn(0x7fcafc0cca40 msgr2=0x7fcafc0ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.910+0000 7fcb03800640 1 -- 172.21.15.83:0/4265102973 shutdown_connections 2024-09-21T00:15:41.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:41.910+0000 7fcb03800640 1 -- 172.21.15.83:0/4265102973 wait complete. 2024-09-21T00:15:41.933 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:15:42.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.150+0000 7f8da4600640 1 -- 172.21.15.83:0/2562447485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d9c0cefa0 msgr2=0x7f8d9c0ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:42.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.150+0000 7f8da4600640 1 --2- 172.21.15.83:0/2562447485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d9c0cefa0 0x7f8d9c0ce320 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c159530 tx=0x7f8d8802a560 comp rx=0 tx=0).stop 2024-09-21T00:15:42.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.150+0000 7f8da4600640 1 -- 172.21.15.83:0/2562447485 shutdown_connections 2024-09-21T00:15:42.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.150+0000 7f8da4600640 1 --2- 172.21.15.83:0/2562447485 >> v2:172.21.15.142:3300/0 conn(0x7f8d9c0ce860 0x7f8d9c15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.150+0000 7f8da4600640 1 --2- 172.21.15.83:0/2562447485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d9c0cefa0 0x7f8d9c0ce320 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.150+0000 7f8da4600640 1 --2- 172.21.15.83:0/2562447485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d9c15b9f0 0x7f8d9c0cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.150+0000 7f8da4600640 1 -- 172.21.15.83:0/2562447485 >> 172.21.15.83:0/2562447485 conn(0x7f8d9c0cca40 msgr2=0x7f8d9c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:42.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.150+0000 7f8da4600640 1 -- 172.21.15.83:0/2562447485 shutdown_connections 2024-09-21T00:15:42.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.150+0000 7f8da4600640 1 -- 172.21.15.83:0/2562447485 wait complete. 2024-09-21T00:15:42.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.152+0000 7f8da4600640 1 Processor -- start 2024-09-21T00:15:42.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.153+0000 7f8da4600640 1 -- start start 2024-09-21T00:15:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.154+0000 7f8da4600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d9c0ce860 0x7f8d9c0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.154+0000 7f8da4600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d9c0cefa0 0x7f8d9c0b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.154+0000 7f8da4600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d9c15b9f0 0x7f8d9c09edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.154+0000 7f8da4600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c15fe70 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.154+0000 7f8da4600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c15fcf0 con 0x7f8d9c15b9f0 2024-09-21T00:15:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.154+0000 7f8da4600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9c06ddf0 con 0x7f8d9c0ce860 2024-09-21T00:15:42.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.154+0000 7f8da1200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d9c0cefa0 0x7f8d9c0b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.154+0000 7f8da1200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d9c0cefa0 0x7f8d9c0b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55902/0 (socket says 172.21.15.83:55902) 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.154+0000 7f8da1200640 1 -- 172.21.15.83:0/2003179327 learned_addr learned my addr 172.21.15.83:0/2003179327 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8da1c00640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d9c0ce860 0x7f8d9c0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8da2600640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d9c15b9f0 0x7f8d9c09edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8da1200640 1 -- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d9c0ce860 msgr2=0x7f8d9c0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8da1200640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d9c0ce860 0x7f8d9c0af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8da1200640 1 -- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d9c15b9f0 msgr2=0x7f8d9c09edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8da1200640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d9c15b9f0 0x7f8d9c09edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8da1200640 1 -- 172.21.15.83:0/2003179327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c0a0fb0 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8da2600640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d9c15b9f0 0x7f8d9c09edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:42.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8da1200640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d9c0cefa0 0x7f8d9c0b4750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d88034040 tx=0x7f8d88003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:42.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8d99600640 1 -- 172.21.15.83:0/2003179327 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8803e030 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8d99600640 1 -- 172.21.15.83:0/2003179327 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d88003e00 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.155+0000 7f8d99600640 1 -- 172.21.15.83:0/2003179327 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88035040 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.156+0000 7f8da4600640 1 -- 172.21.15.83:0/2003179327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9c0b3f90 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.156+0000 7f8da4600640 1 -- 172.21.15.83:0/2003179327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d9c0a0cd0 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.157+0000 7f8da4600640 1 -- 172.21.15.83:0/2003179327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d9c0a0760 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.158+0000 7f8d99600640 1 -- 172.21.15.83:0/2003179327 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d88041030 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.159+0000 7f8d99600640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8d7c078bc0 0x7f8d7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:42.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.159+0000 7f8d99600640 1 -- 172.21.15.83:0/2003179327 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f8d880bb740 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.159+0000 7f8da1c00640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8d7c078bc0 0x7f8d7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:42.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.160+0000 7f8da1c00640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8d7c078bc0 0x7f8d7c07b0d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8d900045b0 tx=0x7f8d9000b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:42.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.163+0000 7f8d99600640 1 -- 172.21.15.83:0/2003179327 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8d88083340 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.384+0000 7f8da4600640 1 -- 172.21.15.83:0/2003179327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d9c06a780 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.385+0000 7f8d99600640 1 -- 172.21.15.83:0/2003179327 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5223 (secure 0 0 0) 0x7f8d9c06a780 con 0x7f8d9c0cefa0 2024-09-21T00:15:42.386 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:42.386 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":26,"btime":"2024-09-21T00:15:36:665966+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2168701718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2168701718},{"type":"v1","addr":"172.21.15.142:6836","nonce":2168701718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/399437337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":399437337},{"type":"v1","addr":"172.21.15.83:6835","nonce":399437337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4915,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/683491362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":683491362},{"type":"v1","addr":"172.21.15.83:6834","nonce":683491362}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:15:32.426071+0000","modified":"2024-09-21T00:15:36.665960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5119},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5119":{"gid":5119,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6837/2876811208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2876811208},{"type":"v1","addr":"172.21.15.142:6837","nonce":2876811208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5119,"qdb_cluster":[5119]},"id":2}]} 2024-09-21T00:15:42.386 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 26 2024-09-21T00:15:42.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 -- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8d7c078bc0 msgr2=0x7f8d7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:42.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8d7c078bc0 0x7f8d7c07b0d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8d900045b0 tx=0x7f8d9000b2e0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 -- 172.21.15.83:0/2003179327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d9c0cefa0 msgr2=0x7f8d9c0b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:42.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d9c0cefa0 0x7f8d9c0b4750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d88034040 tx=0x7f8d88003910 comp rx=0 tx=0).stop 2024-09-21T00:15:42.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 -- 172.21.15.83:0/2003179327 shutdown_connections 2024-09-21T00:15:42.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8d7c078bc0 0x7f8d7c07b0d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d9c15b9f0 0x7f8d9c09edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d9c0cefa0 0x7f8d9c0b4750 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 --2- 172.21.15.83:0/2003179327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d9c0ce860 0x7f8d9c0af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 -- 172.21.15.83:0/2003179327 >> 172.21.15.83:0/2003179327 conn(0x7f8d9c0cca40 msgr2=0x7f8d9c0b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:42.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 -- 172.21.15.83:0/2003179327 shutdown_connections 2024-09-21T00:15:42.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.387+0000 7f8da4600640 1 -- 172.21.15.83:0/2003179327 wait complete. 2024-09-21T00:15:42.414 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:15:42.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.632+0000 7f399f600640 1 -- 172.21.15.83:0/4083422686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f399815f5a0 msgr2=0x7f399815f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:42.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.632+0000 7f399f600640 1 --2- 172.21.15.83:0/4083422686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f399815f5a0 0x7f399815f9b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3990005fd0 tx=0x7f399002a8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.632+0000 7f399f600640 1 -- 172.21.15.83:0/4083422686 shutdown_connections 2024-09-21T00:15:42.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.632+0000 7f399f600640 1 --2- 172.21.15.83:0/4083422686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f399815f5a0 0x7f399815f9b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.632+0000 7f399f600640 1 -- 172.21.15.83:0/4083422686 >> 172.21.15.83:0/4083422686 conn(0x7f39980cca40 msgr2=0x7f39980cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:42.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.632+0000 7f399f600640 1 -- 172.21.15.83:0/4083422686 shutdown_connections 2024-09-21T00:15:42.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.632+0000 7f399f600640 1 -- 172.21.15.83:0/4083422686 wait complete. 2024-09-21T00:15:42.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.634+0000 7f399f600640 1 Processor -- start 2024-09-21T00:15:42.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.634+0000 7f399f600640 1 -- start start 2024-09-21T00:15:42.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399f600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39980cf930 0x7f3998152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:42.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399f600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399815b9f0 0x7f39980aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:42.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399f600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399815f5a0 0x7f39981f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:42.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399f600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f399806e180 con 0x7f39980cf930 2024-09-21T00:15:42.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399f600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f399806e000 con 0x7f399815b9f0 2024-09-21T00:15:42.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399f600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f399806e300 con 0x7f399815f5a0 2024-09-21T00:15:42.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399cc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39980cf930 0x7f3998152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399cc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39980cf930 0x7f3998152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55918/0 (socket says 172.21.15.83:55918) 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399cc00640 1 -- 172.21.15.83:0/2247818453 learned_addr learned my addr 172.21.15.83:0/2247818453 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f398fe00640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399815b9f0 0x7f39980aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399d600640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399815f5a0 0x7f39981f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399cc00640 1 -- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399815f5a0 msgr2=0x7f39981f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399cc00640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399815f5a0 0x7f39981f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399cc00640 1 -- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399815b9f0 msgr2=0x7f39980aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399cc00640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399815b9f0 0x7f39980aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399cc00640 1 -- 172.21.15.83:0/2247818453 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39980b59c0 con 0x7f39980cf930 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f398fe00640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399815b9f0 0x7f39980aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.636+0000 7f399d600640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399815f5a0 0x7f39981f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.637+0000 7f399cc00640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39980cf930 0x7f3998152c90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f398800c3d0 tx=0x7f398800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:42.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.637+0000 7f3995600640 1 -- 172.21.15.83:0/2247818453 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988011790 con 0x7f39980cf930 2024-09-21T00:15:42.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.637+0000 7f3995600640 1 -- 172.21.15.83:0/2247818453 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3988017070 con 0x7f39980cf930 2024-09-21T00:15:42.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.637+0000 7f399f600640 1 -- 172.21.15.83:0/2247818453 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39981554c0 con 0x7f39980cf930 2024-09-21T00:15:42.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.637+0000 7f3995600640 1 -- 172.21.15.83:0/2247818453 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988011cc0 con 0x7f39980cf930 2024-09-21T00:15:42.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.637+0000 7f399f600640 1 -- 172.21.15.83:0/2247818453 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39981f5bf0 con 0x7f39980cf930 2024-09-21T00:15:42.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.638+0000 7f399f600640 1 -- 172.21.15.83:0/2247818453 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f399815f9b0 con 0x7f39980cf930 2024-09-21T00:15:42.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.639+0000 7f3995600640 1 -- 172.21.15.83:0/2247818453 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f398801c460 con 0x7f39980cf930 2024-09-21T00:15:42.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.640+0000 7f3995600640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3974078bc0 0x7f397407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:42.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.640+0000 7f3995600640 1 -- 172.21.15.83:0/2247818453 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f398809ad50 con 0x7f39980cf930 2024-09-21T00:15:42.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.641+0000 7f398fe00640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3974078bc0 0x7f397407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:42.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.641+0000 7f398fe00640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3974078bc0 0x7f397407b0d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f39980cb140 tx=0x7f3980008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:42.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.645+0000 7f3995600640 1 -- 172.21.15.83:0/2247818453 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3988062f10 con 0x7f39980cf930 2024-09-21T00:15:42.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.835+0000 7f399f600640 1 -- 172.21.15.83:0/2247818453 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f399806ec30 con 0x7f39980cf930 2024-09-21T00:15:42.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.836+0000 7f3995600640 1 -- 172.21.15.83:0/2247818453 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+17157 (secure 0 0 0) 0x7f3988062810 con 0x7f39980cf930 2024-09-21T00:15:42.838 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:42.838 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":43,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:15:32.426112+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:15:14.312079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T00:15:15.307562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6837/1450693530":"2024-09-22T00:15:30.827804+0000","172.21.15.142:6835/1450693530":"2024-09-22T00:15:30.827804+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:15:42.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 -- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3974078bc0 msgr2=0x7f397407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:42.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3974078bc0 0x7f397407b0d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f39980cb140 tx=0x7f3980008040 comp rx=0 tx=0).stop 2024-09-21T00:15:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 -- 172.21.15.83:0/2247818453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39980cf930 msgr2=0x7f3998152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39980cf930 0x7f3998152c90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f398800c3d0 tx=0x7f398800c890 comp rx=0 tx=0).stop 2024-09-21T00:15:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 -- 172.21.15.83:0/2247818453 shutdown_connections 2024-09-21T00:15:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3974078bc0 0x7f397407b0d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399815f5a0 0x7f39981f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399815b9f0 0x7f39980aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 --2- 172.21.15.83:0/2247818453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39980cf930 0x7f3998152c90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 -- 172.21.15.83:0/2247818453 >> 172.21.15.83:0/2247818453 conn(0x7f39980cca40 msgr2=0x7f399806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 -- 172.21.15.83:0/2247818453 shutdown_connections 2024-09-21T00:15:42.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:42.839+0000 7f399f600640 1 -- 172.21.15.83:0/2247818453 wait complete. 2024-09-21T00:15:42.862 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T00:15:43.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.084+0000 7f1955600640 1 -- 172.21.15.83:0/1725829665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1934003c30 msgr2=0x7f1934004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:43.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.084+0000 7f1955600640 1 --2- 172.21.15.83:0/1725829665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1934003c30 0x7f1934004080 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f194000c4a0 tx=0x7f1934005830 comp rx=0 tx=0).stop 2024-09-21T00:15:43.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.084+0000 7f1955600640 1 -- 172.21.15.83:0/1725829665 shutdown_connections 2024-09-21T00:15:43.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.084+0000 7f1955600640 1 --2- 172.21.15.83:0/1725829665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1934003c30 0x7f1934004080 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:43.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.084+0000 7f1955600640 1 -- 172.21.15.83:0/1725829665 >> 172.21.15.83:0/1725829665 conn(0x7f19500b1b90 msgr2=0x7f19500b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:43.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.084+0000 7f1955600640 1 -- 172.21.15.83:0/1725829665 shutdown_connections 2024-09-21T00:15:43.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.084+0000 7f1955600640 1 -- 172.21.15.83:0/1725829665 wait complete. 2024-09-21T00:15:43.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.086+0000 7f1955600640 1 Processor -- start 2024-09-21T00:15:43.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.087+0000 7f1955600640 1 -- start start 2024-09-21T00:15:43.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.088+0000 7f1955600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1934003c30 0x7f195015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.088+0000 7f1955600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1950157e10 0x7f19501571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.088+0000 7f1955600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19500c5fd0 0x7f1950157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.088+0000 7f1955600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f195006e380 con 0x7f1950157e10 2024-09-21T00:15:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.088+0000 7f1955600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f195006e200 con 0x7f19500c5fd0 2024-09-21T00:15:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.088+0000 7f1955600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f195006e500 con 0x7f1934003c30 2024-09-21T00:15:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.088+0000 7f1946000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1950157e10 0x7f19501571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.088+0000 7f1946000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1950157e10 0x7f19501571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55928/0 (socket says 172.21.15.83:55928) 2024-09-21T00:15:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.088+0000 7f1946000640 1 -- 172.21.15.83:0/1593414465 learned_addr learned my addr 172.21.15.83:0/1593414465 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f194f400640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19500c5fd0 0x7f1950157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f194ea00640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1934003c30 0x7f195015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:43.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f1946000640 1 -- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1934003c30 msgr2=0x7f195015b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:43.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f1946000640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1934003c30 0x7f195015b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:43.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f1946000640 1 -- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19500c5fd0 msgr2=0x7f1950157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:43.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f1946000640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19500c5fd0 0x7f1950157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:43.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f1946000640 1 -- 172.21.15.83:0/1593414465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19500c8d40 con 0x7f1950157e10 2024-09-21T00:15:43.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f194ea00640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1934003c30 0x7f195015b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:43.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f1946000640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1950157e10 0x7f19501571e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1938011780 tx=0x7f1938011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:43.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f1947400640 1 -- 172.21.15.83:0/1593414465 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193800fae0 con 0x7f1950157e10 2024-09-21T00:15:43.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f1947400640 1 -- 172.21.15.83:0/1593414465 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f193800fd70 con 0x7f1950157e10 2024-09-21T00:15:43.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.089+0000 7f1955600640 1 -- 172.21.15.83:0/1593414465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19500c9240 con 0x7f1950157e10 2024-09-21T00:15:43.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.090+0000 7f1947400640 1 -- 172.21.15.83:0/1593414465 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938005280 con 0x7f1950157e10 2024-09-21T00:15:43.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.090+0000 7f1955600640 1 -- 172.21.15.83:0/1593414465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19500c9800 con 0x7f1950157e10 2024-09-21T00:15:43.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.091+0000 7f1955600640 1 -- 172.21.15.83:0/1593414465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19500749a0 con 0x7f1950157e10 2024-09-21T00:15:43.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.092+0000 7f1947400640 1 -- 172.21.15.83:0/1593414465 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1938005420 con 0x7f1950157e10 2024-09-21T00:15:43.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.093+0000 7f1947400640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f192c078b90 0x7f192c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:43.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.093+0000 7f1947400640 1 -- 172.21.15.83:0/1593414465 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f193809baf0 con 0x7f1950157e10 2024-09-21T00:15:43.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.093+0000 7f194ea00640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f192c078b90 0x7f192c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:43.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.094+0000 7f194ea00640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f192c078b90 0x7f192c07b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1940033000 tx=0x7f194002d070 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:43.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.097+0000 7f1947400640 1 -- 172.21.15.83:0/1593414465 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1938005710 con 0x7f1950157e10 2024-09-21T00:15:43.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.321+0000 7f1955600640 1 -- 172.21.15.83:0/1593414465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f19500cfb00 con 0x7f1950157e10 2024-09-21T00:15:43.323 INFO:tasks.ceph.mon.a.smithi083.stderr:2024-09-21T00:15:43.322+0000 7f6fcde00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:15:43.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.324+0000 7f1947400640 1 -- 172.21.15.83:0/1593414465 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f1938063cb0 con 0x7f1950157e10 2024-09-21T00:15:43.325 INFO:teuthology.orchestra.run.smithi083.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.326+0000 7f1955600640 1 -- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f192c078b90 msgr2=0x7f192c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.326+0000 7f1955600640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f192c078b90 0x7f192c07b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1940033000 tx=0x7f194002d070 comp rx=0 tx=0).stop 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.326+0000 7f1955600640 1 -- 172.21.15.83:0/1593414465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1950157e10 msgr2=0x7f19501571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.326+0000 7f1955600640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1950157e10 0x7f19501571e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1938011780 tx=0x7f1938011b80 comp rx=0 tx=0).stop 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.327+0000 7f1955600640 1 -- 172.21.15.83:0/1593414465 shutdown_connections 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.327+0000 7f1955600640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f192c078b90 0x7f192c07b0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.327+0000 7f1955600640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19500c5fd0 0x7f1950157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.327+0000 7f1955600640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1950157e10 0x7f19501571e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.327+0000 7f1955600640 1 --2- 172.21.15.83:0/1593414465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1934003c30 0x7f195015b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.327+0000 7f1955600640 1 -- 172.21.15.83:0/1593414465 >> 172.21.15.83:0/1593414465 conn(0x7f19500b1b90 msgr2=0x7f19500afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:43.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.327+0000 7f1955600640 1 -- 172.21.15.83:0/1593414465 shutdown_connections 2024-09-21T00:15:43.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.327+0000 7f1955600640 1 -- 172.21.15.83:0/1593414465 wait complete. 2024-09-21T00:15:43.336 INFO:tasks.ceph.mds.d.smithi142.stderr: -619> 2024-09-21T00:15:36.946+0000 7f40ddc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T00:15:43.354 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T00:15:43.450 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-09-21T00:15:43.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.577+0000 7f9d62800640 1 -- 172.21.15.83:0/1810342021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d5c0cddc0 msgr2=0x7f9d5c160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:43.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.577+0000 7f9d62800640 1 --2- 172.21.15.83:0/1810342021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d5c0cddc0 0x7f9d5c160a00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d54005fd0 tx=0x7f9d5402ab40 comp rx=0 tx=0).stop 2024-09-21T00:15:43.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.577+0000 7f9d62800640 1 -- 172.21.15.83:0/1810342021 shutdown_connections 2024-09-21T00:15:43.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.577+0000 7f9d62800640 1 --2- 172.21.15.83:0/1810342021 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d5c0cddc0 0x7f9d5c160a00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:43.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.577+0000 7f9d62800640 1 -- 172.21.15.83:0/1810342021 >> 172.21.15.83:0/1810342021 conn(0x7f9d5c06f920 msgr2=0x7f9d5c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:43.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.577+0000 7f9d62800640 1 -- 172.21.15.83:0/1810342021 shutdown_connections 2024-09-21T00:15:43.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.577+0000 7f9d62800640 1 -- 172.21.15.83:0/1810342021 wait complete. 2024-09-21T00:15:43.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.579+0000 7f9d62800640 1 Processor -- start 2024-09-21T00:15:43.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.580+0000 7f9d62800640 1 -- start start 2024-09-21T00:15:43.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d62800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c06e2c0 0x7f9d5c072c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:43.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d62800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d5c0cddc0 0x7f9d5c144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:43.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d62800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c144580 0x7f9d5c0a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:43.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d62800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c06d6a0 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d62800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c06d820 con 0x7f9d5c144580 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d62800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5c06d9a0 con 0x7f9d5c06e2c0 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d60a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d5c0cddc0 0x7f9d5c144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d60a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d5c0cddc0 0x7f9d5c144040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55942/0 (socket says 172.21.15.83:55942) 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d60a00640 1 -- 172.21.15.83:0/1075487631 learned_addr learned my addr 172.21.15.83:0/1075487631 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d61e00640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c144580 0x7f9d5c0a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.581+0000 7f9d61400640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c06e2c0 0x7f9d5c072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d60a00640 1 -- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c06e2c0 msgr2=0x7f9d5c072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d60a00640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c06e2c0 0x7f9d5c072c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d60a00640 1 -- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c144580 msgr2=0x7f9d5c0a9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d60a00640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c144580 0x7f9d5c0a9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d60a00640 1 -- 172.21.15.83:0/1075487631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5c073610 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d61e00640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c144580 0x7f9d5c0a9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:15:43.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d60a00640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d5c0cddc0 0x7f9d5c144040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c370 tx=0x7f9d4800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d59600640 1 -- 172.21.15.83:0/1075487631 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48017070 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d59600640 1 -- 172.21.15.83:0/1075487631 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d480035f0 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d59600640 1 -- 172.21.15.83:0/1075487631 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48003a40 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.582+0000 7f9d62800640 1 -- 172.21.15.83:0/1075487631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5c0738f0 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.583+0000 7f9d62800640 1 -- 172.21.15.83:0/1075487631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5c073eb0 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.584+0000 7f9d62800640 1 -- 172.21.15.83:0/1075487631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d5c160a00 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.585+0000 7f9d59600640 1 -- 172.21.15.83:0/1075487631 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d4801a070 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.586+0000 7f9d59600640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9d3c078b90 0x7f9d3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:43.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.586+0000 7f9d59600640 1 -- 172.21.15.83:0/1075487631 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6273+0+0 (secure 0 0 0) 0x7f9d4809a1d0 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.586+0000 7f9d61400640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9d3c078b90 0x7f9d3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:43.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.587+0000 7f9d61400640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9d3c078b90 0x7f9d3c07b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9d50000f60 tx=0x7f9d50009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:43.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.590+0000 7f9d59600640 1 -- 172.21.15.83:0/1075487631 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9d5c0ce1d0 con 0x7f9d5c0cddc0 2024-09-21T00:15:43.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:43.814+0000 7f9d62800640 1 -- 172.21.15.83:0/1075487631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9d5c0733a0 con 0x7f9d5c0cddc0 2024-09-21T00:15:44.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.326+0000 7f9d59600640 1 -- 172.21.15.83:0/1075487631 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f9d48061d70 con 0x7f9d5c0cddc0 2024-09-21T00:15:44.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 -- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9d3c078b90 msgr2=0x7f9d3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:44.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9d3c078b90 0x7f9d3c07b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9d50000f60 tx=0x7f9d50009040 comp rx=0 tx=0).stop 2024-09-21T00:15:44.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 -- 172.21.15.83:0/1075487631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d5c0cddc0 msgr2=0x7f9d5c144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:44.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d5c0cddc0 0x7f9d5c144040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c370 tx=0x7f9d4800c830 comp rx=0 tx=0).stop 2024-09-21T00:15:44.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 -- 172.21.15.83:0/1075487631 shutdown_connections 2024-09-21T00:15:44.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9d3c078b90 0x7f9d3c07b0a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:44.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c144580 0x7f9d5c0a9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:44.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d5c0cddc0 0x7f9d5c144040 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:44.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 --2- 172.21.15.83:0/1075487631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c06e2c0 0x7f9d5c072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:44.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 -- 172.21.15.83:0/1075487631 >> 172.21.15.83:0/1075487631 conn(0x7f9d5c06f920 msgr2=0x7f9d5c15bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:44.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 -- 172.21.15.83:0/1075487631 shutdown_connections 2024-09-21T00:15:44.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.329+0000 7f9d62800640 1 -- 172.21.15.83:0/1075487631 wait complete. 2024-09-21T00:15:44.352 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T00:15:44.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.577+0000 7fe6afe00640 1 -- 172.21.15.83:0/1809166114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6b015f2a0 msgr2=0x7fe6b0072f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:44.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.577+0000 7fe6afe00640 1 --2- 172.21.15.83:0/1809166114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6b015f2a0 0x7fe6b0072f20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe6b006f530 tx=0x7fe6a802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:15:44.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.577+0000 7fe6afe00640 1 -- 172.21.15.83:0/1809166114 shutdown_connections 2024-09-21T00:15:44.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.577+0000 7fe6afe00640 1 --2- 172.21.15.83:0/1809166114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6b015f2a0 0x7fe6b0072f20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:44.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.577+0000 7fe6afe00640 1 --2- 172.21.15.83:0/1809166114 >> v2:172.21.15.142:3300/0 conn(0x7fe6b00b4b10 0x7fe6b015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:44.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.577+0000 7fe6afe00640 1 -- 172.21.15.83:0/1809166114 >> 172.21.15.83:0/1809166114 conn(0x7fe6b00d0460 msgr2=0x7fe6b006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:44.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.578+0000 7fe6afe00640 1 -- 172.21.15.83:0/1809166114 shutdown_connections 2024-09-21T00:15:44.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.578+0000 7fe6afe00640 1 -- 172.21.15.83:0/1809166114 wait complete. 2024-09-21T00:15:44.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.580+0000 7fe6afe00640 1 Processor -- start 2024-09-21T00:15:44.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.580+0000 7fe6afe00640 1 -- start start 2024-09-21T00:15:44.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.581+0000 7fe6afe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6b006f0c0 0x7fe6b014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:44.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.581+0000 7fe6afe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b00b4b10 0x7fe6b014b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:44.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.581+0000 7fe6afe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b015f2a0 0x7fe6b01f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:44.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.581+0000 7fe6afe00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0073940 con 0x7fe6b006f0c0 2024-09-21T00:15:44.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.581+0000 7fe6afe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b00737c0 con 0x7fe6b015f2a0 2024-09-21T00:15:44.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.581+0000 7fe6afe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b0073ac0 con 0x7fe6b00b4b10 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6aea00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6b006f0c0 0x7fe6b014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6aea00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6b006f0c0 0x7fe6b014ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55968/0 (socket says 172.21.15.83:55968) 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6aea00640 1 -- 172.21.15.83:0/1957760812 learned_addr learned my addr 172.21.15.83:0/1957760812 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6ae000640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b00b4b10 0x7fe6b014b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6aea00640 1 -- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b00b4b10 msgr2=0x7fe6b014b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6af400640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b015f2a0 0x7fe6b01f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6aea00640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b00b4b10 0x7fe6b014b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6aea00640 1 -- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b015f2a0 msgr2=0x7fe6b01f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6aea00640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b015f2a0 0x7fe6b01f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6aea00640 1 -- 172.21.15.83:0/1957760812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b0155820 con 0x7fe6b006f0c0 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6ae000640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b00b4b10 0x7fe6b014b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6af400640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b015f2a0 0x7fe6b01f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:44.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6aea00640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6b006f0c0 0x7fe6b014ca60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000b420 tx=0x7fe6a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:44.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.582+0000 7fe6a6a00640 1 -- 172.21.15.83:0/1957760812 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0011830 con 0x7fe6b006f0c0 2024-09-21T00:15:44.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.583+0000 7fe6a6a00640 1 -- 172.21.15.83:0/1957760812 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6a0016070 con 0x7fe6b006f0c0 2024-09-21T00:15:44.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.583+0000 7fe6afe00640 1 -- 172.21.15.83:0/1957760812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b0155b00 con 0x7fe6b006f0c0 2024-09-21T00:15:44.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.583+0000 7fe6a6a00640 1 -- 172.21.15.83:0/1957760812 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0011d60 con 0x7fe6b006f0c0 2024-09-21T00:15:44.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.583+0000 7fe6afe00640 1 -- 172.21.15.83:0/1957760812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b014c560 con 0x7fe6b006f0c0 2024-09-21T00:15:44.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.584+0000 7fe6afe00640 1 -- 172.21.15.83:0/1957760812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b0074000 con 0x7fe6b006f0c0 2024-09-21T00:15:44.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.585+0000 7fe6a6a00640 1 -- 172.21.15.83:0/1957760812 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe6a001b460 con 0x7fe6b006f0c0 2024-09-21T00:15:44.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.586+0000 7fe6a6a00640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe690078bc0 0x7fe69007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:44.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.586+0000 7fe6a6a00640 1 -- 172.21.15.83:0/1957760812 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6273+0+0 (secure 0 0 0) 0x7fe6a009aad0 con 0x7fe6b006f0c0 2024-09-21T00:15:44.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.587+0000 7fe6ae000640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe690078bc0 0x7fe69007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:44.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.587+0000 7fe6ae000640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe690078bc0 0x7fe69007b0d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009aa0 tx=0x7fe69c005db0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:44.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.590+0000 7fe6a6a00640 1 -- 172.21.15.83:0/1957760812 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe6a0020020 con 0x7fe6b006f0c0 2024-09-21T00:15:44.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:44.778+0000 7fe6afe00640 1 -- 172.21.15.83:0/1957760812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe6b015eeb0 con 0x7fe6b006f0c0 2024-09-21T00:15:45.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.701+0000 7fe6a6a00640 1 -- 172.21.15.83:0/1957760812 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) ==== 181+0+0 (secure 0 0 0) 0x7fe6a0062c30 con 0x7fe6b006f0c0 2024-09-21T00:15:45.703 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' removed 2024-09-21T00:15:45.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.705+0000 7fe6afe00640 1 -- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe690078bc0 msgr2=0x7fe69007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:45.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.705+0000 7fe6afe00640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe690078bc0 0x7fe69007b0d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009aa0 tx=0x7fe69c005db0 comp rx=0 tx=0).stop 2024-09-21T00:15:45.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.705+0000 7fe6afe00640 1 -- 172.21.15.83:0/1957760812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6b006f0c0 msgr2=0x7fe6b014ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:45.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.705+0000 7fe6afe00640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6b006f0c0 0x7fe6b014ca60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000b420 tx=0x7fe6a000b8e0 comp rx=0 tx=0).stop 2024-09-21T00:15:45.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.706+0000 7fe6afe00640 1 -- 172.21.15.83:0/1957760812 shutdown_connections 2024-09-21T00:15:45.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.706+0000 7fe6afe00640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe690078bc0 0x7fe69007b0d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:45.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.706+0000 7fe6afe00640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b015f2a0 0x7fe6b01f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:45.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.706+0000 7fe6afe00640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b00b4b10 0x7fe6b014b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:45.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.706+0000 7fe6afe00640 1 --2- 172.21.15.83:0/1957760812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6b006f0c0 0x7fe6b014ca60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:45.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.706+0000 7fe6afe00640 1 -- 172.21.15.83:0/1957760812 >> 172.21.15.83:0/1957760812 conn(0x7fe6b00d0460 msgr2=0x7fe6b015d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:45.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.706+0000 7fe6afe00640 1 -- 172.21.15.83:0/1957760812 shutdown_connections 2024-09-21T00:15:45.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.706+0000 7fe6afe00640 1 -- 172.21.15.83:0/1957760812 wait complete. 2024-09-21T00:15:45.735 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T00:15:45.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.968+0000 7f35cd400640 1 -- 172.21.15.83:0/4243779334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35c8160810 msgr2=0x7f35c806d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:45.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.968+0000 7f35cd400640 1 --2- 172.21.15.83:0/4243779334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35c8160810 0x7f35c806d2e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f35b4005fd0 tx=0x7f35b402a530 comp rx=0 tx=0).stop 2024-09-21T00:15:45.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.968+0000 7f35cd400640 1 -- 172.21.15.83:0/4243779334 shutdown_connections 2024-09-21T00:15:45.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.968+0000 7f35cd400640 1 --2- 172.21.15.83:0/4243779334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35c8160c20 0x7f35c806d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:45.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.968+0000 7f35cd400640 1 --2- 172.21.15.83:0/4243779334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35c8160810 0x7f35c806d2e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:45.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.968+0000 7f35cd400640 1 -- 172.21.15.83:0/4243779334 >> 172.21.15.83:0/4243779334 conn(0x7f35c80ccac0 msgr2=0x7f35c80cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:45.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.968+0000 7f35cd400640 1 -- 172.21.15.83:0/4243779334 shutdown_connections 2024-09-21T00:15:45.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.968+0000 7f35cd400640 1 -- 172.21.15.83:0/4243779334 wait complete. 2024-09-21T00:15:45.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.970+0000 7f35cd400640 1 Processor -- start 2024-09-21T00:15:45.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.970+0000 7f35cd400640 1 -- start start 2024-09-21T00:15:45.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.971+0000 7f35cd400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35c80ca690 0x7f35c80c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:45.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.971+0000 7f35cd400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35c8160810 0x7f35c81fa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:45.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35cd400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c8160c20 0x7f35c81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:45.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35cd400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f35c806e0f0 con 0x7f35c80ca690 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35cd400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f35c806df70 con 0x7f35c8160c20 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35cd400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f35c806e270 con 0x7f35c8160810 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35c6800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35c80ca690 0x7f35c80c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35c6800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35c80ca690 0x7f35c80c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55984/0 (socket says 172.21.15.83:55984) 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35c6800640 1 -- 172.21.15.83:0/1460364020 learned_addr learned my addr 172.21.15.83:0/1460364020 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35c7200640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c8160c20 0x7f35c81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35c5e00640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35c8160810 0x7f35c81fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35c6800640 1 -- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35c8160810 msgr2=0x7f35c81fa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35c6800640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35c8160810 0x7f35c81fa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35c6800640 1 -- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c8160c20 msgr2=0x7f35c81584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35c6800640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c8160c20 0x7f35c81584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:45.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.972+0000 7f35c6800640 1 -- 172.21.15.83:0/1460364020 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c81f6250 con 0x7f35c80ca690 2024-09-21T00:15:45.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.973+0000 7f35c6800640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35c80ca690 0x7f35c80c8cb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f35b800b420 tx=0x7f35b800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:45.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.973+0000 7f35bea00640 1 -- 172.21.15.83:0/1460364020 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8011830 con 0x7f35c80ca690 2024-09-21T00:15:45.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.973+0000 7f35bea00640 1 -- 172.21.15.83:0/1460364020 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35b8016070 con 0x7f35c80ca690 2024-09-21T00:15:45.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.973+0000 7f35cd400640 1 -- 172.21.15.83:0/1460364020 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c81f6530 con 0x7f35c80ca690 2024-09-21T00:15:45.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.973+0000 7f35bea00640 1 -- 172.21.15.83:0/1460364020 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8011d60 con 0x7f35c80ca690 2024-09-21T00:15:45.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.973+0000 7f35cd400640 1 -- 172.21.15.83:0/1460364020 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c8158a10 con 0x7f35c80ca690 2024-09-21T00:15:45.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.974+0000 7f35cd400640 1 -- 172.21.15.83:0/1460364020 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c8160100 con 0x7f35c80ca690 2024-09-21T00:15:45.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.975+0000 7f35bea00640 1 -- 172.21.15.83:0/1460364020 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f35b801b460 con 0x7f35c80ca690 2024-09-21T00:15:45.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.977+0000 7f35bea00640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f35a8078bc0 0x7f35a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:45.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.977+0000 7f35bea00640 1 -- 172.21.15.83:0/1460364020 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5835+0+0 (secure 0 0 0) 0x7f35b809a9a0 con 0x7f35c80ca690 2024-09-21T00:15:45.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.977+0000 7f35c5e00640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f35a8078bc0 0x7f35a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:45.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.978+0000 7f35c5e00640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f35a8078bc0 0x7f35a807b0d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f35b4033000 tx=0x7f35b4004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:45.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:45.981+0000 7f35bea00640 1 -- 172.21.15.83:0/1460364020 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f35b8020020 con 0x7f35c80ca690 2024-09-21T00:15:46.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.166+0000 7f35cd400640 1 -- 172.21.15.83:0/1460364020 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f35c8073320 con 0x7f35c80ca690 2024-09-21T00:15:46.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.704+0000 7f35bea00640 1 -- 172.21.15.83:0/1460364020 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) ==== 169+0+0 (secure 0 0 0) 0x7f35b8062cc0 con 0x7f35c80ca690 2024-09-21T00:15:46.705 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' removed 2024-09-21T00:15:46.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.707+0000 7f35cd400640 1 -- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f35a8078bc0 msgr2=0x7f35a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:46.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.707+0000 7f35cd400640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f35a8078bc0 0x7f35a807b0d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f35b4033000 tx=0x7f35b4004730 comp rx=0 tx=0).stop 2024-09-21T00:15:46.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.707+0000 7f35cd400640 1 -- 172.21.15.83:0/1460364020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35c80ca690 msgr2=0x7f35c80c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:46.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.707+0000 7f35cd400640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35c80ca690 0x7f35c80c8cb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f35b800b420 tx=0x7f35b800b8e0 comp rx=0 tx=0).stop 2024-09-21T00:15:46.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.707+0000 7f35cd400640 1 -- 172.21.15.83:0/1460364020 shutdown_connections 2024-09-21T00:15:46.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.707+0000 7f35cd400640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f35a8078bc0 0x7f35a807b0d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:46.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.707+0000 7f35cd400640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c8160c20 0x7f35c81584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:46.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.707+0000 7f35cd400640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35c8160810 0x7f35c81fa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:46.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.707+0000 7f35cd400640 1 --2- 172.21.15.83:0/1460364020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35c80ca690 0x7f35c80c8cb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:46.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.707+0000 7f35cd400640 1 -- 172.21.15.83:0/1460364020 >> 172.21.15.83:0/1460364020 conn(0x7f35c80ccac0 msgr2=0x7f35c80aced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:46.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.708+0000 7f35cd400640 1 -- 172.21.15.83:0/1460364020 shutdown_connections 2024-09-21T00:15:46.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.708+0000 7f35cd400640 1 -- 172.21.15.83:0/1460364020 wait complete. 2024-09-21T00:15:46.737 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T00:15:46.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.959+0000 7f9ec7a00640 1 -- 172.21.15.83:0/1859769665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ec006ddf0 msgr2=0x7f9ec006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:46.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.959+0000 7f9ec7a00640 1 --2- 172.21.15.83:0/1859769665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ec006ddf0 0x7f9ec006e200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9ec006fe40 tx=0x7f9ea802a560 comp rx=0 tx=0).stop 2024-09-21T00:15:46.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.959+0000 7f9ec7a00640 1 -- 172.21.15.83:0/1859769665 shutdown_connections 2024-09-21T00:15:46.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.959+0000 7f9ec7a00640 1 --2- 172.21.15.83:0/1859769665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ec006ddf0 0x7f9ec006e200 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:46.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.959+0000 7f9ec7a00640 1 --2- 172.21.15.83:0/1859769665 >> v2:172.21.15.142:3300/0 conn(0x7f9ec00cef00 0x7f9ec00cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:46.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.959+0000 7f9ec7a00640 1 -- 172.21.15.83:0/1859769665 >> 172.21.15.83:0/1859769665 conn(0x7f9ec00b1b90 msgr2=0x7f9ec00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:46.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.959+0000 7f9ec7a00640 1 -- 172.21.15.83:0/1859769665 shutdown_connections 2024-09-21T00:15:46.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.959+0000 7f9ec7a00640 1 -- 172.21.15.83:0/1859769665 wait complete. 2024-09-21T00:15:46.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.961+0000 7f9ec7a00640 1 Processor -- start 2024-09-21T00:15:46.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.961+0000 7f9ec7a00640 1 -- start start 2024-09-21T00:15:46.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.962+0000 7f9ec7a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec006ddf0 0x7f9ec00be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:46.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.962+0000 7f9ec7a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ec00cef00 0x7f9ec0072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:46.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.962+0000 7f9ec7a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ec0156a50 0x7f9ec0073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:46.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec7a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec00cf850 con 0x7f9ec0156a50 2024-09-21T00:15:46.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec7a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0161060 con 0x7f9ec006ddf0 2024-09-21T00:15:46.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec7a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec00cf9d0 con 0x7f9ec00cef00 2024-09-21T00:15:46.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec5a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ec0156a50 0x7f9ec0073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:46.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec5a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ec0156a50 0x7f9ec0073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55994/0 (socket says 172.21.15.83:55994) 2024-09-21T00:15:46.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec5a00640 1 -- 172.21.15.83:0/2952405161 learned_addr learned my addr 172.21.15.83:0/2952405161 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:46.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec5000640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec006ddf0 0x7f9ec00be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:46.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9eb7e00640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ec00cef00 0x7f9ec0072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:46.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec5a00640 1 -- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ec00cef00 msgr2=0x7f9ec0072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:46.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec5a00640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ec00cef00 0x7f9ec0072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:46.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec5a00640 1 -- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec006ddf0 msgr2=0x7f9ec00be7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:46.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec5a00640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec006ddf0 0x7f9ec00be7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:46.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.963+0000 7f9ec5a00640 1 -- 172.21.15.83:0/2952405161 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec00a0620 con 0x7f9ec0156a50 2024-09-21T00:15:46.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.964+0000 7f9ec5a00640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ec0156a50 0x7f9ec0073120 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e990 tx=0x7f9eb800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:46.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.964+0000 7f9ebd600640 1 -- 172.21.15.83:0/2952405161 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8004d20 con 0x7f9ec0156a50 2024-09-21T00:15:46.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.964+0000 7f9ebd600640 1 -- 172.21.15.83:0/2952405161 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9eb800ca40 con 0x7f9ec0156a50 2024-09-21T00:15:46.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.964+0000 7f9ec7a00640 1 -- 172.21.15.83:0/2952405161 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec00a0900 con 0x7f9ec0156a50 2024-09-21T00:15:46.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.964+0000 7f9ebd600640 1 -- 172.21.15.83:0/2952405161 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8005020 con 0x7f9ec0156a50 2024-09-21T00:15:46.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.964+0000 7f9ec7a00640 1 -- 172.21.15.83:0/2952405161 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec00b89e0 con 0x7f9ec0156a50 2024-09-21T00:15:46.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.965+0000 7f9ec7a00640 1 -- 172.21.15.83:0/2952405161 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec006e200 con 0x7f9ec0156a50 2024-09-21T00:15:46.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.966+0000 7f9ebd600640 1 -- 172.21.15.83:0/2952405161 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9eb80051c0 con 0x7f9ec0156a50 2024-09-21T00:15:46.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.967+0000 7f9ebd600640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9e9c078bc0 0x7f9e9c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:46.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.967+0000 7f9ebd600640 1 -- 172.21.15.83:0/2952405161 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f9eb809b3c0 con 0x7f9ec0156a50 2024-09-21T00:15:46.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.967+0000 7f9ec5000640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9e9c078bc0 0x7f9e9c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:46.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.968+0000 7f9ec5000640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9e9c078bc0 0x7f9e9c07b0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0006fd0 tx=0x7f9eb0009060 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:46.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:46.972+0000 7f9ebd600640 1 -- 172.21.15.83:0/2952405161 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9eb8016030 con 0x7f9ec0156a50 2024-09-21T00:15:47.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.158+0000 7f9ec7a00640 1 -- 172.21.15.83:0/2952405161 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f9ec00a0340 con 0x7f9ec0156a50 2024-09-21T00:15:47.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.162+0000 7f9ebd600640 1 -- 172.21.15.83:0/2952405161 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f9eb8063350 con 0x7f9ec0156a50 2024-09-21T00:15:47.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 -- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9e9c078bc0 msgr2=0x7f9e9c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:47.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9e9c078bc0 0x7f9e9c07b0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0006fd0 tx=0x7f9eb0009060 comp rx=0 tx=0).stop 2024-09-21T00:15:47.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 -- 172.21.15.83:0/2952405161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ec0156a50 msgr2=0x7f9ec0073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:47.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ec0156a50 0x7f9ec0073120 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e990 tx=0x7f9eb800ee50 comp rx=0 tx=0).stop 2024-09-21T00:15:47.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 -- 172.21.15.83:0/2952405161 shutdown_connections 2024-09-21T00:15:47.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f9e9c078bc0 0x7f9e9c07b0d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ec0156a50 0x7f9ec0073120 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ec00cef00 0x7f9ec0072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 --2- 172.21.15.83:0/2952405161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ec006ddf0 0x7f9ec00be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 -- 172.21.15.83:0/2952405161 >> 172.21.15.83:0/2952405161 conn(0x7f9ec00b1b90 msgr2=0x7f9ec00b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:47.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 -- 172.21.15.83:0/2952405161 shutdown_connections 2024-09-21T00:15:47.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.165+0000 7f9ec7a00640 1 -- 172.21.15.83:0/2952405161 wait complete. 2024-09-21T00:15:47.189 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal' 2024-09-21T00:15:47.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.407+0000 7fb8d8400640 1 -- 172.21.15.83:0/1095105099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8d015e7c0 msgr2=0x7fb8d006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:47.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.407+0000 7fb8d8400640 1 --2- 172.21.15.83:0/1095105099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8d015e7c0 0x7fb8d006ddf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0071cc0 tx=0x7fb8bc02a600 comp rx=0 tx=0).stop 2024-09-21T00:15:47.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.408+0000 7fb8d8400640 1 -- 172.21.15.83:0/1095105099 shutdown_connections 2024-09-21T00:15:47.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.408+0000 7fb8d8400640 1 --2- 172.21.15.83:0/1095105099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8d015e7c0 0x7fb8d006ddf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.408+0000 7fb8d8400640 1 --2- 172.21.15.83:0/1095105099 >> v2:172.21.15.142:3300/0 conn(0x7fb8d00cb750 0x7fb8d00af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.408+0000 7fb8d8400640 1 -- 172.21.15.83:0/1095105099 >> 172.21.15.83:0/1095105099 conn(0x7fb8d00cca40 msgr2=0x7fb8d00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:47.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.408+0000 7fb8d8400640 1 -- 172.21.15.83:0/1095105099 shutdown_connections 2024-09-21T00:15:47.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.408+0000 7fb8d8400640 1 -- 172.21.15.83:0/1095105099 wait complete. 2024-09-21T00:15:47.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.410+0000 7fb8d8400640 1 Processor -- start 2024-09-21T00:15:47.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.410+0000 7fb8d8400640 1 -- start start 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.411+0000 7fb8d8400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8d006e330 0x7fb8d015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.411+0000 7fb8d8400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d015e7c0 0x7fb8d01e9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.411+0000 7fb8d8400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8d01e8e50 0x7fb8d006f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.411+0000 7fb8d8400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d00af210 con 0x7fb8d01e8e50 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.411+0000 7fb8d8400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d00af090 con 0x7fb8d015e7c0 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.411+0000 7fb8d8400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d0162ab0 con 0x7fb8d006e330 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d6400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8d01e8e50 0x7fb8d006f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d6400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8d01e8e50 0x7fb8d006f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56008/0 (socket says 172.21.15.83:56008) 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d6400640 1 -- 172.21.15.83:0/1933815037 learned_addr learned my addr 172.21.15.83:0/1933815037 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d5000640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d015e7c0 0x7fb8d01e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:47.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d5a00640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8d006e330 0x7fb8d015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:47.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d6400640 1 -- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8d006e330 msgr2=0x7fb8d015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d6400640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8d006e330 0x7fb8d015a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d6400640 1 -- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d015e7c0 msgr2=0x7fb8d01e9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d6400640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d015e7c0 0x7fb8d01e9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d6400640 1 -- 172.21.15.83:0/1933815037 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d01f8c30 con 0x7fb8d01e8e50 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d5000640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d015e7c0 0x7fb8d01e9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.412+0000 7fb8d6400640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8d01e8e50 0x7fb8d006f230 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c6e0 tx=0x7fb8c800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.413+0000 7fb8cd600640 1 -- 172.21.15.83:0/1933815037 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8003b70 con 0x7fb8d01e8e50 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.413+0000 7fb8cd600640 1 -- 172.21.15.83:0/1933815037 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8c8003d30 con 0x7fb8d01e8e50 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.413+0000 7fb8d8400640 1 -- 172.21.15.83:0/1933815037 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d01f8f10 con 0x7fb8d01e8e50 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.413+0000 7fb8cd600640 1 -- 172.21.15.83:0/1933815037 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8005330 con 0x7fb8d01e8e50 2024-09-21T00:15:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.413+0000 7fb8d8400640 1 -- 172.21.15.83:0/1933815037 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d01f94d0 con 0x7fb8d01e8e50 2024-09-21T00:15:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.414+0000 7fb8d8400640 1 -- 172.21.15.83:0/1933815037 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d00cb750 con 0x7fb8d01e8e50 2024-09-21T00:15:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.415+0000 7fb8cd600640 1 -- 172.21.15.83:0/1933815037 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb8c80054d0 con 0x7fb8d01e8e50 2024-09-21T00:15:47.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.416+0000 7fb8cd600640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb8b0078b90 0x7fb8b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:47.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.416+0000 7fb8cd600640 1 -- 172.21.15.83:0/1933815037 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7fb8c809aa80 con 0x7fb8d01e8e50 2024-09-21T00:15:47.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.417+0000 7fb8d5a00640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb8b0078b90 0x7fb8b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.417+0000 7fb8d5a00640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb8b0078b90 0x7fb8b007b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4005d70 tx=0x7fb8c4005d00 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:47.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.421+0000 7fb8cd600640 1 -- 172.21.15.83:0/1933815037 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb8c809ce20 con 0x7fb8d01e8e50 2024-09-21T00:15:47.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.684+0000 7fb8d8400640 1 -- 172.21.15.83:0/1933815037 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]} v 0) -- 0x7fb8d00b5f40 con 0x7fb8d01e8e50 2024-09-21T00:15:47.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.717+0000 7fb8cd600640 1 -- 172.21.15.83:0/1933815037 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]}]=0 v113) ==== 159+0+0 (secure 0 0 0) 0x7fb8d006e740 con 0x7fb8d01e8e50 2024-09-21T00:15:47.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 -- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb8b0078b90 msgr2=0x7fb8b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:47.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb8b0078b90 0x7fb8b007b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4005d70 tx=0x7fb8c4005d00 comp rx=0 tx=0).stop 2024-09-21T00:15:47.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 -- 172.21.15.83:0/1933815037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8d01e8e50 msgr2=0x7fb8d006f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:47.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8d01e8e50 0x7fb8d006f230 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c6e0 tx=0x7fb8c800cba0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 -- 172.21.15.83:0/1933815037 shutdown_connections 2024-09-21T00:15:47.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fb8b0078b90 0x7fb8b007b0a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8d01e8e50 0x7fb8d006f230 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d015e7c0 0x7fb8d01e9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 --2- 172.21.15.83:0/1933815037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8d006e330 0x7fb8d015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:47.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 -- 172.21.15.83:0/1933815037 >> 172.21.15.83:0/1933815037 conn(0x7fb8d00cca40 msgr2=0x7fb8d00b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:47.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 -- 172.21.15.83:0/1933815037 shutdown_connections 2024-09-21T00:15:47.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:47.720+0000 7fb8d8400640 1 -- 172.21.15.83:0/1933815037 wait complete. 2024-09-21T00:15:47.743 INFO:tasks.cephfs_test_runner:test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) ... ok 2024-09-21T00:15:47.743 INFO:tasks.cephfs_test_runner: 2024-09-21T00:15:47.743 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-21T00:15:47.743 INFO:tasks.cephfs_test_runner:Ran 1 test in 53.876s 2024-09-21T00:15:47.743 INFO:tasks.cephfs_test_runner: 2024-09-21T00:15:47.743 INFO:tasks.cephfs_test_runner:OK 2024-09-21T00:15:47.743 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-21T00:15:47.751 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T00:15:47.774 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T00:15:47.774 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:15:47.774 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:47.809 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052627,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T00:15:47.809 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T00:15:47.809 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:47.884 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052627,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T00:15:47.885 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:15:47.885 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:47.924 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T00:15:47.924 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T00:15:47.925 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:15:48.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T00:15:48.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:48.002 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T00:15:48.038 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T00:15:48.038 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T00:15:48.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:48.039 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:15:48.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:48.137 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T00:15:48.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:48.404 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-09-21T00:15:48.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:48.717 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T00:15:48.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:48.754 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-09-21T00:15:48.855 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2024-09-21T00:15:48.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:15:48.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:48.858 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-21T00:15:48.898 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T00:15:48.899 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T00:15:48.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:48.899 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T00:15:48.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:48.999 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T00:15:49.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:49.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-21T00:15:49.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:49.570 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-21T00:15:49.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:15:49.606 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-21T00:15:49.704 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-09-21T00:15:49.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:15:49.707 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T00:15:49.722 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T00:15:49.722 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:15:49.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.947+0000 7fa752c00640 1 -- 172.21.15.83:0/2032404236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa74c0cddc0 msgr2=0x7fa74c0cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:49.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.947+0000 7fa752c00640 1 --2- 172.21.15.83:0/2032404236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa74c0cddc0 0x7fa74c0cc810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa740009830 tx=0x7fa74002a520 comp rx=0 tx=0).stop 2024-09-21T00:15:49.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.947+0000 7fa752c00640 1 -- 172.21.15.83:0/2032404236 shutdown_connections 2024-09-21T00:15:49.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.947+0000 7fa752c00640 1 --2- 172.21.15.83:0/2032404236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa74c0cddc0 0x7fa74c0cc810 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:49.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.947+0000 7fa752c00640 1 -- 172.21.15.83:0/2032404236 >> 172.21.15.83:0/2032404236 conn(0x7fa74c06f940 msgr2=0x7fa74c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:49.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.947+0000 7fa752c00640 1 -- 172.21.15.83:0/2032404236 shutdown_connections 2024-09-21T00:15:49.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.947+0000 7fa752c00640 1 -- 172.21.15.83:0/2032404236 wait complete. 2024-09-21T00:15:49.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.949+0000 7fa752c00640 1 Processor -- start 2024-09-21T00:15:49.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.950+0000 7fa752c00640 1 -- start start 2024-09-21T00:15:49.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa752c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa74c0b50a0 0x7fa74c1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:49.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa752c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa74c0ccd50 0x7fa74c072c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:49.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa752c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa74c0cddc0 0x7fa74c1ef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:49.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa752c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c0ce330 con 0x7fa74c0ccd50 2024-09-21T00:15:49.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa752c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c06e5f0 con 0x7fa74c0b50a0 2024-09-21T00:15:49.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa752c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa74c15d630 con 0x7fa74c0cddc0 2024-09-21T00:15:49.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa750e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa74c0ccd50 0x7fa74c072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:49.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa750e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa74c0ccd50 0x7fa74c072c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56028/0 (socket says 172.21.15.83:56028) 2024-09-21T00:15:49.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa750e00640 1 -- 172.21.15.83:0/658234630 learned_addr learned my addr 172.21.15.83:0/658234630 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:49.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa752200640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa74c0cddc0 0x7fa74c1ef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:49.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.951+0000 7fa751800640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa74c0b50a0 0x7fa74c1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:49.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.952+0000 7fa750e00640 1 -- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa74c0cddc0 msgr2=0x7fa74c1ef4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:49.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.952+0000 7fa750e00640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa74c0cddc0 0x7fa74c1ef4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:49.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.952+0000 7fa750e00640 1 -- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa74c0b50a0 msgr2=0x7fa74c1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:49.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.952+0000 7fa750e00640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa74c0b50a0 0x7fa74c1545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:49.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.952+0000 7fa750e00640 1 -- 172.21.15.83:0/658234630 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c0afc70 con 0x7fa74c0ccd50 2024-09-21T00:15:49.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.952+0000 7fa750e00640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa74c0ccd50 0x7fa74c072c00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa73800c370 tx=0x7fa73800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:49.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.952+0000 7fa749600640 1 -- 172.21.15.83:0/658234630 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738017070 con 0x7fa74c0ccd50 2024-09-21T00:15:49.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.952+0000 7fa749600640 1 -- 172.21.15.83:0/658234630 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7380035f0 con 0x7fa74c0ccd50 2024-09-21T00:15:49.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.952+0000 7fa752c00640 1 -- 172.21.15.83:0/658234630 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c0aff50 con 0x7fa74c0ccd50 2024-09-21T00:15:49.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.952+0000 7fa749600640 1 -- 172.21.15.83:0/658234630 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738003a40 con 0x7fa74c0ccd50 2024-09-21T00:15:49.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.953+0000 7fa752c00640 1 -- 172.21.15.83:0/658234630 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c0b0510 con 0x7fa74c0ccd50 2024-09-21T00:15:49.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.954+0000 7fa752c00640 1 -- 172.21.15.83:0/658234630 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74c0b4da0 con 0x7fa74c0ccd50 2024-09-21T00:15:49.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.955+0000 7fa749600640 1 -- 172.21.15.83:0/658234630 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa73801a070 con 0x7fa74c0ccd50 2024-09-21T00:15:49.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.956+0000 7fa749600640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa72c078b90 0x7fa72c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:49.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.956+0000 7fa749600640 1 -- 172.21.15.83:0/658234630 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7fa738099ed0 con 0x7fa74c0ccd50 2024-09-21T00:15:49.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.956+0000 7fa751800640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa72c078b90 0x7fa72c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:49.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.957+0000 7fa751800640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa72c078b90 0x7fa72c07b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa740034000 tx=0x7fa740004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:49.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:49.960+0000 7fa749600640 1 -- 172.21.15.83:0/658234630 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa738061d40 con 0x7fa74c0ccd50 2024-09-21T00:15:50.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.141+0000 7fa752c00640 1 -- 172.21.15.83:0/658234630 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa74c073140 con 0x7fa72c078b90 2024-09-21T00:15:50.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.142+0000 7fa749600640 1 -- 172.21.15.83:0/658234630 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13478 (secure 0 0 0) 0x7fa74c073140 con 0x7fa72c078b90 2024-09-21T00:15:50.143 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:50.144 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:15:50.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 -- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa72c078b90 msgr2=0x7fa72c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:50.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa72c078b90 0x7fa72c07b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa740034000 tx=0x7fa740004730 comp rx=0 tx=0).stop 2024-09-21T00:15:50.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 -- 172.21.15.83:0/658234630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa74c0ccd50 msgr2=0x7fa74c072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:50.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa74c0ccd50 0x7fa74c072c00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa73800c370 tx=0x7fa73800c830 comp rx=0 tx=0).stop 2024-09-21T00:15:50.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 -- 172.21.15.83:0/658234630 shutdown_connections 2024-09-21T00:15:50.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa72c078b90 0x7fa72c07b0a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa74c0cddc0 0x7fa74c1ef4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa74c0ccd50 0x7fa74c072c00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 --2- 172.21.15.83:0/658234630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa74c0b50a0 0x7fa74c1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 -- 172.21.15.83:0/658234630 >> 172.21.15.83:0/658234630 conn(0x7fa74c06f940 msgr2=0x7fa74c0cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:50.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 -- 172.21.15.83:0/658234630 shutdown_connections 2024-09-21T00:15:50.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.145+0000 7fa752c00640 1 -- 172.21.15.83:0/658234630 wait complete. 2024-09-21T00:15:50.171 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-21T00:15:48.876073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221528,"kb_used_data":5288,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753192,"statfs":{"total":773094113280,"available":772867268608,"internally_reserved":0,"allocated":5414912,"data_stored":3014148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7328,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-80,"num_read_kb":-87,"num_write":-53,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001142"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":154,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-21T00:15:46.707784+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:15:46.707784+0000","last_peered":"2024-09-21T00:15:46.707784+0000","last_clean":"2024-09-21T00:15:46.707784+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:15:46.707784+0000","last_undegraded":"2024-09-21T00:15:46.707784+0000","last_fullsized":"2024-09-21T00:15:46.707784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":226155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":226155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1130496,"data_stored":822566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":226155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1114112,"data_stored":816523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:15:50.171 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:15:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.391+0000 7fda15e00640 1 -- 172.21.15.83:0/519591961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda1015f5a0 msgr2=0x7fda1015f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.391+0000 7fda15e00640 1 --2- 172.21.15.83:0/519591961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda1015f5a0 0x7fda1015f9b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fda10072560 tx=0x7fda0802aac0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.391+0000 7fda15e00640 1 -- 172.21.15.83:0/519591961 shutdown_connections 2024-09-21T00:15:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.391+0000 7fda15e00640 1 --2- 172.21.15.83:0/519591961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda1015f5a0 0x7fda1015f9b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.391+0000 7fda15e00640 1 --2- 172.21.15.83:0/519591961 >> v2:172.21.15.142:3300/0 conn(0x7fda1015b9f0 0x7fda100cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.391+0000 7fda15e00640 1 -- 172.21.15.83:0/519591961 >> 172.21.15.83:0/519591961 conn(0x7fda100cca40 msgr2=0x7fda100cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.391+0000 7fda15e00640 1 -- 172.21.15.83:0/519591961 shutdown_connections 2024-09-21T00:15:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.391+0000 7fda15e00640 1 -- 172.21.15.83:0/519591961 wait complete. 2024-09-21T00:15:50.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.394+0000 7fda15e00640 1 Processor -- start 2024-09-21T00:15:50.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.394+0000 7fda15e00640 1 -- start start 2024-09-21T00:15:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.395+0000 7fda15e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda100cefa0 0x7fda101f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.395+0000 7fda15e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda1015b9f0 0x7fda100b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.395+0000 7fda15e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda1015f5a0 0x7fda1015e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.395+0000 7fda15e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fda1006df70 con 0x7fda1015b9f0 2024-09-21T00:15:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.395+0000 7fda15e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fda1006ddf0 con 0x7fda1015f5a0 2024-09-21T00:15:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.395+0000 7fda15e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fda1006e0f0 con 0x7fda100cefa0 2024-09-21T00:15:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.395+0000 7fda0e000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda1015b9f0 0x7fda100b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda0e000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda1015b9f0 0x7fda100b5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56042/0 (socket says 172.21.15.83:56042) 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda0e000640 1 -- 172.21.15.83:0/3366657806 learned_addr learned my addr 172.21.15.83:0/3366657806 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda0ea00640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda100cefa0 0x7fda101f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda0f400640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda1015f5a0 0x7fda1015e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda0e000640 1 -- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda100cefa0 msgr2=0x7fda101f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda0e000640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda100cefa0 0x7fda101f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda0e000640 1 -- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda1015f5a0 msgr2=0x7fda1015e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda0e000640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda1015f5a0 0x7fda1015e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda0e000640 1 -- 172.21.15.83:0/3366657806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda101f6720 con 0x7fda1015b9f0 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda0e000640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda1015b9f0 0x7fda100b5760 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00c3f0 tx=0x7fd9fc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.396+0000 7fda07400640 1 -- 172.21.15.83:0/3366657806 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc017070 con 0x7fda1015b9f0 2024-09-21T00:15:50.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.397+0000 7fda07400640 1 -- 172.21.15.83:0/3366657806 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9fc0035f0 con 0x7fda1015b9f0 2024-09-21T00:15:50.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.397+0000 7fda07400640 1 -- 172.21.15.83:0/3366657806 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc003a40 con 0x7fda1015b9f0 2024-09-21T00:15:50.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.397+0000 7fda15e00640 1 -- 172.21.15.83:0/3366657806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda100b5ca0 con 0x7fda1015b9f0 2024-09-21T00:15:50.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.397+0000 7fda15e00640 1 -- 172.21.15.83:0/3366657806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda101e6310 con 0x7fda1015b9f0 2024-09-21T00:15:50.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.398+0000 7fda15e00640 1 -- 172.21.15.83:0/3366657806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1006acf0 con 0x7fda1015b9f0 2024-09-21T00:15:50.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.399+0000 7fda07400640 1 -- 172.21.15.83:0/3366657806 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9fc01a070 con 0x7fda1015b9f0 2024-09-21T00:15:50.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.400+0000 7fda07400640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9f0078bc0 0x7fd9f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:50.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.400+0000 7fda07400640 1 -- 172.21.15.83:0/3366657806 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7fd9fc099fa0 con 0x7fda1015b9f0 2024-09-21T00:15:50.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.400+0000 7fda0ea00640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9f0078bc0 0x7fd9f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.401+0000 7fda0ea00640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9f0078bc0 0x7fd9f007b0d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fda00004590 tx=0x7fda0000b390 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:50.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.404+0000 7fda07400640 1 -- 172.21.15.83:0/3366657806 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fda1006acf0 con 0x7fda1015b9f0 2024-09-21T00:15:50.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.585+0000 7fda15e00640 1 -- 172.21.15.83:0/3366657806 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda1006e5a0 con 0x7fd9f0078bc0 2024-09-21T00:15:50.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.587+0000 7fda07400640 1 -- 172.21.15.83:0/3366657806 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13478 (secure 0 0 0) 0x7fda1006e5a0 con 0x7fd9f0078bc0 2024-09-21T00:15:50.588 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:50.588 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:15:50.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 -- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9f0078bc0 msgr2=0x7fd9f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:50.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9f0078bc0 0x7fd9f007b0d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fda00004590 tx=0x7fda0000b390 comp rx=0 tx=0).stop 2024-09-21T00:15:50.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 -- 172.21.15.83:0/3366657806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda1015b9f0 msgr2=0x7fda100b5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:50.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda1015b9f0 0x7fda100b5760 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00c3f0 tx=0x7fd9fc00c8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 -- 172.21.15.83:0/3366657806 shutdown_connections 2024-09-21T00:15:50.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd9f0078bc0 0x7fd9f007b0d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda1015f5a0 0x7fda1015e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda1015b9f0 0x7fda100b5760 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 --2- 172.21.15.83:0/3366657806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda100cefa0 0x7fda101f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 -- 172.21.15.83:0/3366657806 >> 172.21.15.83:0/3366657806 conn(0x7fda100cca40 msgr2=0x7fda1009efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:50.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 -- 172.21.15.83:0/3366657806 shutdown_connections 2024-09-21T00:15:50.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.589+0000 7fda15e00640 1 -- 172.21.15.83:0/3366657806 wait complete. 2024-09-21T00:15:50.612 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-21T00:15:48.876073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221528,"kb_used_data":5288,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753192,"statfs":{"total":773094113280,"available":772867268608,"internally_reserved":0,"allocated":5414912,"data_stored":3014148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7328,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-80,"num_read_kb":-87,"num_write":-53,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001142"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":154,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-21T00:15:46.707784+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:15:46.707784+0000","last_peered":"2024-09-21T00:15:46.707784+0000","last_clean":"2024-09-21T00:15:46.707784+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:15:46.707784+0000","last_undegraded":"2024-09-21T00:15:46.707784+0000","last_fullsized":"2024-09-21T00:15:46.707784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":226155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":226155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1130496,"data_stored":822566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":226155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1114112,"data_stored":816523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:15:50.612 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T00:15:50.613 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:15:50.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.832+0000 7f5742c00640 1 -- 172.21.15.83:0/1291153963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c073dd0 msgr2=0x7f573c15c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:50.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.832+0000 7f5742c00640 1 --2- 172.21.15.83:0/1291153963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c073dd0 0x7f573c15c3b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f573c06ea80 tx=0x7f573002a560 comp rx=0 tx=0).stop 2024-09-21T00:15:50.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.832+0000 7f5742c00640 1 -- 172.21.15.83:0/1291153963 shutdown_connections 2024-09-21T00:15:50.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.832+0000 7f5742c00640 1 --2- 172.21.15.83:0/1291153963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f573c0b39d0 0x7f573c06def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.832+0000 7f5742c00640 1 --2- 172.21.15.83:0/1291153963 >> v2:172.21.15.142:3300/0 conn(0x7f573c152530 0x7f573c0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.832+0000 7f5742c00640 1 --2- 172.21.15.83:0/1291153963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c073dd0 0x7f573c15c3b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.832+0000 7f5742c00640 1 -- 172.21.15.83:0/1291153963 >> 172.21.15.83:0/1291153963 conn(0x7f573c06f940 msgr2=0x7f573c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:50.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.833+0000 7f5742c00640 1 -- 172.21.15.83:0/1291153963 shutdown_connections 2024-09-21T00:15:50.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.833+0000 7f5742c00640 1 -- 172.21.15.83:0/1291153963 wait complete. 2024-09-21T00:15:50.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.835+0000 7f5742c00640 1 Processor -- start 2024-09-21T00:15:50.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.835+0000 7f5742c00640 1 -- start start 2024-09-21T00:15:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.836+0000 7f5742c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f573c073dd0 0x7f573c15e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.836+0000 7f5742c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c0b39d0 0x7f573c1f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.836+0000 7f5742c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f573c152530 0x7f573c1f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.836+0000 7f5742c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f573c0cf3a0 con 0x7f573c0b39d0 2024-09-21T00:15:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.836+0000 7f5742c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f573c0cf220 con 0x7f573c152530 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.836+0000 7f5742c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f573c0cf520 con 0x7f573c073dd0 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5740e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c0b39d0 0x7f573c1f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5741800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f573c073dd0 0x7f573c15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5740e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c0b39d0 0x7f573c1f8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56056/0 (socket says 172.21.15.83:56056) 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5740e00640 1 -- 172.21.15.83:0/1417244272 learned_addr learned my addr 172.21.15.83:0/1417244272 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5742200640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f573c152530 0x7f573c1f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5740e00640 1 -- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f573c073dd0 msgr2=0x7f573c15e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5740e00640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f573c073dd0 0x7f573c15e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5740e00640 1 -- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f573c152530 msgr2=0x7f573c1f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5740e00640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f573c152530 0x7f573c1f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:50.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5740e00640 1 -- 172.21.15.83:0/1417244272 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573c1f9b30 con 0x7f573c0b39d0 2024-09-21T00:15:50.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.837+0000 7f5740e00640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c0b39d0 0x7f573c1f8c20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f572800c970 tx=0x7f572800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:50.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.838+0000 7f5739600640 1 -- 172.21.15.83:0/1417244272 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728007bb0 con 0x7f573c0b39d0 2024-09-21T00:15:50.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.838+0000 7f5739600640 1 -- 172.21.15.83:0/1417244272 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5728007e40 con 0x7f573c0b39d0 2024-09-21T00:15:50.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.838+0000 7f5739600640 1 -- 172.21.15.83:0/1417244272 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572800f6b0 con 0x7f573c0b39d0 2024-09-21T00:15:50.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.838+0000 7f5742c00640 1 -- 172.21.15.83:0/1417244272 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573c15d590 con 0x7f573c0b39d0 2024-09-21T00:15:50.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.838+0000 7f5742c00640 1 -- 172.21.15.83:0/1417244272 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f573c14a7e0 con 0x7f573c0b39d0 2024-09-21T00:15:50.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.839+0000 7f5742c00640 1 -- 172.21.15.83:0/1417244272 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573c0cfab0 con 0x7f573c0b39d0 2024-09-21T00:15:50.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.840+0000 7f5739600640 1 -- 172.21.15.83:0/1417244272 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f572800f850 con 0x7f573c0b39d0 2024-09-21T00:15:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.841+0000 7f5739600640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f571c078b90 0x7f571c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.841+0000 7f5739600640 1 -- 172.21.15.83:0/1417244272 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f572809b3c0 con 0x7f573c0b39d0 2024-09-21T00:15:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.842+0000 7f5741800640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f571c078b90 0x7f571c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.842+0000 7f5741800640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f571c078b90 0x7f571c07b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5730033000 tx=0x7f5730004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:50.846+0000 7f5739600640 1 -- 172.21.15.83:0/1417244272 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5728014030 con 0x7f573c0b39d0 2024-09-21T00:15:51.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.026+0000 7f5742c00640 1 -- 172.21.15.83:0/1417244272 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f573c155d90 con 0x7f571c078b90 2024-09-21T00:15:51.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.027+0000 7f5739600640 1 -- 172.21.15.83:0/1417244272 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13478 (secure 0 0 0) 0x7f573c155d90 con 0x7f571c078b90 2024-09-21T00:15:51.028 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:51.029 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 -- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f571c078b90 msgr2=0x7f571c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f571c078b90 0x7f571c07b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5730033000 tx=0x7f5730004730 comp rx=0 tx=0).stop 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 -- 172.21.15.83:0/1417244272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c0b39d0 msgr2=0x7f573c1f8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c0b39d0 0x7f573c1f8c20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f572800c970 tx=0x7f572800ce30 comp rx=0 tx=0).stop 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 -- 172.21.15.83:0/1417244272 shutdown_connections 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f571c078b90 0x7f571c07b0a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f573c152530 0x7f573c1f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c0b39d0 0x7f573c1f8c20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 --2- 172.21.15.83:0/1417244272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f573c073dd0 0x7f573c15e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 -- 172.21.15.83:0/1417244272 >> 172.21.15.83:0/1417244272 conn(0x7f573c06f940 msgr2=0x7f573c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 -- 172.21.15.83:0/1417244272 shutdown_connections 2024-09-21T00:15:51.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.029+0000 7f5742c00640 1 -- 172.21.15.83:0/1417244272 wait complete. 2024-09-21T00:15:51.052 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-21T00:15:50.876470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221528,"kb_used_data":5288,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753192,"statfs":{"total":773094113280,"available":772867268608,"internally_reserved":0,"allocated":5414912,"data_stored":3014148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9207,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-81,"num_read_kb":-88,"num_write":-57,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.549558"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":154,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-21T00:15:46.707784+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:15:46.707784+0000","last_peered":"2024-09-21T00:15:46.707784+0000","last_clean":"2024-09-21T00:15:46.707784+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:15:46.707784+0000","last_undegraded":"2024-09-21T00:15:46.707784+0000","last_fullsized":"2024-09-21T00:15:46.707784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":226155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":226155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1130496,"data_stored":822566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":226155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1114112,"data_stored":816523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:15:51.053 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:15:51.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.273+0000 7f862e200640 1 -- 172.21.15.83:0/2283218660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628074cb0 msgr2=0x7f8628073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:51.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.273+0000 7f862e200640 1 --2- 172.21.15.83:0/2283218660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628074cb0 0x7f8628073dd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8618009830 tx=0x7f861802a5b0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.273+0000 7f862e200640 1 -- 172.21.15.83:0/2283218660 shutdown_connections 2024-09-21T00:15:51.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.273+0000 7f862e200640 1 --2- 172.21.15.83:0/2283218660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628074cb0 0x7f8628073dd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.273+0000 7f862e200640 1 -- 172.21.15.83:0/2283218660 >> 172.21.15.83:0/2283218660 conn(0x7f86280cca40 msgr2=0x7f86280cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:51.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.273+0000 7f862e200640 1 -- 172.21.15.83:0/2283218660 shutdown_connections 2024-09-21T00:15:51.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.274+0000 7f862e200640 1 -- 172.21.15.83:0/2283218660 wait complete. 2024-09-21T00:15:51.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.276+0000 7f862e200640 1 Processor -- start 2024-09-21T00:15:51.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.276+0000 7f862e200640 1 -- start start 2024-09-21T00:15:51.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.277+0000 7f862e200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628074cb0 0x7f8628153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:51.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.277+0000 7f862e200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86280cbc10 0x7f86280b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:51.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.277+0000 7f862e200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86280b1060 0x7f86280b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:51.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.277+0000 7f862e200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f862806f670 con 0x7f8628074cb0 2024-09-21T00:15:51.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.277+0000 7f862e200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f862806f4f0 con 0x7f86280cbc10 2024-09-21T00:15:51.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.277+0000 7f862e200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f862806f7f0 con 0x7f86280b1060 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.277+0000 7f8627400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628074cb0 0x7f8628153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f8627400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628074cb0 0x7f8628153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56076/0 (socket says 172.21.15.83:56076) 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f8627400640 1 -- 172.21.15.83:0/4169929572 learned_addr learned my addr 172.21.15.83:0/4169929572 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f861ea00640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86280cbc10 0x7f86280b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f8627e00640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86280b1060 0x7f86280b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f8627400640 1 -- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86280b1060 msgr2=0x7f86280b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f8627400640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86280b1060 0x7f86280b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f8627400640 1 -- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86280cbc10 msgr2=0x7f86280b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f8627400640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86280cbc10 0x7f86280b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f8627400640 1 -- 172.21.15.83:0/4169929572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8628159970 con 0x7f8628074cb0 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f8627e00640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86280b1060 0x7f86280b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:51.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.278+0000 7f8627400640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628074cb0 0x7f8628153e00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8618009950 tx=0x7f8618033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.279+0000 7f861fe00640 1 -- 172.21.15.83:0/4169929572 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618031b60 con 0x7f8628074cb0 2024-09-21T00:15:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.279+0000 7f861fe00640 1 -- 172.21.15.83:0/4169929572 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8618031df0 con 0x7f8628074cb0 2024-09-21T00:15:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.279+0000 7f862e200640 1 -- 172.21.15.83:0/4169929572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86280b4f90 con 0x7f8628074cb0 2024-09-21T00:15:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.279+0000 7f861fe00640 1 -- 172.21.15.83:0/4169929572 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618005280 con 0x7f8628074cb0 2024-09-21T00:15:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.279+0000 7f862e200640 1 -- 172.21.15.83:0/4169929572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86280b4c90 con 0x7f8628074cb0 2024-09-21T00:15:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.280+0000 7f862e200640 1 -- 172.21.15.83:0/4169929572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86280747b0 con 0x7f8628074cb0 2024-09-21T00:15:51.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.281+0000 7f861fe00640 1 -- 172.21.15.83:0/4169929572 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8618005420 con 0x7f8628074cb0 2024-09-21T00:15:51.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.282+0000 7f861fe00640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8604078bc0 0x7f860407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:51.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.282+0000 7f861fe00640 1 -- 172.21.15.83:0/4169929572 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f86180bbe50 con 0x7f8628074cb0 2024-09-21T00:15:51.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.283+0000 7f861ea00640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8604078bc0 0x7f860407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:51.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.284+0000 7f861ea00640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8604078bc0 0x7f860407b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86280ca0b0 tx=0x7f8610009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:51.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.287+0000 7f861fe00640 1 -- 172.21.15.83:0/4169929572 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f861803f030 con 0x7f8628074cb0 2024-09-21T00:15:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.473+0000 7f862e200640 1 -- 172.21.15.83:0/4169929572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f862806f2b0 con 0x7f8628074cb0 2024-09-21T00:15:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.474+0000 7f861fe00640 1 -- 172.21.15.83:0/4169929572 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+13463 (secure 0 0 0) 0x7f8618031770 con 0x7f8628074cb0 2024-09-21T00:15:51.475 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:51.475 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":46,"fsid":"d4df3382-b453-41c4-9497-6203e3b4e46e","created":"2024-09-21T00:13:41.673641+0000","modified":"2024-09-21T00:15:46.702448+0000","last_up_change":"2024-09-21T00:13:57.805090+0000","last_in_change":"2024-09-21T00:13:47.391687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:13:58.878947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1863d3-4393-46a1-9614-69443da83c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6817","nonce":3973258171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6819","nonce":3973258171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6823","nonce":3973258171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3973258171},{"type":"v1","addr":"172.21.15.83:6821","nonce":3973258171}]},"public_addr":"172.21.15.83:6817/3973258171","cluster_addr":"172.21.15.83:6819/3973258171","heartbeat_back_addr":"172.21.15.83:6823/3973258171","heartbeat_front_addr":"172.21.15.83:6821/3973258171","state":["exists","up"]},{"osd":1,"uuid":"63121bd4-ab9f-45ef-960a-26db2f18a0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6809","nonce":1381138332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6811","nonce":1381138332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6815","nonce":1381138332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1381138332},{"type":"v1","addr":"172.21.15.83:6813","nonce":1381138332}]},"public_addr":"172.21.15.83:6809/1381138332","cluster_addr":"172.21.15.83:6811/1381138332","heartbeat_back_addr":"172.21.15.83:6815/1381138332","heartbeat_front_addr":"172.21.15.83:6813/1381138332","state":["exists","up"]},{"osd":2,"uuid":"d1a0fa44-ff1c-416b-abf1-473c09231294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6801","nonce":4285051206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6803","nonce":4285051206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6807","nonce":4285051206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":4285051206},{"type":"v1","addr":"172.21.15.83:6805","nonce":4285051206}]},"public_addr":"172.21.15.83:6801/4285051206","cluster_addr":"172.21.15.83:6803/4285051206","heartbeat_back_addr":"172.21.15.83:6807/4285051206","heartbeat_front_addr":"172.21.15.83:6805/4285051206","state":["exists","up"]},{"osd":3,"uuid":"b981efc2-7f3e-4d16-93ea-5a1c126fa745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6825","nonce":1075763441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6827","nonce":1075763441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6831","nonce":1075763441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":1075763441},{"type":"v1","addr":"172.21.15.83:6829","nonce":1075763441}]},"public_addr":"172.21.15.83:6825/1075763441","cluster_addr":"172.21.15.83:6827/1075763441","heartbeat_back_addr":"172.21.15.83:6831/1075763441","heartbeat_front_addr":"172.21.15.83:6829/1075763441","state":["exists","up"]},{"osd":4,"uuid":"9cf4a8e4-96e6-4803-ba5f-5c7ba2ea4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6803","nonce":1069372226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6805","nonce":1069372226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6809","nonce":1069372226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1069372226},{"type":"v1","addr":"172.21.15.142:6807","nonce":1069372226}]},"public_addr":"172.21.15.142:6803/1069372226","cluster_addr":"172.21.15.142:6805/1069372226","heartbeat_back_addr":"172.21.15.142:6809/1069372226","heartbeat_front_addr":"172.21.15.142:6807/1069372226","state":["exists","up"]},{"osd":5,"uuid":"9596ec5c-75ff-4aa3-93d9-82ecda0b10c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6811","nonce":3942773776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6813","nonce":3942773776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6817","nonce":3942773776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3942773776},{"type":"v1","addr":"172.21.15.142:6815","nonce":3942773776}]},"public_addr":"172.21.15.142:6811/3942773776","cluster_addr":"172.21.15.142:6813/3942773776","heartbeat_back_addr":"172.21.15.142:6817/3942773776","heartbeat_front_addr":"172.21.15.142:6815/3942773776","state":["exists","up"]},{"osd":6,"uuid":"4b631676-f08f-4b67-b2ca-5c46a9e181e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6819","nonce":2503212538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6821","nonce":2503212538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6825","nonce":2503212538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2503212538},{"type":"v1","addr":"172.21.15.142:6823","nonce":2503212538}]},"public_addr":"172.21.15.142:6819/2503212538","cluster_addr":"172.21.15.142:6821/2503212538","heartbeat_back_addr":"172.21.15.142:6825/2503212538","heartbeat_front_addr":"172.21.15.142:6823/2503212538","state":["exists","up"]},{"osd":7,"uuid":"7bcd6cd0-da9e-4d5a-8611-cebd4ecab3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6827","nonce":2409799611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6829","nonce":2409799611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6833","nonce":2409799611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2409799611},{"type":"v1","addr":"172.21.15.142:6831","nonce":2409799611}]},"public_addr":"172.21.15.142:6827/2409799611","cluster_addr":"172.21.15.142:6829/2409799611","heartbeat_back_addr":"172.21.15.142:6833/2409799611","heartbeat_front_addr":"172.21.15.142:6831/2409799611","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.110101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.307807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.884171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.913809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.003752+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.867840+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:53.999140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:13:54.208341+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6837/2876811208":"2024-09-22T00:15:43.322815+0000","172.21.15.142:6835/2876811208":"2024-09-22T00:15:43.322815+0000","172.21.15.142:6837/1450693530":"2024-09-22T00:15:30.827804+0000","172.21.15.142:6835/1450693530":"2024-09-22T00:15:30.827804+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.476+0000 7f862e200640 1 -- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8604078bc0 msgr2=0x7f860407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.476+0000 7f862e200640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8604078bc0 0x7f860407b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86280ca0b0 tx=0x7f8610009040 comp rx=0 tx=0).stop 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.476+0000 7f862e200640 1 -- 172.21.15.83:0/4169929572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628074cb0 msgr2=0x7f8628153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.476+0000 7f862e200640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628074cb0 0x7f8628153e00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8618009950 tx=0x7f8618033c10 comp rx=0 tx=0).stop 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.476+0000 7f862e200640 1 -- 172.21.15.83:0/4169929572 shutdown_connections 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.476+0000 7f862e200640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f8604078bc0 0x7f860407b0d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.476+0000 7f862e200640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86280b1060 0x7f86280b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.476+0000 7f862e200640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86280cbc10 0x7f86280b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.476+0000 7f862e200640 1 --2- 172.21.15.83:0/4169929572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628074cb0 0x7f8628153e00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.476+0000 7f862e200640 1 -- 172.21.15.83:0/4169929572 >> 172.21.15.83:0/4169929572 conn(0x7f86280cca40 msgr2=0x7f862809edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.477+0000 7f862e200640 1 -- 172.21.15.83:0/4169929572 shutdown_connections 2024-09-21T00:15:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:51.477+0000 7f862e200640 1 -- 172.21.15.83:0/4169929572 wait complete. 2024-09-21T00:15:52.500 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T00:15:52.500 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T00:15:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.734+0000 7f846f200640 1 -- 172.21.15.83:0/449722411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8470145cc0 msgr2=0x7f84701604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.734+0000 7f846f200640 1 --2- 172.21.15.83:0/449722411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8470145cc0 0x7f84701604a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f84700cfa70 tx=0x7f845802a540 comp rx=0 tx=0).stop 2024-09-21T00:15:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.734+0000 7f846f200640 1 -- 172.21.15.83:0/449722411 shutdown_connections 2024-09-21T00:15:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.734+0000 7f846f200640 1 --2- 172.21.15.83:0/449722411 >> v2:172.21.15.142:3300/0 conn(0x7f84700ceaf0 0x7f84700cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.734+0000 7f846f200640 1 --2- 172.21.15.83:0/449722411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8470145cc0 0x7f84701604a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.734+0000 7f846f200640 1 --2- 172.21.15.83:0/449722411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84700b2e60 0x7f847015ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.734+0000 7f846f200640 1 -- 172.21.15.83:0/449722411 >> 172.21.15.83:0/449722411 conn(0x7f84700d0460 msgr2=0x7f847006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.735+0000 7f846f200640 1 -- 172.21.15.83:0/449722411 shutdown_connections 2024-09-21T00:15:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.735+0000 7f846f200640 1 -- 172.21.15.83:0/449722411 wait complete. 2024-09-21T00:15:52.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.737+0000 7f846f200640 1 Processor -- start 2024-09-21T00:15:52.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.737+0000 7f846f200640 1 -- start start 2024-09-21T00:15:52.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.738+0000 7f846f200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84700b2e60 0x7f8470141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:52.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.738+0000 7f846f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84700ceaf0 0x7f84701f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:52.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.738+0000 7f846f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8470145cc0 0x7f8470144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:52.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.738+0000 7f846f200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f847006fdd0 con 0x7f84700b2e60 2024-09-21T00:15:52.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.738+0000 7f846f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f847006fc50 con 0x7f8470145cc0 2024-09-21T00:15:52.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.738+0000 7f846f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f847006ff50 con 0x7f84700ceaf0 2024-09-21T00:15:52.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.739+0000 7f846de00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84700b2e60 0x7f8470141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:52.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.739+0000 7f846de00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84700b2e60 0x7f8470141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51134/0 (socket says 172.21.15.83:51134) 2024-09-21T00:15:52.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.739+0000 7f846de00640 1 -- 172.21.15.83:0/3711603854 learned_addr learned my addr 172.21.15.83:0/3711603854 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:52.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.739+0000 7f8467e00640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84700ceaf0 0x7f84701f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:52.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.739+0000 7f846e800640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8470145cc0 0x7f8470144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:52.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.739+0000 7f846de00640 1 -- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84700ceaf0 msgr2=0x7f84701f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:52.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.739+0000 7f846de00640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84700ceaf0 0x7f84701f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:52.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.739+0000 7f846de00640 1 -- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8470145cc0 msgr2=0x7f8470144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:52.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.739+0000 7f846de00640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8470145cc0 0x7f8470144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:52.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.739+0000 7f846de00640 1 -- 172.21.15.83:0/3711603854 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8470142040 con 0x7f84700b2e60 2024-09-21T00:15:52.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.740+0000 7f846de00640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84700b2e60 0x7f8470141910 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f846000d660 tx=0x7f846000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.740+0000 7f8466000640 1 -- 172.21.15.83:0/3711603854 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460017070 con 0x7f84700b2e60 2024-09-21T00:15:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.740+0000 7f8466000640 1 -- 172.21.15.83:0/3711603854 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8460005310 con 0x7f84700b2e60 2024-09-21T00:15:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.740+0000 7f8466000640 1 -- 172.21.15.83:0/3711603854 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84600097c0 con 0x7f84700b2e60 2024-09-21T00:15:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.740+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8470142320 con 0x7f84700b2e60 2024-09-21T00:15:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.740+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84701f8b60 con 0x7f84700b2e60 2024-09-21T00:15:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.741+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8470144770 con 0x7f84700b2e60 2024-09-21T00:15:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.742+0000 7f8466000640 1 -- 172.21.15.83:0/3711603854 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8460009960 con 0x7f84700b2e60 2024-09-21T00:15:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.743+0000 7f8466000640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f844c078b90 0x7f844c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.743+0000 7f8466000640 1 -- 172.21.15.83:0/3711603854 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f846009abc0 con 0x7f84700b2e60 2024-09-21T00:15:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.743+0000 7f8466000640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] conn(0x7f844c07f120 0x7f844c0815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.743+0000 7f8466000640 1 -- 172.21.15.83:0/3711603854 --> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f844c081c80 con 0x7f844c07f120 2024-09-21T00:15:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.743+0000 7f8466000640 1 -- 172.21.15.83:0/3711603854 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f846009f2a0 con 0x7f84700b2e60 2024-09-21T00:15:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.743+0000 7f8467e00640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f844c078b90 0x7f844c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.744+0000 7f846e800640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] conn(0x7f844c07f120 0x7f844c0815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.744+0000 7f8467e00640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f844c078b90 0x7f844c07b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8458033000 tx=0x7f8458004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.744+0000 7f846e800640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] conn(0x7f844c07f120 0x7f844c0815b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.745+0000 7f8466000640 1 -- 172.21.15.83:0/3711603854 <== osd.0 v2:172.21.15.83:6816/3973258171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f844c081c80 con 0x7f844c07f120 2024-09-21T00:15:52.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.758+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 --> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f847015a8f0 con 0x7f844c07f120 2024-09-21T00:15:52.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.758+0000 7f8466000640 1 -- 172.21.15.83:0/3711603854 <== osd.0 v2:172.21.15.83:6816/3973258171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f847015a8f0 con 0x7f844c07f120 2024-09-21T00:15:52.760 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:52.760 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T00:15:52.760 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 >> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] conn(0x7f844c07f120 msgr2=0x7f844c0815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846f200640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.83:6816/3973258171,v1:172.21.15.83:6817/3973258171] conn(0x7f844c07f120 0x7f844c0815b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f844c078b90 msgr2=0x7f844c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846f200640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f844c078b90 0x7f844c07b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8458033000 tx=0x7f8458004730 comp rx=0 tx=0).stop 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84700b2e60 msgr2=0x7f8470141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846f200640 1 --2- 172.21.15.83:0/3711603854 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84700b2e60 0x7f8470141910 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f846000d660 tx=0x7f846000db20 comp rx=0 tx=0).stop 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846e800640 1 -- 172.21.15.83:0/3711603854 reap_dead start 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 shutdown_connections 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 >> 172.21.15.83:0/3711603854 conn(0x7f84700d0460 msgr2=0x7f847006d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 shutdown_connections 2024-09-21T00:15:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:52.759+0000 7f846f200640 1 -- 172.21.15.83:0/3711603854 wait complete. 2024-09-21T00:15:52.782 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T00:15:53.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.004+0000 7f57bbe00640 1 -- 172.21.15.83:0/3736813243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57bc162880 msgr2=0x7f57bc06fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.004+0000 7f57bbe00640 1 --2- 172.21.15.83:0/3736813243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57bc162880 0x7f57bc06fe00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f57b4005fd0 tx=0x7f57b402a8a0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.005+0000 7f57bbe00640 1 -- 172.21.15.83:0/3736813243 shutdown_connections 2024-09-21T00:15:53.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.005+0000 7f57bbe00640 1 --2- 172.21.15.83:0/3736813243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57bc162880 0x7f57bc06fe00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.005+0000 7f57bbe00640 1 --2- 172.21.15.83:0/3736813243 >> v2:172.21.15.142:3300/0 conn(0x7f57bc0ade20 0x7f57bc162340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.005+0000 7f57bbe00640 1 -- 172.21.15.83:0/3736813243 >> 172.21.15.83:0/3736813243 conn(0x7f57bc0d05c0 msgr2=0x7f57bc06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:53.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.005+0000 7f57bbe00640 1 -- 172.21.15.83:0/3736813243 shutdown_connections 2024-09-21T00:15:53.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.005+0000 7f57bbe00640 1 -- 172.21.15.83:0/3736813243 wait complete. 2024-09-21T00:15:53.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.007+0000 7f57bbe00640 1 Processor -- start 2024-09-21T00:15:53.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.007+0000 7f57bbe00640 1 -- start start 2024-09-21T00:15:53.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.008+0000 7f57bbe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57bc0ade20 0x7f57bc1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.008+0000 7f57bbe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57bc0aef80 0x7f57bc13df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57bbe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57bc162880 0x7f57bc140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57bbe00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc155240 con 0x7f57bc0aef80 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57bbe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc1550c0 con 0x7f57bc162880 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57bbe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f57bc1553c0 con 0x7f57bc0ade20 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57b2000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57bc0aef80 0x7f57bc13df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57b2000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57bc0aef80 0x7f57bc13df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51150/0 (socket says 172.21.15.83:51150) 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57b2000640 1 -- 172.21.15.83:0/2990195170 learned_addr learned my addr 172.21.15.83:0/2990195170 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57baa00640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57bc0ade20 0x7f57bc1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57bb400640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57bc162880 0x7f57bc140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57b2000640 1 -- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57bc0ade20 msgr2=0x7f57bc1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57b2000640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57bc0ade20 0x7f57bc1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57b2000640 1 -- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57bc162880 msgr2=0x7f57bc140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57b2000640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57bc162880 0x7f57bc140a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.009+0000 7f57b2000640 1 -- 172.21.15.83:0/2990195170 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57bc157df0 con 0x7f57bc0aef80 2024-09-21T00:15:53.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.010+0000 7f57b2000640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57bc0aef80 0x7f57bc13df50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f57a400e7c0 tx=0x7f57a400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:53.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.010+0000 7f57b3400640 1 -- 172.21.15.83:0/2990195170 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a400ccc0 con 0x7f57bc0aef80 2024-09-21T00:15:53.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.010+0000 7f57b3400640 1 -- 172.21.15.83:0/2990195170 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57a400ee70 con 0x7f57bc0aef80 2024-09-21T00:15:53.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.010+0000 7f57bbe00640 1 -- 172.21.15.83:0/2990195170 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57bc13ebd0 con 0x7f57bc0aef80 2024-09-21T00:15:53.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.010+0000 7f57b3400640 1 -- 172.21.15.83:0/2990195170 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a4010690 con 0x7f57bc0aef80 2024-09-21T00:15:53.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.010+0000 7f57bbe00640 1 -- 172.21.15.83:0/2990195170 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57bc13f190 con 0x7f57bc0aef80 2024-09-21T00:15:53.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.011+0000 7f57bbe00640 1 -- 172.21.15.83:0/2990195170 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57bc157b60 con 0x7f57bc0aef80 2024-09-21T00:15:53.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.013+0000 7f57b3400640 1 -- 172.21.15.83:0/2990195170 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f57a4010830 con 0x7f57bc0aef80 2024-09-21T00:15:53.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.014+0000 7f57b3400640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5798078bc0 0x7f579807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.014+0000 7f57b3400640 1 -- 172.21.15.83:0/2990195170 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f57a409b540 con 0x7f57bc0aef80 2024-09-21T00:15:53.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.014+0000 7f57baa00640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5798078bc0 0x7f579807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.015+0000 7f57baa00640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5798078bc0 0x7f579807b0d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f57ac007fd0 tx=0x7f57ac001370 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:53.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.018+0000 7f57b3400640 1 -- 172.21.15.83:0/2990195170 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f57a4063440 con 0x7f57bc0aef80 2024-09-21T00:15:53.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.208+0000 7f57bbe00640 1 -- 172.21.15.83:0/2990195170 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f57bc06e590 con 0x7f5798078bc0 2024-09-21T00:15:53.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.209+0000 7f57b3400640 1 -- 172.21.15.83:0/2990195170 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f57bc06e590 con 0x7f5798078bc0 2024-09-21T00:15:53.210 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T00:15:53.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.211+0000 7f57bbe00640 1 -- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5798078bc0 msgr2=0x7f579807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.211+0000 7f57bbe00640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5798078bc0 0x7f579807b0d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f57ac007fd0 tx=0x7f57ac001370 comp rx=0 tx=0).stop 2024-09-21T00:15:53.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.211+0000 7f57bbe00640 1 -- 172.21.15.83:0/2990195170 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57bc0aef80 msgr2=0x7f57bc13df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.211+0000 7f57bbe00640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57bc0aef80 0x7f57bc13df50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f57a400e7c0 tx=0x7f57a400ec80 comp rx=0 tx=0).stop 2024-09-21T00:15:53.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.211+0000 7f57bbe00640 1 -- 172.21.15.83:0/2990195170 shutdown_connections 2024-09-21T00:15:53.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.211+0000 7f57bbe00640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f5798078bc0 0x7f579807b0d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.211+0000 7f57bbe00640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57bc162880 0x7f57bc140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.211+0000 7f57bbe00640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57bc0aef80 0x7f57bc13df50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.211+0000 7f57bbe00640 1 --2- 172.21.15.83:0/2990195170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57bc0ade20 0x7f57bc1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.212+0000 7f57bbe00640 1 -- 172.21.15.83:0/2990195170 >> 172.21.15.83:0/2990195170 conn(0x7f57bc0d05c0 msgr2=0x7f57bc0b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:53.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.212+0000 7f57bbe00640 1 -- 172.21.15.83:0/2990195170 shutdown_connections 2024-09-21T00:15:53.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.212+0000 7f57bbe00640 1 -- 172.21.15.83:0/2990195170 wait complete. 2024-09-21T00:15:53.234 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T00:15:53.235 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T00:15:53.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.458+0000 7f2935200640 1 -- 172.21.15.83:0/4104767077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2930160c20 msgr2=0x7f293006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.458+0000 7f2935200640 1 --2- 172.21.15.83:0/4104767077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2930160c20 0x7f293006d820 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2928005fd0 tx=0x7f292802a8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.458+0000 7f2935200640 1 -- 172.21.15.83:0/4104767077 shutdown_connections 2024-09-21T00:15:53.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.458+0000 7f2935200640 1 --2- 172.21.15.83:0/4104767077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2930160c20 0x7f293006d820 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.458+0000 7f2935200640 1 --2- 172.21.15.83:0/4104767077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2930160810 0x7f293006d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.458+0000 7f2935200640 1 -- 172.21.15.83:0/4104767077 >> 172.21.15.83:0/4104767077 conn(0x7f29300ccac0 msgr2=0x7f29300cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:53.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.458+0000 7f2935200640 1 -- 172.21.15.83:0/4104767077 shutdown_connections 2024-09-21T00:15:53.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.459+0000 7f2935200640 1 -- 172.21.15.83:0/4104767077 wait complete. 2024-09-21T00:15:53.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.461+0000 7f2935200640 1 Processor -- start 2024-09-21T00:15:53.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.461+0000 7f2935200640 1 -- start start 2024-09-21T00:15:53.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.462+0000 7f2935200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300ca690 0x7f29301f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.462+0000 7f2935200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2930160810 0x7f293015f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.462+0000 7f2935200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2930160c20 0x7f293015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.462+0000 7f2935200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f293006e0f0 con 0x7f2930160c20 2024-09-21T00:15:53.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.462+0000 7f2935200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f293006df70 con 0x7f2930160810 2024-09-21T00:15:53.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.462+0000 7f2935200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f293006e270 con 0x7f29300ca690 2024-09-21T00:15:53.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292e800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2930160c20 0x7f293015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292e800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2930160c20 0x7f293015e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51162/0 (socket says 172.21.15.83:51162) 2024-09-21T00:15:53.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292e800640 1 -- 172.21.15.83:0/3093431345 learned_addr learned my addr 172.21.15.83:0/3093431345 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:53.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292de00640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300ca690 0x7f29301f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292d400640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2930160810 0x7f293015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292e800640 1 -- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300ca690 msgr2=0x7f29301f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292e800640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300ca690 0x7f29301f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292e800640 1 -- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2930160810 msgr2=0x7f293015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292e800640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2930160810 0x7f293015f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292e800640 1 -- 172.21.15.83:0/3093431345 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29301f5f10 con 0x7f2930160c20 2024-09-21T00:15:53.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292de00640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300ca690 0x7f29301f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:53.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292d400640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2930160810 0x7f293015f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:53.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.463+0000 7f292e800640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2930160c20 0x7f293015e3c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2928009cd0 tx=0x7f2928031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:53.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.464+0000 7f2926000640 1 -- 172.21.15.83:0/3093431345 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928031990 con 0x7f2930160c20 2024-09-21T00:15:53.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.464+0000 7f2926000640 1 -- 172.21.15.83:0/3093431345 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2928031c20 con 0x7f2930160c20 2024-09-21T00:15:53.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.464+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29301f6420 con 0x7f2930160c20 2024-09-21T00:15:53.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.464+0000 7f2926000640 1 -- 172.21.15.83:0/3093431345 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29280330d0 con 0x7f2930160c20 2024-09-21T00:15:53.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.464+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293015dbc0 con 0x7f2930160c20 2024-09-21T00:15:53.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.465+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2930160100 con 0x7f2930160c20 2024-09-21T00:15:53.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.466+0000 7f2926000640 1 -- 172.21.15.83:0/3093431345 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2928033270 con 0x7f2930160c20 2024-09-21T00:15:53.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.467+0000 7f2926000640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2910078b90 0x7f291007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.467+0000 7f2926000640 1 -- 172.21.15.83:0/3093431345 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f29280bc240 con 0x7f2930160c20 2024-09-21T00:15:53.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.467+0000 7f2926000640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] conn(0x7f291007f120 0x7f29100815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.467+0000 7f2926000640 1 -- 172.21.15.83:0/3093431345 --> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2910081c80 con 0x7f291007f120 2024-09-21T00:15:53.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.467+0000 7f2926000640 1 -- 172.21.15.83:0/3093431345 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f29280c3050 con 0x7f2930160c20 2024-09-21T00:15:53.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.468+0000 7f292de00640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2910078b90 0x7f291007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.468+0000 7f292d400640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] conn(0x7f291007f120 0x7f29100815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.468+0000 7f292d400640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] conn(0x7f291007f120 0x7f29100815b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:53.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.469+0000 7f292de00640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2910078b90 0x7f291007b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2920000f60 tx=0x7f2920009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:53.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.469+0000 7f2926000640 1 -- 172.21.15.83:0/3093431345 <== osd.1 v2:172.21.15.83:6808/1381138332 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2910081c80 con 0x7f291007f120 2024-09-21T00:15:53.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.482+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 --> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f29301f6190 con 0x7f291007f120 2024-09-21T00:15:53.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.482+0000 7f2926000640 1 -- 172.21.15.83:0/3093431345 <== osd.1 v2:172.21.15.83:6808/1381138332 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f29301f6190 con 0x7f291007f120 2024-09-21T00:15:53.484 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:53.484 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T00:15:53.484 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:53.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 >> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] conn(0x7f291007f120 msgr2=0x7f29100815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f2935200640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.83:6808/1381138332,v1:172.21.15.83:6809/1381138332] conn(0x7f291007f120 0x7f29100815b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2910078b90 msgr2=0x7f291007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f2935200640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2910078b90 0x7f291007b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2920000f60 tx=0x7f2920009040 comp rx=0 tx=0).stop 2024-09-21T00:15:53.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2930160c20 msgr2=0x7f293015e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f2935200640 1 --2- 172.21.15.83:0/3093431345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2930160c20 0x7f293015e3c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2928009cd0 tx=0x7f2928031760 comp rx=0 tx=0).stop 2024-09-21T00:15:53.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f292e800640 1 -- 172.21.15.83:0/3093431345 reap_dead start 2024-09-21T00:15:53.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 shutdown_connections 2024-09-21T00:15:53.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 >> 172.21.15.83:0/3093431345 conn(0x7f29300ccac0 msgr2=0x7f29300b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:53.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 shutdown_connections 2024-09-21T00:15:53.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.483+0000 7f2935200640 1 -- 172.21.15.83:0/3093431345 wait complete. 2024-09-21T00:15:53.506 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T00:15:53.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.727+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2183324082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8b006ddf0 msgr2=0x7fe8b006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.727+0000 7fe8b6e00640 1 --2- 172.21.15.83:0/2183324082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8b006ddf0 0x7fe8b006e200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe89c005fd0 tx=0x7fe89c02a5d0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.727+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2183324082 shutdown_connections 2024-09-21T00:15:53.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.727+0000 7fe8b6e00640 1 --2- 172.21.15.83:0/2183324082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8b006ddf0 0x7fe8b006e200 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.727+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2183324082 >> 172.21.15.83:0/2183324082 conn(0x7fe8b00b1b90 msgr2=0x7fe8b00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:53.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.727+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2183324082 shutdown_connections 2024-09-21T00:15:53.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.727+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2183324082 wait complete. 2024-09-21T00:15:53.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.729+0000 7fe8b6e00640 1 Processor -- start 2024-09-21T00:15:53.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.730+0000 7fe8b6e00640 1 -- start start 2024-09-21T00:15:53.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.731+0000 7fe8b6e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8b006ddf0 0x7fe8b01f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.731+0000 7fe8b6e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8b00cef00 0x7fe8b01ec460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.731+0000 7fe8b6e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8b0156a50 0x7fe8b0158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.731+0000 7fe8b6e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b0160fd0 con 0x7fe8b006ddf0 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.731+0000 7fe8b6e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b0160e50 con 0x7fe8b0156a50 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.731+0000 7fe8b6e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe8b00cfa20 con 0x7fe8b00cef00 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.731+0000 7fe8afe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8b006ddf0 0x7fe8b01f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8afe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8b006ddf0 0x7fe8b01f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51180/0 (socket says 172.21.15.83:51180) 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8afe00640 1 -- 172.21.15.83:0/2462192859 learned_addr learned my addr 172.21.15.83:0/2462192859 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8af400640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8b00cef00 0x7fe8b01ec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8b4e00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8b0156a50 0x7fe8b0158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8afe00640 1 -- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8b00cef00 msgr2=0x7fe8b01ec460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8afe00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8b00cef00 0x7fe8b01ec460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8afe00640 1 -- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8b0156a50 msgr2=0x7fe8b0158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8afe00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8b0156a50 0x7fe8b0158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8afe00640 1 -- 172.21.15.83:0/2462192859 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b01f6a90 con 0x7fe8b006ddf0 2024-09-21T00:15:53.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8b4e00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8b0156a50 0x7fe8b0158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:53.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.732+0000 7fe8afe00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8b006ddf0 0x7fe8b01f6550 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c3f0 tx=0x7fe8a000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:53.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.733+0000 7fe8a7e00640 1 -- 172.21.15.83:0/2462192859 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0017070 con 0x7fe8b006ddf0 2024-09-21T00:15:53.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.733+0000 7fe8a7e00640 1 -- 172.21.15.83:0/2462192859 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8a00035f0 con 0x7fe8b006ddf0 2024-09-21T00:15:53.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.733+0000 7fe8a7e00640 1 -- 172.21.15.83:0/2462192859 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0003a40 con 0x7fe8b006ddf0 2024-09-21T00:15:53.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.733+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2462192859 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b0157480 con 0x7fe8b006ddf0 2024-09-21T00:15:53.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.733+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2462192859 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b0157a40 con 0x7fe8b006ddf0 2024-09-21T00:15:53.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.734+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2462192859 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8b006e200 con 0x7fe8b006ddf0 2024-09-21T00:15:53.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.736+0000 7fe8a7e00640 1 -- 172.21.15.83:0/2462192859 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8a001a070 con 0x7fe8b006ddf0 2024-09-21T00:15:53.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.737+0000 7fe8a7e00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe890078bc0 0x7fe89007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:53.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.737+0000 7fe8a7e00640 1 -- 172.21.15.83:0/2462192859 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7fe8a0099f10 con 0x7fe8b006ddf0 2024-09-21T00:15:53.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.738+0000 7fe8af400640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe890078bc0 0x7fe89007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:53.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.738+0000 7fe8af400640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe890078bc0 0x7fe89007b0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe89c033000 tx=0x7fe89c004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:53.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.742+0000 7fe8a7e00640 1 -- 172.21.15.83:0/2462192859 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe8b01f6a90 con 0x7fe8b006ddf0 2024-09-21T00:15:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.927+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2462192859 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe8b00729a0 con 0x7fe890078bc0 2024-09-21T00:15:53.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.928+0000 7fe8a7e00640 1 -- 172.21.15.83:0/2462192859 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe8b00729a0 con 0x7fe890078bc0 2024-09-21T00:15:53.929 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T00:15:53.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe890078bc0 msgr2=0x7fe89007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe890078bc0 0x7fe89007b0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe89c033000 tx=0x7fe89c004730 comp rx=0 tx=0).stop 2024-09-21T00:15:53.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2462192859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8b006ddf0 msgr2=0x7fe8b01f6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:53.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8b006ddf0 0x7fe8b01f6550 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c3f0 tx=0x7fe8a000c8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2462192859 shutdown_connections 2024-09-21T00:15:53.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fe890078bc0 0x7fe89007b0d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8b0156a50 0x7fe8b0158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8b00cef00 0x7fe8b01ec460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 --2- 172.21.15.83:0/2462192859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8b006ddf0 0x7fe8b01f6550 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:53.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2462192859 >> 172.21.15.83:0/2462192859 conn(0x7fe8b00b1b90 msgr2=0x7fe8b015dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:53.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2462192859 shutdown_connections 2024-09-21T00:15:53.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:53.930+0000 7fe8b6e00640 1 -- 172.21.15.83:0/2462192859 wait complete. 2024-09-21T00:15:53.956 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T00:15:53.956 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T00:15:54.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.180+0000 7fd48dc00640 1 -- 172.21.15.83:0/1832907670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd488160bb0 msgr2=0x7fd4880ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.180+0000 7fd48dc00640 1 --2- 172.21.15.83:0/1832907670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd488160bb0 0x7fd4880ccae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd478009820 tx=0x7fd47802a500 comp rx=0 tx=0).stop 2024-09-21T00:15:54.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.180+0000 7fd48dc00640 1 -- 172.21.15.83:0/1832907670 shutdown_connections 2024-09-21T00:15:54.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.180+0000 7fd48dc00640 1 --2- 172.21.15.83:0/1832907670 >> v2:172.21.15.142:3300/0 conn(0x7fd48815d510 0x7fd4880b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.181+0000 7fd48dc00640 1 --2- 172.21.15.83:0/1832907670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd488160bb0 0x7fd4880ccae0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.181+0000 7fd48dc00640 1 -- 172.21.15.83:0/1832907670 >> 172.21.15.83:0/1832907670 conn(0x7fd4880d2280 msgr2=0x7fd4880d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:54.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.181+0000 7fd48dc00640 1 -- 172.21.15.83:0/1832907670 shutdown_connections 2024-09-21T00:15:54.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.181+0000 7fd48dc00640 1 -- 172.21.15.83:0/1832907670 wait complete. 2024-09-21T00:15:54.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.183+0000 7fd48dc00640 1 Processor -- start 2024-09-21T00:15:54.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.183+0000 7fd48dc00640 1 -- start start 2024-09-21T00:15:54.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.184+0000 7fd48dc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4880cd020 0x7fd4880b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.184+0000 7fd48dc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd48815d510 0x7fd4881f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.184+0000 7fd48dc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd488160bb0 0x7fd48815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.184+0000 7fd48dc00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd4880d0390 con 0x7fd4880cd020 2024-09-21T00:15:54.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.184+0000 7fd48dc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd4880d0210 con 0x7fd48815d510 2024-09-21T00:15:54.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.184+0000 7fd48dc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd4880b28f0 con 0x7fd488160bb0 2024-09-21T00:15:54.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.185+0000 7fd486a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4880cd020 0x7fd4880b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.185+0000 7fd486a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4880cd020 0x7fd4880b7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51186/0 (socket says 172.21.15.83:51186) 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.185+0000 7fd486a00640 1 -- 172.21.15.83:0/2121809232 learned_addr learned my addr 172.21.15.83:0/2121809232 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.185+0000 7fd486a00640 1 -- 172.21.15.83:0/2121809232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd488160bb0 msgr2=0x7fd48815a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.185+0000 7fd486a00640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd488160bb0 0x7fd48815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.185+0000 7fd486a00640 1 -- 172.21.15.83:0/2121809232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd48815d510 msgr2=0x7fd4881f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.185+0000 7fd486a00640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd48815d510 0x7fd4881f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.185+0000 7fd486a00640 1 -- 172.21.15.83:0/2121809232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4880ca6a0 con 0x7fd4880cd020 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.185+0000 7fd486a00640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4880cd020 0x7fd4880b7a10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd478009940 tx=0x7fd478005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.186+0000 7fd47ea00640 1 -- 172.21.15.83:0/2121809232 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47803f070 con 0x7fd4880cd020 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.186+0000 7fd47ea00640 1 -- 172.21.15.83:0/2121809232 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd478004340 con 0x7fd4880cd020 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.186+0000 7fd47ea00640 1 -- 172.21.15.83:0/2121809232 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478031bb0 con 0x7fd4880cd020 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.186+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4880b5e40 con 0x7fd4880cd020 2024-09-21T00:15:54.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.186+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4880b6400 con 0x7fd4880cd020 2024-09-21T00:15:54.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.187+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd4880b2db0 con 0x7fd4880cd020 2024-09-21T00:15:54.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.188+0000 7fd47ea00640 1 -- 172.21.15.83:0/2121809232 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd478042070 con 0x7fd4880cd020 2024-09-21T00:15:54.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.189+0000 7fd47ea00640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd464078bc0 0x7fd46407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.189+0000 7fd47ea00640 1 -- 172.21.15.83:0/2121809232 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7fd4780bc250 con 0x7fd4880cd020 2024-09-21T00:15:54.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.189+0000 7fd47ea00640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] conn(0x7fd46407f150 0x7fd4640815e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.189+0000 7fd47ea00640 1 -- 172.21.15.83:0/2121809232 --> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd478032e50 con 0x7fd46407f150 2024-09-21T00:15:54.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.189+0000 7fd47ea00640 1 -- 172.21.15.83:0/2121809232 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fd4780bc600 con 0x7fd4880cd020 2024-09-21T00:15:54.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.190+0000 7fd47fe00640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd464078bc0 0x7fd46407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:54.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.190+0000 7fd487400640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] conn(0x7fd46407f150 0x7fd4640815e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:54.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.190+0000 7fd487400640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] conn(0x7fd46407f150 0x7fd4640815e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:54.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.190+0000 7fd47fe00640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd464078bc0 0x7fd46407b0d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd4880b83a0 tx=0x7fd470007a30 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:54.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.191+0000 7fd47ea00640 1 -- 172.21.15.83:0/2121809232 <== osd.2 v2:172.21.15.83:6800/4285051206 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd478032e50 con 0x7fd46407f150 2024-09-21T00:15:54.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.204+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 --> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd488068fe0 con 0x7fd46407f150 2024-09-21T00:15:54.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.204+0000 7fd47ea00640 1 -- 172.21.15.83:0/2121809232 <== osd.2 v2:172.21.15.83:6800/4285051206 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd488068fe0 con 0x7fd46407f150 2024-09-21T00:15:54.206 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:54.206 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T00:15:54.206 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 >> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] conn(0x7fd46407f150 msgr2=0x7fd4640815e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd48dc00640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.83:6800/4285051206,v1:172.21.15.83:6801/4285051206] conn(0x7fd46407f150 0x7fd4640815e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd464078bc0 msgr2=0x7fd46407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd48dc00640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fd464078bc0 0x7fd46407b0d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd4880b83a0 tx=0x7fd470007a30 comp rx=0 tx=0).stop 2024-09-21T00:15:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4880cd020 msgr2=0x7fd4880b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd48dc00640 1 --2- 172.21.15.83:0/2121809232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4880cd020 0x7fd4880b7a10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd478009940 tx=0x7fd478005270 comp rx=0 tx=0).stop 2024-09-21T00:15:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd487400640 1 -- 172.21.15.83:0/2121809232 reap_dead start 2024-09-21T00:15:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 shutdown_connections 2024-09-21T00:15:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 >> 172.21.15.83:0/2121809232 conn(0x7fd4880d2280 msgr2=0x7fd488070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:54.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 shutdown_connections 2024-09-21T00:15:54.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.205+0000 7fd48dc00640 1 -- 172.21.15.83:0/2121809232 wait complete. 2024-09-21T00:15:54.231 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T00:15:54.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.449+0000 7f6a86e00640 1 -- 172.21.15.83:0/586281271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a8015ca90 msgr2=0x7f6a800d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.449+0000 7f6a86e00640 1 --2- 172.21.15.83:0/586281271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a8015ca90 0x7f6a800d0670 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c005fd0 tx=0x7f6a6c02a540 comp rx=0 tx=0).stop 2024-09-21T00:15:54.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.449+0000 7f6a86e00640 1 -- 172.21.15.83:0/586281271 shutdown_connections 2024-09-21T00:15:54.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.449+0000 7f6a86e00640 1 --2- 172.21.15.83:0/586281271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a800d0bb0 0x7f6a800b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.449+0000 7f6a86e00640 1 --2- 172.21.15.83:0/586281271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a8015ca90 0x7f6a800d0670 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.449+0000 7f6a86e00640 1 -- 172.21.15.83:0/586281271 >> 172.21.15.83:0/586281271 conn(0x7f6a800b46e0 msgr2=0x7f6a800d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:54.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.449+0000 7f6a86e00640 1 -- 172.21.15.83:0/586281271 shutdown_connections 2024-09-21T00:15:54.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.449+0000 7f6a86e00640 1 -- 172.21.15.83:0/586281271 wait complete. 2024-09-21T00:15:54.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.451+0000 7f6a86e00640 1 Processor -- start 2024-09-21T00:15:54.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.452+0000 7f6a86e00640 1 -- start start 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.453+0000 7f6a86e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800ccc40 0x7f6a8006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.453+0000 7f6a86e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a800d0bb0 0x7f6a800b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.453+0000 7f6a86e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a8015ca90 0x7f6a8014f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.453+0000 7f6a86e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6a800b66a0 con 0x7f6a800d0bb0 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.453+0000 7f6a86e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a800b6520 con 0x7f6a800ccc40 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.453+0000 7f6a86e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6a800b6820 con 0x7f6a8015ca90 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.453+0000 7f6a7f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a800d0bb0 0x7f6a800b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.453+0000 7f6a7f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a800d0bb0 0x7f6a800b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51200/0 (socket says 172.21.15.83:51200) 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.453+0000 7f6a7f400640 1 -- 172.21.15.83:0/2394047779 learned_addr learned my addr 172.21.15.83:0/2394047779 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.454+0000 7f6a7fe00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800ccc40 0x7f6a8006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.454+0000 7f6a84e00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a8015ca90 0x7f6a8014f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:54.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.454+0000 7f6a7f400640 1 -- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a8015ca90 msgr2=0x7f6a8014f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.454+0000 7f6a7f400640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a8015ca90 0x7f6a8014f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.454+0000 7f6a7f400640 1 -- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800ccc40 msgr2=0x7f6a8006f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.454+0000 7f6a7f400640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800ccc40 0x7f6a8006f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.454+0000 7f6a7f400640 1 -- 172.21.15.83:0/2394047779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a800cca20 con 0x7f6a800d0bb0 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.454+0000 7f6a7fe00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800ccc40 0x7f6a8006f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.454+0000 7f6a84e00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a8015ca90 0x7f6a8014f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.454+0000 7f6a7f400640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a800d0bb0 0x7f6a800b13c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009850 tx=0x7f6a6c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.455+0000 7f6a77e00640 1 -- 172.21.15.83:0/2394047779 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c03e030 con 0x7f6a800d0bb0 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.455+0000 7f6a77e00640 1 -- 172.21.15.83:0/2394047779 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a6c003d90 con 0x7f6a800d0bb0 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.455+0000 7f6a86e00640 1 -- 172.21.15.83:0/2394047779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a800cc740 con 0x7f6a800d0bb0 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.455+0000 7f6a77e00640 1 -- 172.21.15.83:0/2394047779 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c035040 con 0x7f6a800d0bb0 2024-09-21T00:15:54.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.455+0000 7f6a86e00640 1 -- 172.21.15.83:0/2394047779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a8006ec80 con 0x7f6a800d0bb0 2024-09-21T00:15:54.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.456+0000 7f6a86e00640 1 -- 172.21.15.83:0/2394047779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a800b6db0 con 0x7f6a800d0bb0 2024-09-21T00:15:54.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.457+0000 7f6a77e00640 1 -- 172.21.15.83:0/2394047779 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a6c041030 con 0x7f6a800d0bb0 2024-09-21T00:15:54.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.458+0000 7f6a77e00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6a60078bc0 0x7f6a6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.458+0000 7f6a77e00640 1 -- 172.21.15.83:0/2394047779 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f6a6c0bb410 con 0x7f6a800d0bb0 2024-09-21T00:15:54.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.459+0000 7f6a7fe00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6a60078bc0 0x7f6a6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:54.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.459+0000 7f6a7fe00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6a60078bc0 0x7f6a6007b0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a700016a0 tx=0x7f6a70009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:54.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.462+0000 7f6a77e00640 1 -- 172.21.15.83:0/2394047779 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6a6c0838d0 con 0x7f6a800d0bb0 2024-09-21T00:15:54.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.645+0000 7f6a86e00640 1 -- 172.21.15.83:0/2394047779 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f6a800cd5e0 con 0x7f6a60078bc0 2024-09-21T00:15:54.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.646+0000 7f6a77e00640 1 -- 172.21.15.83:0/2394047779 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6a800cd5e0 con 0x7f6a60078bc0 2024-09-21T00:15:54.647 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T00:15:54.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 -- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6a60078bc0 msgr2=0x7f6a6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6a60078bc0 0x7f6a6007b0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a700016a0 tx=0x7f6a70009040 comp rx=0 tx=0).stop 2024-09-21T00:15:54.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 -- 172.21.15.83:0/2394047779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a800d0bb0 msgr2=0x7f6a800b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a800d0bb0 0x7f6a800b13c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009850 tx=0x7f6a6c0038a0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 -- 172.21.15.83:0/2394047779 shutdown_connections 2024-09-21T00:15:54.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f6a60078bc0 0x7f6a6007b0d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a8015ca90 0x7f6a8014f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a800d0bb0 0x7f6a800b13c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 --2- 172.21.15.83:0/2394047779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a800ccc40 0x7f6a8006f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 -- 172.21.15.83:0/2394047779 >> 172.21.15.83:0/2394047779 conn(0x7f6a800b46e0 msgr2=0x7f6a800b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:54.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 -- 172.21.15.83:0/2394047779 shutdown_connections 2024-09-21T00:15:54.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.648+0000 7f6a86e00640 1 -- 172.21.15.83:0/2394047779 wait complete. 2024-09-21T00:15:54.671 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T00:15:54.671 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T00:15:54.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.896+0000 7f3219c00640 1 -- 172.21.15.83:0/834360286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32140d0460 msgr2=0x7f3214161ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.896+0000 7f3219c00640 1 --2- 172.21.15.83:0/834360286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32140d0460 0x7f3214161ed0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f32140ba580 tx=0x7f320402a5f0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.896+0000 7f3219c00640 1 -- 172.21.15.83:0/834360286 shutdown_connections 2024-09-21T00:15:54.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.896+0000 7f3219c00640 1 --2- 172.21.15.83:0/834360286 >> v2:172.21.15.142:3300/0 conn(0x7f32140b7b60 0x7f32140b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.896+0000 7f3219c00640 1 --2- 172.21.15.83:0/834360286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32140d0460 0x7f3214161ed0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.896+0000 7f3219c00640 1 -- 172.21.15.83:0/834360286 >> 172.21.15.83:0/834360286 conn(0x7f32140d4510 msgr2=0x7f32140d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:54.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.896+0000 7f3219c00640 1 -- 172.21.15.83:0/834360286 shutdown_connections 2024-09-21T00:15:54.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.896+0000 7f3219c00640 1 -- 172.21.15.83:0/834360286 wait complete. 2024-09-21T00:15:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.898+0000 7f3219c00640 1 Processor -- start 2024-09-21T00:15:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.898+0000 7f3219c00640 1 -- start start 2024-09-21T00:15:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3219c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32140b7b60 0x7f32141f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3219c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32140cf200 0x7f32140cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3219c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32140d0460 0x7f321414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3219c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f32141629e0 con 0x7f32140b7b60 2024-09-21T00:15:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3219c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3214162860 con 0x7f32140d0460 2024-09-21T00:15:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3219c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3214162b60 con 0x7f32140cf200 2024-09-21T00:15:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3212a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32140b7b60 0x7f32141f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3212a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32140b7b60 0x7f32141f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51220/0 (socket says 172.21.15.83:51220) 2024-09-21T00:15:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3212a00640 1 -- 172.21.15.83:0/4095038474 learned_addr learned my addr 172.21.15.83:0/4095038474 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:54.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3212a00640 1 -- 172.21.15.83:0/4095038474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32140cf200 msgr2=0x7f32140cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3212a00640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32140cf200 0x7f32140cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3212a00640 1 -- 172.21.15.83:0/4095038474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32140d0460 msgr2=0x7f321414d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3212a00640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32140d0460 0x7f321414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.900+0000 7f3212a00640 1 -- 172.21.15.83:0/4095038474 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32141f69f0 con 0x7f32140b7b60 2024-09-21T00:15:54.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.901+0000 7f3212a00640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32140b7b60 0x7f32141f64b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3204000c00 tx=0x7f3204003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:54.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.901+0000 7f320aa00640 1 -- 172.21.15.83:0/4095038474 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320403e030 con 0x7f32140b7b60 2024-09-21T00:15:54.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.901+0000 7f320aa00640 1 -- 172.21.15.83:0/4095038474 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3204003e00 con 0x7f32140b7b60 2024-09-21T00:15:54.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.901+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32140cc6a0 con 0x7f32140b7b60 2024-09-21T00:15:54.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.901+0000 7f320aa00640 1 -- 172.21.15.83:0/4095038474 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3204035040 con 0x7f32140b7b60 2024-09-21T00:15:54.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.901+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32140cb680 con 0x7f32140b7b60 2024-09-21T00:15:54.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.902+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32140b7f70 con 0x7f32140b7b60 2024-09-21T00:15:54.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.903+0000 7f320aa00640 1 -- 172.21.15.83:0/4095038474 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3204041030 con 0x7f32140b7b60 2024-09-21T00:15:54.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.904+0000 7f320aa00640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31f4078b90 0x7f31f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.904+0000 7f320aa00640 1 -- 172.21.15.83:0/4095038474 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f32040bb590 con 0x7f32140b7b60 2024-09-21T00:15:54.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.904+0000 7f320aa00640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] conn(0x7f31f407f120 0x7f31f40815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:54.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.904+0000 7f320aa00640 1 -- 172.21.15.83:0/4095038474 --> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3204034e90 con 0x7f31f407f120 2024-09-21T00:15:54.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.904+0000 7f320aa00640 1 -- 172.21.15.83:0/4095038474 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f32040c2050 con 0x7f32140b7b60 2024-09-21T00:15:54.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.905+0000 7f3212000640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31f4078b90 0x7f31f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:54.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.905+0000 7f3213400640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] conn(0x7f31f407f120 0x7f31f40815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:54.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.905+0000 7f3213400640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] conn(0x7f31f407f120 0x7f31f40815b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:54.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.905+0000 7f3212000640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31f4078b90 0x7f31f407b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f32000058c0 tx=0x7f3200005850 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:54.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.906+0000 7f320aa00640 1 -- 172.21.15.83:0/4095038474 <== osd.3 v2:172.21.15.83:6824/1075763441 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3204034e90 con 0x7f31f407f120 2024-09-21T00:15:54.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.919+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 --> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f32140d20a0 con 0x7f31f407f120 2024-09-21T00:15:54.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.919+0000 7f320aa00640 1 -- 172.21.15.83:0/4095038474 <== osd.3 v2:172.21.15.83:6824/1075763441 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f32140d20a0 con 0x7f31f407f120 2024-09-21T00:15:54.921 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:54.921 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T00:15:54.921 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 >> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] conn(0x7f31f407f120 msgr2=0x7f31f40815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3219c00640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.83:6824/1075763441,v1:172.21.15.83:6825/1075763441] conn(0x7f31f407f120 0x7f31f40815b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31f4078b90 msgr2=0x7f31f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3219c00640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f31f4078b90 0x7f31f407b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f32000058c0 tx=0x7f3200005850 comp rx=0 tx=0).stop 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32140b7b60 msgr2=0x7f32141f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3219c00640 1 --2- 172.21.15.83:0/4095038474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32140b7b60 0x7f32141f64b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3204000c00 tx=0x7f3204003910 comp rx=0 tx=0).stop 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3213400640 1 -- 172.21.15.83:0/4095038474 reap_dead start 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 shutdown_connections 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 >> 172.21.15.83:0/4095038474 conn(0x7f32140d4510 msgr2=0x7f32140d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 shutdown_connections 2024-09-21T00:15:54.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:54.920+0000 7f3219c00640 1 -- 172.21.15.83:0/4095038474 wait complete. 2024-09-21T00:15:54.942 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T00:15:55.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.162+0000 7fa377c00640 1 -- 172.21.15.83:0/2190245606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37006e500 msgr2=0x7fa3700cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.162+0000 7fa377c00640 1 --2- 172.21.15.83:0/2190245606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37006e500 0x7fa3700cef00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa3700b2c70 tx=0x7fa36802aac0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.162+0000 7fa377c00640 1 -- 172.21.15.83:0/2190245606 shutdown_connections 2024-09-21T00:15:55.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.162+0000 7fa377c00640 1 --2- 172.21.15.83:0/2190245606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa37006e500 0x7fa3700cef00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.162+0000 7fa377c00640 1 --2- 172.21.15.83:0/2190245606 >> v2:172.21.15.142:3300/0 conn(0x7fa370156a50 0x7fa370074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.162+0000 7fa377c00640 1 -- 172.21.15.83:0/2190245606 >> 172.21.15.83:0/2190245606 conn(0x7fa3700b1b90 msgr2=0x7fa3700b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:55.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.162+0000 7fa377c00640 1 -- 172.21.15.83:0/2190245606 shutdown_connections 2024-09-21T00:15:55.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.162+0000 7fa377c00640 1 -- 172.21.15.83:0/2190245606 wait complete. 2024-09-21T00:15:55.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.165+0000 7fa377c00640 1 Processor -- start 2024-09-21T00:15:55.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.165+0000 7fa377c00640 1 -- start start 2024-09-21T00:15:55.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.166+0000 7fa377c00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa370074b60 0x7fa3701e9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.166+0000 7fa377c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa370156a50 0x7fa3700b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.166+0000 7fa377c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3701e6ed0 0x7fa3701e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.166+0000 7fa377c00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa3700cf7d0 con 0x7fa370074b60 2024-09-21T00:15:55.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.166+0000 7fa377c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa3700cf650 con 0x7fa370156a50 2024-09-21T00:15:55.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.166+0000 7fa377c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa3700cf950 con 0x7fa3701e6ed0 2024-09-21T00:15:55.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.166+0000 7fa375200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa370074b60 0x7fa3701e9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa375200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa370074b60 0x7fa3701e9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51238/0 (socket says 172.21.15.83:51238) 2024-09-21T00:15:55.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa375200640 1 -- 172.21.15.83:0/2736439349 learned_addr learned my addr 172.21.15.83:0/2736439349 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:55.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa375c00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3701e6ed0 0x7fa3701e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa36fe00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa370156a50 0x7fa3700b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa375200640 1 -- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3701e6ed0 msgr2=0x7fa3701e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa375200640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3701e6ed0 0x7fa3701e72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa375200640 1 -- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa370156a50 msgr2=0x7fa3700b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa375200640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa370156a50 0x7fa3700b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa375200640 1 -- 172.21.15.83:0/2736439349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3701e7820 con 0x7fa370074b60 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa375c00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3701e6ed0 0x7fa3701e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa36fe00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa370156a50 0x7fa3700b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.167+0000 7fa375200640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa370074b60 0x7fa3701e9b60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa36400d700 tx=0x7fa36400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.168+0000 7fa36cc00640 1 -- 172.21.15.83:0/2736439349 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364017070 con 0x7fa370074b60 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.168+0000 7fa36cc00640 1 -- 172.21.15.83:0/2736439349 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa364005310 con 0x7fa370074b60 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.168+0000 7fa377c00640 1 -- 172.21.15.83:0/2736439349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3701e8070 con 0x7fa370074b60 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.168+0000 7fa36cc00640 1 -- 172.21.15.83:0/2736439349 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364009820 con 0x7fa370074b60 2024-09-21T00:15:55.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.168+0000 7fa377c00640 1 -- 172.21.15.83:0/2736439349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa370157380 con 0x7fa370074b60 2024-09-21T00:15:55.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.169+0000 7fa377c00640 1 -- 172.21.15.83:0/2736439349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3701e8240 con 0x7fa370074b60 2024-09-21T00:15:55.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.170+0000 7fa36cc00640 1 -- 172.21.15.83:0/2736439349 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3640099c0 con 0x7fa370074b60 2024-09-21T00:15:55.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.171+0000 7fa36cc00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa350078bc0 0x7fa35007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.172+0000 7fa36cc00640 1 -- 172.21.15.83:0/2736439349 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7fa36409ae50 con 0x7fa370074b60 2024-09-21T00:15:55.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.172+0000 7fa36fe00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa350078bc0 0x7fa35007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.173+0000 7fa36fe00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa350078bc0 0x7fa35007b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa3700a0f10 tx=0x7fa35c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:55.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.176+0000 7fa36cc00640 1 -- 172.21.15.83:0/2736439349 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa3701e7820 con 0x7fa370074b60 2024-09-21T00:15:55.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.364+0000 7fa377c00640 1 -- 172.21.15.83:0/2736439349 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa3700cef00 con 0x7fa350078bc0 2024-09-21T00:15:55.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.365+0000 7fa36cc00640 1 -- 172.21.15.83:0/2736439349 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa3700cef00 con 0x7fa350078bc0 2024-09-21T00:15:55.366 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.367+0000 7fa377c00640 1 -- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa350078bc0 msgr2=0x7fa35007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.367+0000 7fa377c00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa350078bc0 0x7fa35007b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa3700a0f10 tx=0x7fa35c009040 comp rx=0 tx=0).stop 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.367+0000 7fa377c00640 1 -- 172.21.15.83:0/2736439349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa370074b60 msgr2=0x7fa3701e9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.367+0000 7fa377c00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa370074b60 0x7fa3701e9b60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa36400d700 tx=0x7fa36400dbc0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.367+0000 7fa377c00640 1 -- 172.21.15.83:0/2736439349 shutdown_connections 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.367+0000 7fa377c00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fa350078bc0 0x7fa35007b0d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.367+0000 7fa377c00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3701e6ed0 0x7fa3701e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.367+0000 7fa377c00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa370156a50 0x7fa3700b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.367+0000 7fa377c00640 1 --2- 172.21.15.83:0/2736439349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa370074b60 0x7fa3701e9b60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.367+0000 7fa377c00640 1 -- 172.21.15.83:0/2736439349 >> 172.21.15.83:0/2736439349 conn(0x7fa3700b1b90 msgr2=0x7fa370070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:55.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.368+0000 7fa377c00640 1 -- 172.21.15.83:0/2736439349 shutdown_connections 2024-09-21T00:15:55.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.368+0000 7fa377c00640 1 -- 172.21.15.83:0/2736439349 wait complete. 2024-09-21T00:15:55.390 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T00:15:55.391 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T00:15:55.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.613+0000 7f52edc00640 1 -- 172.21.15.83:0/1440445679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e8160810 msgr2=0x7f52e806d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.613+0000 7f52edc00640 1 --2- 172.21.15.83:0/1440445679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e8160810 0x7f52e806d2e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f52d4005fd0 tx=0x7f52d402a5d0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.613+0000 7f52edc00640 1 -- 172.21.15.83:0/1440445679 shutdown_connections 2024-09-21T00:15:55.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.613+0000 7f52edc00640 1 --2- 172.21.15.83:0/1440445679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e8160810 0x7f52e806d2e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.613+0000 7f52edc00640 1 -- 172.21.15.83:0/1440445679 >> 172.21.15.83:0/1440445679 conn(0x7f52e80ccac0 msgr2=0x7f52e80cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:55.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.613+0000 7f52edc00640 1 -- 172.21.15.83:0/1440445679 shutdown_connections 2024-09-21T00:15:55.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.613+0000 7f52edc00640 1 -- 172.21.15.83:0/1440445679 wait complete. 2024-09-21T00:15:55.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.616+0000 7f52edc00640 1 Processor -- start 2024-09-21T00:15:55.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.616+0000 7f52edc00640 1 -- start start 2024-09-21T00:15:55.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.617+0000 7f52edc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52e80ca690 0x7f52e80b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.617+0000 7f52edc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e8160810 0x7f52e80b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.617+0000 7f52edc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e8160c20 0x7f52e81f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.617+0000 7f52edc00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f52e806e2c0 con 0x7f52e8160810 2024-09-21T00:15:55.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.617+0000 7f52edc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f52e806e140 con 0x7f52e80ca690 2024-09-21T00:15:55.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.617+0000 7f52edc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f52e806e440 con 0x7f52e8160c20 2024-09-21T00:15:55.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.617+0000 7f52e6000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e8160810 0x7f52e80b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.617+0000 7f52e6000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e8160810 0x7f52e80b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51266/0 (socket says 172.21.15.83:51266) 2024-09-21T00:15:55.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.617+0000 7f52e6000640 1 -- 172.21.15.83:0/158011567 learned_addr learned my addr 172.21.15.83:0/158011567 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:55.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52e7400640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e8160c20 0x7f52e81f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52e6a00640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52e80ca690 0x7f52e80b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52e6000640 1 -- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e8160c20 msgr2=0x7f52e81f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52e6000640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e8160c20 0x7f52e81f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52e6000640 1 -- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52e80ca690 msgr2=0x7f52e80b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52e6000640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52e80ca690 0x7f52e80b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52e6000640 1 -- 172.21.15.83:0/158011567 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e80c4590 con 0x7f52e8160810 2024-09-21T00:15:55.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52e7400640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52e8160c20 0x7f52e81f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:55.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52e6a00640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52e80ca690 0x7f52e80b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:55.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52e6000640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e8160810 0x7f52e80b5560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f52d4000c00 tx=0x7f52d40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:55.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.618+0000 7f52dea00640 1 -- 172.21.15.83:0/158011567 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d403e030 con 0x7f52e8160810 2024-09-21T00:15:55.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.619+0000 7f52dea00640 1 -- 172.21.15.83:0/158011567 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52d4003ca0 con 0x7f52e8160810 2024-09-21T00:15:55.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.619+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e81f4850 con 0x7f52e8160810 2024-09-21T00:15:55.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.619+0000 7f52dea00640 1 -- 172.21.15.83:0/158011567 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4035040 con 0x7f52e8160810 2024-09-21T00:15:55.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.619+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e80b2ef0 con 0x7f52e8160810 2024-09-21T00:15:55.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.620+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52e80b5aa0 con 0x7f52e8160810 2024-09-21T00:15:55.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.621+0000 7f52dea00640 1 -- 172.21.15.83:0/158011567 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52d4041030 con 0x7f52e8160810 2024-09-21T00:15:55.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.622+0000 7f52dea00640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c8078b90 0x7f52c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.622+0000 7f52dea00640 1 -- 172.21.15.83:0/158011567 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f52d40bb920 con 0x7f52e8160810 2024-09-21T00:15:55.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.622+0000 7f52dea00640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] conn(0x7f52c807f120 0x7f52c80815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.622+0000 7f52dea00640 1 -- 172.21.15.83:0/158011567 --> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52d4003e90 con 0x7f52c807f120 2024-09-21T00:15:55.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.622+0000 7f52dea00640 1 -- 172.21.15.83:0/158011567 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f52d40bbcd0 con 0x7f52e8160810 2024-09-21T00:15:55.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.622+0000 7f52e6a00640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c8078b90 0x7f52c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.623+0000 7f52e7400640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] conn(0x7f52c807f120 0x7f52c80815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.623+0000 7f52e6a00640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c8078b90 0x7f52c807b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f52d8000f60 tx=0x7f52d8009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:55.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.623+0000 7f52e7400640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] conn(0x7f52c807f120 0x7f52c80815b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:55.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.624+0000 7f52dea00640 1 -- 172.21.15.83:0/158011567 <== osd.4 v2:172.21.15.142:6802/1069372226 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52d4003e90 con 0x7f52c807f120 2024-09-21T00:15:55.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.637+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 --> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f52e81f4600 con 0x7f52c807f120 2024-09-21T00:15:55.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52dea00640 1 -- 172.21.15.83:0/158011567 <== osd.4 v2:172.21.15.142:6802/1069372226 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f52e81f4600 con 0x7f52c807f120 2024-09-21T00:15:55.639 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T00:15:55.639 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:55.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] conn(0x7f52c807f120 msgr2=0x7f52c80815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52edc00640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:6802/1069372226,v1:172.21.15.142:6803/1069372226] conn(0x7f52c807f120 0x7f52c80815b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c8078b90 msgr2=0x7f52c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52edc00640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f52c8078b90 0x7f52c807b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f52d8000f60 tx=0x7f52d8009040 comp rx=0 tx=0).stop 2024-09-21T00:15:55.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e8160810 msgr2=0x7f52e80b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52edc00640 1 --2- 172.21.15.83:0/158011567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52e8160810 0x7f52e80b5560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f52d4000c00 tx=0x7f52d40038a0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52e7400640 1 -- 172.21.15.83:0/158011567 reap_dead start 2024-09-21T00:15:55.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 shutdown_connections 2024-09-21T00:15:55.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 >> 172.21.15.83:0/158011567 conn(0x7f52e80ccac0 msgr2=0x7f52e80aced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:55.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.638+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 shutdown_connections 2024-09-21T00:15:55.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.639+0000 7f52edc00640 1 -- 172.21.15.83:0/158011567 wait complete. 2024-09-21T00:15:55.660 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T00:15:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.882+0000 7f4414600640 1 -- 172.21.15.83:0/617140381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f440c0cf9a0 msgr2=0x7f440c072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.882+0000 7f4414600640 1 --2- 172.21.15.83:0/617140381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f440c0cf9a0 0x7f440c072d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4404005fd0 tx=0x7f440402aa90 comp rx=0 tx=0).stop 2024-09-21T00:15:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.882+0000 7f4414600640 1 -- 172.21.15.83:0/617140381 shutdown_connections 2024-09-21T00:15:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.882+0000 7f4414600640 1 --2- 172.21.15.83:0/617140381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f440c0cf9a0 0x7f440c072d90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.882+0000 7f4414600640 1 --2- 172.21.15.83:0/617140381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f440c15fc50 0x7f440c06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.882+0000 7f4414600640 1 -- 172.21.15.83:0/617140381 >> 172.21.15.83:0/617140381 conn(0x7f440c0b1b90 msgr2=0x7f440c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:55.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.882+0000 7f4414600640 1 -- 172.21.15.83:0/617140381 shutdown_connections 2024-09-21T00:15:55.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.883+0000 7f4414600640 1 -- 172.21.15.83:0/617140381 wait complete. 2024-09-21T00:15:55.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.885+0000 7f4414600640 1 Processor -- start 2024-09-21T00:15:55.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.885+0000 7f4414600640 1 -- start start 2024-09-21T00:15:55.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.886+0000 7f4414600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f440c06e330 0x7f440c0c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.886+0000 7f4414600640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f440c0cf9a0 0x7f440c0a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.886+0000 7f4414600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f440c15fc50 0x7f440c0b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.886+0000 7f4414600640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f440c070d20 con 0x7f440c0cf9a0 2024-09-21T00:15:55.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.886+0000 7f4414600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f440c070ba0 con 0x7f440c15fc50 2024-09-21T00:15:55.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.886+0000 7f4414600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f440c0732d0 con 0x7f440c06e330 2024-09-21T00:15:55.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4411200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f440c0cf9a0 0x7f440c0a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4411200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f440c0cf9a0 0x7f440c0a0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51292/0 (socket says 172.21.15.83:51292) 2024-09-21T00:15:55.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4411200640 1 -- 172.21.15.83:0/1389516306 learned_addr learned my addr 172.21.15.83:0/1389516306 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:55.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4411c00640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f440c06e330 0x7f440c0c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4412600640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f440c15fc50 0x7f440c0b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4411200640 1 -- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f440c06e330 msgr2=0x7f440c0c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4411200640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f440c06e330 0x7f440c0c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4411200640 1 -- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f440c15fc50 msgr2=0x7f440c0b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:55.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4411200640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f440c15fc50 0x7f440c0b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:55.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4411200640 1 -- 172.21.15.83:0/1389516306 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c0c9dc0 con 0x7f440c0cf9a0 2024-09-21T00:15:55.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.887+0000 7f4411200640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f440c0cf9a0 0x7f440c0a0b40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c3c0 tx=0x7f43f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:55.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.888+0000 7f4409600640 1 -- 172.21.15.83:0/1389516306 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8017070 con 0x7f440c0cf9a0 2024-09-21T00:15:55.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.888+0000 7f4409600640 1 -- 172.21.15.83:0/1389516306 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43f80035f0 con 0x7f440c0cf9a0 2024-09-21T00:15:55.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.888+0000 7f4414600640 1 -- 172.21.15.83:0/1389516306 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440c0ca0a0 con 0x7f440c0cf9a0 2024-09-21T00:15:55.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.888+0000 7f4409600640 1 -- 172.21.15.83:0/1389516306 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8003a40 con 0x7f440c0cf9a0 2024-09-21T00:15:55.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.888+0000 7f4414600640 1 -- 172.21.15.83:0/1389516306 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440c0a1080 con 0x7f440c0cf9a0 2024-09-21T00:15:55.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.889+0000 7f4414600640 1 -- 172.21.15.83:0/1389516306 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440c0c7af0 con 0x7f440c0cf9a0 2024-09-21T00:15:55.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.890+0000 7f4409600640 1 -- 172.21.15.83:0/1389516306 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43f801a070 con 0x7f440c0cf9a0 2024-09-21T00:15:55.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.891+0000 7f4409600640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f43ec078b90 0x7f43ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:55.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.891+0000 7f4409600640 1 -- 172.21.15.83:0/1389516306 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f43f8099e50 con 0x7f440c0cf9a0 2024-09-21T00:15:55.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.891+0000 7f4411c00640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f43ec078b90 0x7f43ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:55.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.892+0000 7f4411c00640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f43ec078b90 0x7f43ec07b0a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f440000bb50 tx=0x7f440000b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:55.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:55.895+0000 7f4409600640 1 -- 172.21.15.83:0/1389516306 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f440c0c7af0 con 0x7f440c0cf9a0 2024-09-21T00:15:56.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.079+0000 7f4414600640 1 -- 172.21.15.83:0/1389516306 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f440c073820 con 0x7f43ec078b90 2024-09-21T00:15:56.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.080+0000 7f4409600640 1 -- 172.21.15.83:0/1389516306 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f440c073820 con 0x7f43ec078b90 2024-09-21T00:15:56.081 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T00:15:56.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 -- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f43ec078b90 msgr2=0x7f43ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f43ec078b90 0x7f43ec07b0a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f440000bb50 tx=0x7f440000b2e0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 -- 172.21.15.83:0/1389516306 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f440c0cf9a0 msgr2=0x7f440c0a0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f440c0cf9a0 0x7f440c0a0b40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c3c0 tx=0x7f43f800c880 comp rx=0 tx=0).stop 2024-09-21T00:15:56.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 -- 172.21.15.83:0/1389516306 shutdown_connections 2024-09-21T00:15:56.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f43ec078b90 0x7f43ec07b0a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f440c15fc50 0x7f440c0b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f440c0cf9a0 0x7f440c0a0b40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 --2- 172.21.15.83:0/1389516306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f440c06e330 0x7f440c0c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 -- 172.21.15.83:0/1389516306 >> 172.21.15.83:0/1389516306 conn(0x7f440c0b1b90 msgr2=0x7f440c0b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:56.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 -- 172.21.15.83:0/1389516306 shutdown_connections 2024-09-21T00:15:56.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.082+0000 7f4414600640 1 -- 172.21.15.83:0/1389516306 wait complete. 2024-09-21T00:15:56.107 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T00:15:56.107 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T00:15:56.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.330+0000 7f4525800640 1 -- 172.21.15.83:0/4094244562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f452006def0 msgr2=0x7f452006e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.330+0000 7f4525800640 1 --2- 172.21.15.83:0/4094244562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f452006def0 0x7f452006e300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4518005fd0 tx=0x7f451802aa90 comp rx=0 tx=0).stop 2024-09-21T00:15:56.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.330+0000 7f4525800640 1 -- 172.21.15.83:0/4094244562 shutdown_connections 2024-09-21T00:15:56.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.330+0000 7f4525800640 1 --2- 172.21.15.83:0/4094244562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f452006def0 0x7f452006e300 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.330+0000 7f4525800640 1 --2- 172.21.15.83:0/4094244562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4520070940 0x7f45200cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.330+0000 7f4525800640 1 -- 172.21.15.83:0/4094244562 >> 172.21.15.83:0/4094244562 conn(0x7f45200ccac0 msgr2=0x7f45200cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:56.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.331+0000 7f4525800640 1 -- 172.21.15.83:0/4094244562 shutdown_connections 2024-09-21T00:15:56.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.331+0000 7f4525800640 1 -- 172.21.15.83:0/4094244562 wait complete. 2024-09-21T00:15:56.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.333+0000 7f4525800640 1 Processor -- start 2024-09-21T00:15:56.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.333+0000 7f4525800640 1 -- start start 2024-09-21T00:15:56.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.334+0000 7f4525800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f452006def0 0x7f45200c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:56.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f4525800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4520070940 0x7f452014a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f4525800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45200cd790 0x7f452014a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f4525800640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f452006f660 con 0x7f45200cd790 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f4525800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f452006f4e0 con 0x7f4520070940 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f4525800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f452006f7e0 con 0x7f452006def0 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f451f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45200cd790 0x7f452014a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f451f400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45200cd790 0x7f452014a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51304/0 (socket says 172.21.15.83:51304) 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f451f400640 1 -- 172.21.15.83:0/699193925 learned_addr learned my addr 172.21.15.83:0/699193925 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f451e000640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4520070940 0x7f452014a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f451ea00640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f452006def0 0x7f45200c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f451f400640 1 -- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f452006def0 msgr2=0x7f45200c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f451f400640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f452006def0 0x7f45200c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f451f400640 1 -- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4520070940 msgr2=0x7f452014a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f451f400640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4520070940 0x7f452014a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.335+0000 7f451f400640 1 -- 172.21.15.83:0/699193925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45201e5500 con 0x7f45200cd790 2024-09-21T00:15:56.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.336+0000 7f451f400640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45200cd790 0x7f452014a7e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4518009bf0 tx=0x7f4518003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:56.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.336+0000 7f4516a00640 1 -- 172.21.15.83:0/699193925 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518044070 con 0x7f45200cd790 2024-09-21T00:15:56.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.336+0000 7f4516a00640 1 -- 172.21.15.83:0/699193925 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4518004250 con 0x7f45200cd790 2024-09-21T00:15:56.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.336+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45201e57e0 con 0x7f45200cd790 2024-09-21T00:15:56.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.336+0000 7f4516a00640 1 -- 172.21.15.83:0/699193925 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518004660 con 0x7f45200cd790 2024-09-21T00:15:56.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.336+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45201e5da0 con 0x7f45200cd790 2024-09-21T00:15:56.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.337+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f452014ad20 con 0x7f45200cd790 2024-09-21T00:15:56.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.338+0000 7f4516a00640 1 -- 172.21.15.83:0/699193925 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4518047070 con 0x7f45200cd790 2024-09-21T00:15:56.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.339+0000 7f4516a00640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4500078b90 0x7f450007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:56.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.339+0000 7f4516a00640 1 -- 172.21.15.83:0/699193925 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f45180bbd20 con 0x7f45200cd790 2024-09-21T00:15:56.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.339+0000 7f4516a00640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] conn(0x7f450007f120 0x7f45000815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:56.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.339+0000 7f4516a00640 1 -- 172.21.15.83:0/699193925 --> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f451802eae0 con 0x7f450007f120 2024-09-21T00:15:56.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.339+0000 7f4516a00640 1 -- 172.21.15.83:0/699193925 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f45180c1070 con 0x7f45200cd790 2024-09-21T00:15:56.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.339+0000 7f451ea00640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4500078b90 0x7f450007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:56.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.340+0000 7f451e000640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] conn(0x7f450007f120 0x7f45000815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:56.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.340+0000 7f451ea00640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4500078b90 0x7f450007b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4510007fd0 tx=0x7f4510009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:56.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.340+0000 7f451e000640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] conn(0x7f450007f120 0x7f45000815b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:56.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.341+0000 7f4516a00640 1 -- 172.21.15.83:0/699193925 <== osd.5 v2:172.21.15.142:6810/3942773776 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f451802eae0 con 0x7f450007f120 2024-09-21T00:15:56.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.354+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 --> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f452006e300 con 0x7f450007f120 2024-09-21T00:15:56.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.355+0000 7f4516a00640 1 -- 172.21.15.83:0/699193925 <== osd.5 v2:172.21.15.142:6810/3942773776 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f452006e300 con 0x7f450007f120 2024-09-21T00:15:56.357 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:56.357 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T00:15:56.357 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:56.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] conn(0x7f450007f120 msgr2=0x7f45000815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f4525800640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:6810/3942773776,v1:172.21.15.142:6811/3942773776] conn(0x7f450007f120 0x7f45000815b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4500078b90 msgr2=0x7f450007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f4525800640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f4500078b90 0x7f450007b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4510007fd0 tx=0x7f4510009040 comp rx=0 tx=0).stop 2024-09-21T00:15:56.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45200cd790 msgr2=0x7f452014a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f4525800640 1 --2- 172.21.15.83:0/699193925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45200cd790 0x7f452014a7e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4518009bf0 tx=0x7f4518003ce0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f451f400640 1 -- 172.21.15.83:0/699193925 reap_dead start 2024-09-21T00:15:56.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 shutdown_connections 2024-09-21T00:15:56.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 >> 172.21.15.83:0/699193925 conn(0x7f45200ccac0 msgr2=0x7f452006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:56.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 shutdown_connections 2024-09-21T00:15:56.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.356+0000 7f4525800640 1 -- 172.21.15.83:0/699193925 wait complete. 2024-09-21T00:15:56.378 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T00:15:56.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.598+0000 7f7eae400640 1 -- 172.21.15.83:0/3653100451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea8074b60 msgr2=0x7f7ea806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.598+0000 7f7eae400640 1 --2- 172.21.15.83:0/3653100451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea8074b60 0x7f7ea806ddf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009830 tx=0x7f7e9402a510 comp rx=0 tx=0).stop 2024-09-21T00:15:56.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.598+0000 7f7eae400640 1 -- 172.21.15.83:0/3653100451 shutdown_connections 2024-09-21T00:15:56.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.598+0000 7f7eae400640 1 --2- 172.21.15.83:0/3653100451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea8074b60 0x7f7ea806ddf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.598+0000 7f7eae400640 1 --2- 172.21.15.83:0/3653100451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea8156a50 0x7f7ea8074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.598+0000 7f7eae400640 1 -- 172.21.15.83:0/3653100451 >> 172.21.15.83:0/3653100451 conn(0x7f7ea80b1b90 msgr2=0x7f7ea80b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:56.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.598+0000 7f7eae400640 1 -- 172.21.15.83:0/3653100451 shutdown_connections 2024-09-21T00:15:56.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.598+0000 7f7eae400640 1 -- 172.21.15.83:0/3653100451 wait complete. 2024-09-21T00:15:56.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.600+0000 7f7eae400640 1 Processor -- start 2024-09-21T00:15:56.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.600+0000 7f7eae400640 1 -- start start 2024-09-21T00:15:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7eae400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea806e330 0x7f7ea80c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7eae400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea8074b60 0x7f7ea8155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7eae400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ea8156a50 0x7f7ea815b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:56.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7eae400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea80ce500 con 0x7f7ea8156a50 2024-09-21T00:15:56.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7eae400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea80ce380 con 0x7f7ea8074b60 2024-09-21T00:15:56.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7eae400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea80ce680 con 0x7f7ea806e330 2024-09-21T00:15:56.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7ea7e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ea8156a50 0x7f7ea815b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:56.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7ea7e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ea8156a50 0x7f7ea815b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51308/0 (socket says 172.21.15.83:51308) 2024-09-21T00:15:56.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7ea7e00640 1 -- 172.21.15.83:0/2194428131 learned_addr learned my addr 172.21.15.83:0/2194428131 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:56.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7ea6a00640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea8074b60 0x7f7ea8155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:56.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.602+0000 7f7ea7400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea806e330 0x7f7ea80c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7ea7e00640 1 -- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea806e330 msgr2=0x7f7ea80c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7ea7e00640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea806e330 0x7f7ea80c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7ea7e00640 1 -- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea8074b60 msgr2=0x7f7ea8155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7ea7e00640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea8074b60 0x7f7ea8155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7ea7e00640 1 -- 172.21.15.83:0/2194428131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea8156440 con 0x7f7ea8156a50 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7ea7400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea806e330 0x7f7ea80c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7ea7e00640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ea8156a50 0x7f7ea815b5f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000cb10 tx=0x7f7ea000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7e9f400640 1 -- 172.21.15.83:0/2194428131 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0016020 con 0x7f7ea8156a50 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7e9f400640 1 -- 172.21.15.83:0/2194428131 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ea000ad60 con 0x7f7ea8156a50 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7eae400640 1 -- 172.21.15.83:0/2194428131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea80cacb0 con 0x7f7ea8156a50 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7e9f400640 1 -- 172.21.15.83:0/2194428131 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0012680 con 0x7f7ea8156a50 2024-09-21T00:15:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.603+0000 7f7eae400640 1 -- 172.21.15.83:0/2194428131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea80cb270 con 0x7f7ea8156a50 2024-09-21T00:15:56.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.604+0000 7f7eae400640 1 -- 172.21.15.83:0/2194428131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea806ddf0 con 0x7f7ea8156a50 2024-09-21T00:15:56.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.605+0000 7f7e9f400640 1 -- 172.21.15.83:0/2194428131 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ea0019020 con 0x7f7ea8156a50 2024-09-21T00:15:56.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.606+0000 7f7e9f400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7e88078b90 0x7f7e8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:56.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.606+0000 7f7e9f400640 1 -- 172.21.15.83:0/2194428131 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f7ea009b1f0 con 0x7f7ea8156a50 2024-09-21T00:15:56.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.607+0000 7f7ea7400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7e88078b90 0x7f7e8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:56.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.608+0000 7f7ea7400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7e88078b90 0x7f7e8807b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009b80 tx=0x7f7e98005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:56.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.611+0000 7f7e9f400640 1 -- 172.21.15.83:0/2194428131 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7ea0020020 con 0x7f7ea8156a50 2024-09-21T00:15:56.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.797+0000 7f7eae400640 1 -- 172.21.15.83:0/2194428131 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f7ea8160320 con 0x7f7e88078b90 2024-09-21T00:15:56.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.798+0000 7f7e9f400640 1 -- 172.21.15.83:0/2194428131 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7ea8160320 con 0x7f7e88078b90 2024-09-21T00:15:56.799 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T00:15:56.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 -- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7e88078b90 msgr2=0x7f7e8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7e88078b90 0x7f7e8807b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009b80 tx=0x7f7e98005f90 comp rx=0 tx=0).stop 2024-09-21T00:15:56.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 -- 172.21.15.83:0/2194428131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ea8156a50 msgr2=0x7f7ea815b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:56.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ea8156a50 0x7f7ea815b5f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000cb10 tx=0x7f7ea000a060 comp rx=0 tx=0).stop 2024-09-21T00:15:56.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 -- 172.21.15.83:0/2194428131 shutdown_connections 2024-09-21T00:15:56.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f7e88078b90 0x7f7e8807b0a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ea8156a50 0x7f7ea815b5f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea8074b60 0x7f7ea8155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 --2- 172.21.15.83:0/2194428131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea806e330 0x7f7ea80c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:56.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 -- 172.21.15.83:0/2194428131 >> 172.21.15.83:0/2194428131 conn(0x7f7ea80b1b90 msgr2=0x7f7ea80b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:56.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 -- 172.21.15.83:0/2194428131 shutdown_connections 2024-09-21T00:15:56.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:56.800+0000 7f7eae400640 1 -- 172.21.15.83:0/2194428131 wait complete. 2024-09-21T00:15:56.826 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T00:15:56.826 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T00:15:57.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.050+0000 7f50f2400640 1 -- 172.21.15.83:0/1674923438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ec145cc0 msgr2=0x7f50ec0cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.050+0000 7f50f2400640 1 --2- 172.21.15.83:0/1674923438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ec145cc0 0x7f50ec0cf030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f50e4005fd0 tx=0x7f50e402a8b0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.051+0000 7f50f2400640 1 -- 172.21.15.83:0/1674923438 shutdown_connections 2024-09-21T00:15:57.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.051+0000 7f50f2400640 1 --2- 172.21.15.83:0/1674923438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ec160670 0x7f50ec0ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.051+0000 7f50f2400640 1 --2- 172.21.15.83:0/1674923438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ec145cc0 0x7f50ec0cf030 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.051+0000 7f50f2400640 1 -- 172.21.15.83:0/1674923438 >> 172.21.15.83:0/1674923438 conn(0x7f50ec0d0460 msgr2=0x7f50ec06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:57.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.051+0000 7f50f2400640 1 -- 172.21.15.83:0/1674923438 shutdown_connections 2024-09-21T00:15:57.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.051+0000 7f50f2400640 1 -- 172.21.15.83:0/1674923438 wait complete. 2024-09-21T00:15:57.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.053+0000 7f50f2400640 1 Processor -- start 2024-09-21T00:15:57.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.053+0000 7f50f2400640 1 -- start start 2024-09-21T00:15:57.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50f2400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ec0b2e60 0x7f50ec141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50f2400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50ec145cc0 0x7f50ec14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50f2400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ec151e70 0x7f50ec14e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50f2400640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec06ff10 con 0x7f50ec145cc0 2024-09-21T00:15:57.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50f2400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec06fd90 con 0x7f50ec0b2e60 2024-09-21T00:15:57.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50f2400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f50ec070090 con 0x7f50ec151e70 2024-09-21T00:15:57.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50e3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50ec145cc0 0x7f50ec14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50e3e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50ec145cc0 0x7f50ec14e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51324/0 (socket says 172.21.15.83:51324) 2024-09-21T00:15:57.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50e3e00640 1 -- 172.21.15.83:0/1096917723 learned_addr learned my addr 172.21.15.83:0/1096917723 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:57.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50f1000640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ec0b2e60 0x7f50ec141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50f1a00640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ec151e70 0x7f50ec14e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50e3e00640 1 -- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ec151e70 msgr2=0x7f50ec14e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50e3e00640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ec151e70 0x7f50ec14e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50e3e00640 1 -- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ec0b2e60 msgr2=0x7f50ec141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50e3e00640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ec0b2e60 0x7f50ec141510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.055+0000 7f50e3e00640 1 -- 172.21.15.83:0/1096917723 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ec141e70 con 0x7f50ec145cc0 2024-09-21T00:15:57.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.056+0000 7f50e3e00640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50ec145cc0 0x7f50ec14e3b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f50d400e9f0 tx=0x7f50d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:57.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.056+0000 7f50e9600640 1 -- 172.21.15.83:0/1096917723 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d400cd80 con 0x7f50ec145cc0 2024-09-21T00:15:57.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.056+0000 7f50e9600640 1 -- 172.21.15.83:0/1096917723 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50d4004020 con 0x7f50ec145cc0 2024-09-21T00:15:57.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.056+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ec142150 con 0x7f50ec145cc0 2024-09-21T00:15:57.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.056+0000 7f50e9600640 1 -- 172.21.15.83:0/1096917723 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4004470 con 0x7f50ec145cc0 2024-09-21T00:15:57.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.056+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ec142710 con 0x7f50ec145cc0 2024-09-21T00:15:57.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.057+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50ec0705b0 con 0x7f50ec145cc0 2024-09-21T00:15:57.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.058+0000 7f50e9600640 1 -- 172.21.15.83:0/1096917723 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50d40035f0 con 0x7f50ec145cc0 2024-09-21T00:15:57.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.059+0000 7f50e9600640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f50c8078b90 0x7f50c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.059+0000 7f50e9600640 1 -- 172.21.15.83:0/1096917723 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f50d409bcc0 con 0x7f50ec145cc0 2024-09-21T00:15:57.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.060+0000 7f50e9600640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] conn(0x7f50c807f120 0x7f50c80815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.060+0000 7f50e9600640 1 -- 172.21.15.83:0/1096917723 --> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50d4015e50 con 0x7f50c807f120 2024-09-21T00:15:57.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.060+0000 7f50e9600640 1 -- 172.21.15.83:0/1096917723 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f50d409c070 con 0x7f50ec145cc0 2024-09-21T00:15:57.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.060+0000 7f50f1000640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f50c8078b90 0x7f50c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.060+0000 7f50f1a00640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] conn(0x7f50c807f120 0x7f50c80815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.061+0000 7f50f1000640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f50c8078b90 0x7f50c807b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f50dc007fd0 tx=0x7f50dc001370 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:57.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.061+0000 7f50f1a00640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] conn(0x7f50c807f120 0x7f50c80815b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:57.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.062+0000 7f50e9600640 1 -- 172.21.15.83:0/1096917723 <== osd.6 v2:172.21.15.142:6818/2503212538 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f50d4015e50 con 0x7f50c807f120 2024-09-21T00:15:57.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.075+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 --> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f50ec0adc20 con 0x7f50c807f120 2024-09-21T00:15:57.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.075+0000 7f50e9600640 1 -- 172.21.15.83:0/1096917723 <== osd.6 v2:172.21.15.142:6818/2503212538 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f50ec0adc20 con 0x7f50c807f120 2024-09-21T00:15:57.077 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:57.077 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T00:15:57.077 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:57.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] conn(0x7f50c807f120 msgr2=0x7f50c80815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f2400640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:6818/2503212538,v1:172.21.15.142:6819/2503212538] conn(0x7f50c807f120 0x7f50c80815b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f50c8078b90 msgr2=0x7f50c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f2400640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f50c8078b90 0x7f50c807b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f50dc007fd0 tx=0x7f50dc001370 comp rx=0 tx=0).stop 2024-09-21T00:15:57.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50ec145cc0 msgr2=0x7f50ec14e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f2400640 1 --2- 172.21.15.83:0/1096917723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50ec145cc0 0x7f50ec14e3b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f50d400e9f0 tx=0x7f50d400eeb0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f1a00640 1 -- 172.21.15.83:0/1096917723 reap_dead start 2024-09-21T00:15:57.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 shutdown_connections 2024-09-21T00:15:57.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 >> 172.21.15.83:0/1096917723 conn(0x7f50ec0d0460 msgr2=0x7f50ec15ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:57.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 shutdown_connections 2024-09-21T00:15:57.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.076+0000 7f50f2400640 1 -- 172.21.15.83:0/1096917723 wait complete. 2024-09-21T00:15:57.101 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T00:15:57.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.320+0000 7fbf48a00640 1 -- 172.21.15.83:0/1451110257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf4406ddf0 msgr2=0x7fbf4406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.320+0000 7fbf48a00640 1 --2- 172.21.15.83:0/1451110257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf4406ddf0 0x7fbf4406e200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009830 tx=0x7fbf3002a510 comp rx=0 tx=0).stop 2024-09-21T00:15:57.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.320+0000 7fbf48a00640 1 -- 172.21.15.83:0/1451110257 shutdown_connections 2024-09-21T00:15:57.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.320+0000 7fbf48a00640 1 --2- 172.21.15.83:0/1451110257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf440cef00 0x7fbf440cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.320+0000 7fbf48a00640 1 --2- 172.21.15.83:0/1451110257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf4406ddf0 0x7fbf4406e200 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.320+0000 7fbf48a00640 1 -- 172.21.15.83:0/1451110257 >> 172.21.15.83:0/1451110257 conn(0x7fbf440b1b90 msgr2=0x7fbf440b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:57.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.320+0000 7fbf48a00640 1 -- 172.21.15.83:0/1451110257 shutdown_connections 2024-09-21T00:15:57.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.320+0000 7fbf48a00640 1 -- 172.21.15.83:0/1451110257 wait complete. 2024-09-21T00:15:57.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.323+0000 7fbf48a00640 1 Processor -- start 2024-09-21T00:15:57.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.323+0000 7fbf48a00640 1 -- start start 2024-09-21T00:15:57.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.324+0000 7fbf48a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4406ddf0 0x7fbf440a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.324+0000 7fbf48a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf440cef00 0x7fbf44157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.324+0000 7fbf48a00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf44156a50 0x7fbf441f88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.324+0000 7fbf48a00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbf440cf850 con 0x7fbf44156a50 2024-09-21T00:15:57.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.324+0000 7fbf48a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44161060 con 0x7fbf4406ddf0 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.324+0000 7fbf48a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbf440cf9d0 con 0x7fbf440cef00 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf42800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf44156a50 0x7fbf441f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf42800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf44156a50 0x7fbf441f88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51348/0 (socket says 172.21.15.83:51348) 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf42800640 1 -- 172.21.15.83:0/1508667319 learned_addr learned my addr 172.21.15.83:0/1508667319 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf41e00640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4406ddf0 0x7fbf440a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf41400640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf440cef00 0x7fbf44157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf42800640 1 -- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf440cef00 msgr2=0x7fbf44157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf42800640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf440cef00 0x7fbf44157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf42800640 1 -- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4406ddf0 msgr2=0x7fbf440a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf42800640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4406ddf0 0x7fbf440a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf42800640 1 -- 172.21.15.83:0/1508667319 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf441576a0 con 0x7fbf44156a50 2024-09-21T00:15:57.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.325+0000 7fbf42800640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf44156a50 0x7fbf441f88e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00ea70 tx=0x7fbf3c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:57.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.326+0000 7fbf3a000640 1 -- 172.21.15.83:0/1508667319 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00ce40 con 0x7fbf44156a50 2024-09-21T00:15:57.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.326+0000 7fbf3a000640 1 -- 172.21.15.83:0/1508667319 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf3c004c10 con 0x7fbf44156a50 2024-09-21T00:15:57.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.326+0000 7fbf3a000640 1 -- 172.21.15.83:0/1508667319 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c005020 con 0x7fbf44156a50 2024-09-21T00:15:57.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.326+0000 7fbf48a00640 1 -- 172.21.15.83:0/1508667319 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf44159b70 con 0x7fbf44156a50 2024-09-21T00:15:57.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.326+0000 7fbf48a00640 1 -- 172.21.15.83:0/1508667319 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf440b4170 con 0x7fbf44156a50 2024-09-21T00:15:57.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.327+0000 7fbf48a00640 1 -- 172.21.15.83:0/1508667319 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf4406e200 con 0x7fbf44156a50 2024-09-21T00:15:57.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.328+0000 7fbf3a000640 1 -- 172.21.15.83:0/1508667319 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf3c0051c0 con 0x7fbf44156a50 2024-09-21T00:15:57.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.329+0000 7fbf3a000640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbf24078bc0 0x7fbf2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.329+0000 7fbf3a000640 1 -- 172.21.15.83:0/1508667319 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7fbf3c09b8e0 con 0x7fbf44156a50 2024-09-21T00:15:57.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.330+0000 7fbf41e00640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbf24078bc0 0x7fbf2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.330+0000 7fbf41e00640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbf24078bc0 0x7fbf2407b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf34000f60 tx=0x7fbf34009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:57.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.334+0000 7fbf3a000640 1 -- 172.21.15.83:0/1508667319 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbf3c0637e0 con 0x7fbf44156a50 2024-09-21T00:15:57.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.519+0000 7fbf48a00640 1 -- 172.21.15.83:0/1508667319 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fbf44072d60 con 0x7fbf24078bc0 2024-09-21T00:15:57.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.519+0000 7fbf3a000640 1 -- 172.21.15.83:0/1508667319 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbf44072d60 con 0x7fbf24078bc0 2024-09-21T00:15:57.520 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T00:15:57.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 -- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbf24078bc0 msgr2=0x7fbf2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbf24078bc0 0x7fbf2407b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf34000f60 tx=0x7fbf34009040 comp rx=0 tx=0).stop 2024-09-21T00:15:57.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 -- 172.21.15.83:0/1508667319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf44156a50 msgr2=0x7fbf441f88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf44156a50 0x7fbf441f88e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00ea70 tx=0x7fbf3c00ef30 comp rx=0 tx=0).stop 2024-09-21T00:15:57.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 -- 172.21.15.83:0/1508667319 shutdown_connections 2024-09-21T00:15:57.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fbf24078bc0 0x7fbf2407b0d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf44156a50 0x7fbf441f88e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf440cef00 0x7fbf44157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 --2- 172.21.15.83:0/1508667319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4406ddf0 0x7fbf440a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 -- 172.21.15.83:0/1508667319 >> 172.21.15.83:0/1508667319 conn(0x7fbf440b1b90 msgr2=0x7fbf440730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:57.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 -- 172.21.15.83:0/1508667319 shutdown_connections 2024-09-21T00:15:57.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.522+0000 7fbf48a00640 1 -- 172.21.15.83:0/1508667319 wait complete. 2024-09-21T00:15:57.544 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T00:15:57.545 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T00:15:57.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.770+0000 7f2dfb200640 1 -- 172.21.15.83:0/1748278239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2df40b2e60 msgr2=0x7f2df415ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.770+0000 7f2dfb200640 1 --2- 172.21.15.83:0/1748278239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2df40b2e60 0x7f2df415ff60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2df40cfa70 tx=0x7f2de802a540 comp rx=0 tx=0).stop 2024-09-21T00:15:57.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.770+0000 7f2dfb200640 1 -- 172.21.15.83:0/1748278239 shutdown_connections 2024-09-21T00:15:57.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.770+0000 7f2dfb200640 1 --2- 172.21.15.83:0/1748278239 >> v2:172.21.15.142:3300/0 conn(0x7f2df40ceaf0 0x7f2df40cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.770+0000 7f2dfb200640 1 --2- 172.21.15.83:0/1748278239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df4145cc0 0x7f2df41604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.770+0000 7f2dfb200640 1 --2- 172.21.15.83:0/1748278239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2df40b2e60 0x7f2df415ff60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.770+0000 7f2dfb200640 1 -- 172.21.15.83:0/1748278239 >> 172.21.15.83:0/1748278239 conn(0x7f2df40d0460 msgr2=0x7f2df406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:57.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.770+0000 7f2dfb200640 1 -- 172.21.15.83:0/1748278239 shutdown_connections 2024-09-21T00:15:57.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.770+0000 7f2dfb200640 1 -- 172.21.15.83:0/1748278239 wait complete. 2024-09-21T00:15:57.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.773+0000 7f2dfb200640 1 Processor -- start 2024-09-21T00:15:57.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.773+0000 7f2dfb200640 1 -- start start 2024-09-21T00:15:57.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.774+0000 7f2dfb200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2df40b2e60 0x7f2df4141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.774+0000 7f2dfb200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df40ceaf0 0x7f2df4073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.774+0000 7f2dfb200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df4145cc0 0x7f2df41f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.774+0000 7f2dfb200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2df406fdd0 con 0x7f2df40b2e60 2024-09-21T00:15:57.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.774+0000 7f2dfb200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2df406fc50 con 0x7f2df4145cc0 2024-09-21T00:15:57.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.774+0000 7f2dfb200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2df406ff50 con 0x7f2df40ceaf0 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.774+0000 7f2df9e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2df40b2e60 0x7f2df4141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2df9e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2df40b2e60 0x7f2df4141c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51368/0 (socket says 172.21.15.83:51368) 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2df9e00640 1 -- 172.21.15.83:0/1620280203 learned_addr learned my addr 172.21.15.83:0/1620280203 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2df9400640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df40ceaf0 0x7f2df4073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2dfa800640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df4145cc0 0x7f2df41f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2df9e00640 1 -- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df40ceaf0 msgr2=0x7f2df4073580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2df9e00640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df40ceaf0 0x7f2df4073580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2df9e00640 1 -- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df4145cc0 msgr2=0x7f2df41f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2df9e00640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df4145cc0 0x7f2df41f8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2df9e00640 1 -- 172.21.15.83:0/1620280203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df4074000 con 0x7f2df40b2e60 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2dfa800640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df4145cc0 0x7f2df41f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:57.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.775+0000 7f2df9e00640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2df40b2e60 0x7f2df4141c60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2de8005fd0 tx=0x7f2de80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:57.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.776+0000 7f2dee000640 1 -- 172.21.15.83:0/1620280203 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de803e030 con 0x7f2df40b2e60 2024-09-21T00:15:57.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.776+0000 7f2dee000640 1 -- 172.21.15.83:0/1620280203 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2de80047a0 con 0x7f2df40b2e60 2024-09-21T00:15:57.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.776+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df40742e0 con 0x7f2df40b2e60 2024-09-21T00:15:57.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.776+0000 7f2dee000640 1 -- 172.21.15.83:0/1620280203 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8035040 con 0x7f2df40b2e60 2024-09-21T00:15:57.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.776+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df40748a0 con 0x7f2df40b2e60 2024-09-21T00:15:57.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.777+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2df4070470 con 0x7f2df40b2e60 2024-09-21T00:15:57.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.778+0000 7f2dee000640 1 -- 172.21.15.83:0/1620280203 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2de8041030 con 0x7f2df40b2e60 2024-09-21T00:15:57.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.779+0000 7f2dee000640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2dd8078bc0 0x7f2dd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.779+0000 7f2dee000640 1 -- 172.21.15.83:0/1620280203 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f2de80bb890 con 0x7f2df40b2e60 2024-09-21T00:15:57.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.779+0000 7f2dee000640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] conn(0x7f2dd807f150 0x7f2dd80815e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:57.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.779+0000 7f2dee000640 1 -- 172.21.15.83:0/1620280203 --> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2de802eec0 con 0x7f2dd807f150 2024-09-21T00:15:57.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.779+0000 7f2dee000640 1 -- 172.21.15.83:0/1620280203 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f2de80bbc80 con 0x7f2df40b2e60 2024-09-21T00:15:57.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.780+0000 7f2df9400640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2dd8078bc0 0x7f2dd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.780+0000 7f2dfa800640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] conn(0x7f2dd807f150 0x7f2dd80815e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:57.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.780+0000 7f2df9400640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2dd8078bc0 0x7f2dd807b0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2df4074d90 tx=0x7f2de400b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:57.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.781+0000 7f2dfa800640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] conn(0x7f2dd807f150 0x7f2dd80815e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:57.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.782+0000 7f2dee000640 1 -- 172.21.15.83:0/1620280203 <== osd.7 v2:172.21.15.142:6826/2409799611 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2de802eec0 con 0x7f2dd807f150 2024-09-21T00:15:57.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.794+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 --> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2df40b4b00 con 0x7f2dd807f150 2024-09-21T00:15:57.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.795+0000 7f2dee000640 1 -- 172.21.15.83:0/1620280203 <== osd.7 v2:172.21.15.142:6826/2409799611 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2df40b4b00 con 0x7f2dd807f150 2024-09-21T00:15:57.797 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T00:15:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T00:15:57.797 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T00:15:57.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] conn(0x7f2dd807f150 msgr2=0x7f2dd80815e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfb200640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:6826/2409799611,v1:172.21.15.142:6827/2409799611] conn(0x7f2dd807f150 0x7f2dd80815e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2dd8078bc0 msgr2=0x7f2dd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfb200640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2dd8078bc0 0x7f2dd807b0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2df4074d90 tx=0x7f2de400b2e0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2df40b2e60 msgr2=0x7f2df4141c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:57.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfb200640 1 --2- 172.21.15.83:0/1620280203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2df40b2e60 0x7f2df4141c60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2de8005fd0 tx=0x7f2de80039e0 comp rx=0 tx=0).stop 2024-09-21T00:15:57.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfa800640 1 -- 172.21.15.83:0/1620280203 reap_dead start 2024-09-21T00:15:57.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 shutdown_connections 2024-09-21T00:15:57.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 >> 172.21.15.83:0/1620280203 conn(0x7f2df40d0460 msgr2=0x7f2df413ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:57.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 shutdown_connections 2024-09-21T00:15:57.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:57.796+0000 7f2dfb200640 1 -- 172.21.15.83:0/1620280203 wait complete. 2024-09-21T00:15:57.818 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T00:15:58.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.037+0000 7f3ae4000640 1 -- 172.21.15.83:0/4228646355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ac4003a50 msgr2=0x7f3ac4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:58.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.037+0000 7f3ae4000640 1 --2- 172.21.15.83:0/4228646355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ac4003a50 0x7f3ac4003ec0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c4a0 tx=0x7f3ac4005830 comp rx=0 tx=0).stop 2024-09-21T00:15:58.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.038+0000 7f3ae4000640 1 -- 172.21.15.83:0/4228646355 shutdown_connections 2024-09-21T00:15:58.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.038+0000 7f3ae4000640 1 --2- 172.21.15.83:0/4228646355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ac4003a50 0x7f3ac4003ec0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.038+0000 7f3ae4000640 1 -- 172.21.15.83:0/4228646355 >> 172.21.15.83:0/4228646355 conn(0x7f3adc0b1b90 msgr2=0x7f3adc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:58.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.038+0000 7f3ae4000640 1 -- 172.21.15.83:0/4228646355 shutdown_connections 2024-09-21T00:15:58.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.038+0000 7f3ae4000640 1 -- 172.21.15.83:0/4228646355 wait complete. 2024-09-21T00:15:58.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.040+0000 7f3ae4000640 1 Processor -- start 2024-09-21T00:15:58.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.040+0000 7f3ae4000640 1 -- start start 2024-09-21T00:15:58.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.041+0000 7f3ae4000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ac4003a50 0x7f3adc1f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:58.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.041+0000 7f3ae4000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0b5600 0x7f3adc1f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:58.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.041+0000 7f3ae4000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3adc0c5ff0 0x7f3adc0b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae4000640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc06e380 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae4000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc06e200 con 0x7f3ac4003a50 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae4000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3adc06e500 con 0x7f3adc0b5600 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3adc0c5ff0 0x7f3adc0b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3adc0c5ff0 0x7f3adc0b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51378/0 (socket says 172.21.15.83:51378) 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae2000640 1 -- 172.21.15.83:0/3213079141 learned_addr learned my addr 172.21.15.83:0/3213079141 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae0c00640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0b5600 0x7f3adc1f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae1600640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ac4003a50 0x7f3adc1f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae2000640 1 -- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0b5600 msgr2=0x7f3adc1f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae2000640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0b5600 0x7f3adc1f73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae2000640 1 -- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ac4003a50 msgr2=0x7f3adc1f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae2000640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ac4003a50 0x7f3adc1f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae2000640 1 -- 172.21.15.83:0/3213079141 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3adc0b5ba0 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.042+0000 7f3ae0c00640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0b5600 0x7f3adc1f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:15:58.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.043+0000 7f3ae2000640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3adc0c5ff0 0x7f3adc0b46c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3adc06f350 tx=0x7f3ad40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:58.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.043+0000 7f3ad9600640 1 -- 172.21.15.83:0/3213079141 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4011870 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.043+0000 7f3ad9600640 1 -- 172.21.15.83:0/3213079141 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ad4017070 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.043+0000 7f3ad9600640 1 -- 172.21.15.83:0/3213079141 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4011de0 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.043+0000 7f3ae4000640 1 -- 172.21.15.83:0/3213079141 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3adc0b3be0 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.043+0000 7f3ae4000640 1 -- 172.21.15.83:0/3213079141 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3adc0b41a0 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.044+0000 7f3ae4000640 1 -- 172.21.15.83:0/3213079141 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3adc0b3a00 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.045+0000 7f3ad9600640 1 -- 172.21.15.83:0/3213079141 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ad401c460 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.046+0000 7f3ad9600640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3abc078b90 0x7f3abc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:58.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.046+0000 7f3ad9600640 1 -- 172.21.15.83:0/3213079141 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f3ad409b3d0 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.047+0000 7f3ae1600640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3abc078b90 0x7f3abc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:58.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.047+0000 7f3ae1600640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3abc078b90 0x7f3abc07b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0033000 tx=0x7f3ad002d070 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:58.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.051+0000 7f3ad9600640 1 -- 172.21.15.83:0/3213079141 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3adc0b3a00 con 0x7f3adc0c5ff0 2024-09-21T00:15:58.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.235+0000 7f3ae4000640 1 -- 172.21.15.83:0/3213079141 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f3adc06f3d0 con 0x7f3abc078b90 2024-09-21T00:15:58.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.236+0000 7f3ad9600640 1 -- 172.21.15.83:0/3213079141 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3adc06f3d0 con 0x7f3abc078b90 2024-09-21T00:15:58.237 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T00:15:58.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 -- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3abc078b90 msgr2=0x7f3abc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:58.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3abc078b90 0x7f3abc07b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0033000 tx=0x7f3ad002d070 comp rx=0 tx=0).stop 2024-09-21T00:15:58.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 -- 172.21.15.83:0/3213079141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3adc0c5ff0 msgr2=0x7f3adc0b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:58.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3adc0c5ff0 0x7f3adc0b46c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3adc06f350 tx=0x7f3ad40019b0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 -- 172.21.15.83:0/3213079141 shutdown_connections 2024-09-21T00:15:58.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f3abc078b90 0x7f3abc07b0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3adc0c5ff0 0x7f3adc0b46c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0b5600 0x7f3adc1f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 --2- 172.21.15.83:0/3213079141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ac4003a50 0x7f3adc1f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 -- 172.21.15.83:0/3213079141 >> 172.21.15.83:0/3213079141 conn(0x7f3adc0b1b90 msgr2=0x7f3adc072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:58.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 -- 172.21.15.83:0/3213079141 shutdown_connections 2024-09-21T00:15:58.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.238+0000 7f3ae4000640 1 -- 172.21.15.83:0/3213079141 wait complete. 2024-09-21T00:15:58.260 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:15:58.435 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:15:58.440 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:15:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.480+0000 7f44fcc00640 1 -- 172.21.15.83:0/1952082994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f8162280 msgr2=0x7f44f8162690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.480+0000 7f44fcc00640 1 --2- 172.21.15.83:0/1952082994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f8162280 0x7f44f8162690 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f44e4005fd0 tx=0x7f44e402a5d0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.481+0000 7f44fcc00640 1 -- 172.21.15.83:0/1952082994 shutdown_connections 2024-09-21T00:15:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.481+0000 7f44fcc00640 1 --2- 172.21.15.83:0/1952082994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44f80b2e40 0x7f44f80b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.481+0000 7f44fcc00640 1 --2- 172.21.15.83:0/1952082994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f8162280 0x7f44f8162690 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.481+0000 7f44fcc00640 1 -- 172.21.15.83:0/1952082994 >> 172.21.15.83:0/1952082994 conn(0x7f44f80b6b20 msgr2=0x7f44f80d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.481+0000 7f44fcc00640 1 -- 172.21.15.83:0/1952082994 shutdown_connections 2024-09-21T00:15:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.481+0000 7f44fcc00640 1 -- 172.21.15.83:0/1952082994 wait complete. 2024-09-21T00:15:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.483+0000 7f44fcc00640 1 Processor -- start 2024-09-21T00:15:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.483+0000 7f44fcc00640 1 -- start start 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44fcc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44f80b2e40 0x7f44f80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44fcc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44f8162280 0x7f44f81f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44fcc00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81f8a20 0x7f44f81f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44fcc00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f44f815e4b0 con 0x7f44f81f8a20 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44fcc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f44f80b39d0 con 0x7f44f8162280 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44fcc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f44f815e630 con 0x7f44f80b2e40 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44f6800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81f8a20 0x7f44f81f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44f6800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81f8a20 0x7f44f81f8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51394/0 (socket says 172.21.15.83:51394) 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44f6800640 1 -- 172.21.15.83:0/1739345645 learned_addr learned my addr 172.21.15.83:0/1739345645 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44f5e00640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44f80b2e40 0x7f44f80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.485+0000 7f44f5400640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44f8162280 0x7f44f81f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:58.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.486+0000 7f44f6800640 1 -- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44f80b2e40 msgr2=0x7f44f80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:58.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.486+0000 7f44f6800640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44f80b2e40 0x7f44f80ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.486+0000 7f44f6800640 1 -- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44f8162280 msgr2=0x7f44f81f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:58.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.486+0000 7f44f6800640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44f8162280 0x7f44f81f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.486+0000 7f44f6800640 1 -- 172.21.15.83:0/1739345645 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f80aadc0 con 0x7f44f81f8a20 2024-09-21T00:15:58.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.486+0000 7f44f6800640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81f8a20 0x7f44f81f8e30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f44f000ea40 tx=0x7f44f000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:58.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.486+0000 7f44ee000640 1 -- 172.21.15.83:0/1739345645 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f000ce40 con 0x7f44f81f8a20 2024-09-21T00:15:58.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.486+0000 7f44ee000640 1 -- 172.21.15.83:0/1739345645 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44f0004c10 con 0x7f44f81f8a20 2024-09-21T00:15:58.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.486+0000 7f44ee000640 1 -- 172.21.15.83:0/1739345645 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0005020 con 0x7f44f81f8a20 2024-09-21T00:15:58.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.486+0000 7f44fcc00640 1 -- 172.21.15.83:0/1739345645 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f80cee80 con 0x7f44f81f8a20 2024-09-21T00:15:58.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.487+0000 7f44fcc00640 1 -- 172.21.15.83:0/1739345645 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f814df40 con 0x7f44f81f8a20 2024-09-21T00:15:58.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.488+0000 7f44fcc00640 1 -- 172.21.15.83:0/1739345645 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f80aaf90 con 0x7f44f81f8a20 2024-09-21T00:15:58.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.489+0000 7f44ee000640 1 -- 172.21.15.83:0/1739345645 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44f00051c0 con 0x7f44f81f8a20 2024-09-21T00:15:58.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.490+0000 7f44ee000640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f44d8078bc0 0x7f44d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:15:58.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.490+0000 7f44ee000640 1 -- 172.21.15.83:0/1739345645 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f44f009b950 con 0x7f44f81f8a20 2024-09-21T00:15:58.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.490+0000 7f44f5e00640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f44d8078bc0 0x7f44d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:15:58.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.491+0000 7f44f5e00640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f44d8078bc0 0x7f44d807b0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f44e8001720 tx=0x7f44e8009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:15:58.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.496+0000 7f44ee000640 1 -- 172.21.15.83:0/1739345645 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f44f00637d0 con 0x7f44f81f8a20 2024-09-21T00:15:58.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.684+0000 7f44fcc00640 1 -- 172.21.15.83:0/1739345645 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44f8162f00 con 0x7f44d8078bc0 2024-09-21T00:15:58.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.685+0000 7f44ee000640 1 -- 172.21.15.83:0/1739345645 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13340 (secure 0 0 0) 0x7f44f8162f00 con 0x7f44d8078bc0 2024-09-21T00:15:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:15:58.687 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:15:58.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.687+0000 7f44fcc00640 1 -- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f44d8078bc0 msgr2=0x7f44d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:58.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.687+0000 7f44fcc00640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f44d8078bc0 0x7f44d807b0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f44e8001720 tx=0x7f44e8009040 comp rx=0 tx=0).stop 2024-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.687+0000 7f44fcc00640 1 -- 172.21.15.83:0/1739345645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81f8a20 msgr2=0x7f44f81f8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.687+0000 7f44fcc00640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81f8a20 0x7f44f81f8e30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f44f000ea40 tx=0x7f44f000ef00 comp rx=0 tx=0).stop 2024-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.688+0000 7f44fcc00640 1 -- 172.21.15.83:0/1739345645 shutdown_connections 2024-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.688+0000 7f44fcc00640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f44d8078bc0 0x7f44d807b0d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.688+0000 7f44fcc00640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81f8a20 0x7f44f81f8e30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.688+0000 7f44fcc00640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44f8162280 0x7f44f81f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.688+0000 7f44fcc00640 1 --2- 172.21.15.83:0/1739345645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44f80b2e40 0x7f44f80ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.688+0000 7f44fcc00640 1 -- 172.21.15.83:0/1739345645 >> 172.21.15.83:0/1739345645 conn(0x7f44f80b6b20 msgr2=0x7f44f815daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:15:58.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.688+0000 7f44fcc00640 1 -- 172.21.15.83:0/1739345645 shutdown_connections 2024-09-21T00:15:58.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:15:58.688+0000 7f44fcc00640 1 -- 172.21.15.83:0/1739345645 wait complete. 2024-09-21T00:15:58.712 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-21T00:15:56.877667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221584,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753136,"statfs":{"total":773094113280,"available":772867211264,"internally_reserved":0,"allocated":5480448,"data_stored":3038320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.171122"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":154,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-21T00:15:46.707784+0000","last_change":"2024-09-21T00:14:01.146544+0000","last_active":"2024-09-21T00:15:46.707784+0000","last_peered":"2024-09-21T00:15:46.707784+0000","last_clean":"2024-09-21T00:15:46.707784+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:15:46.707784+0000","last_undegraded":"2024-09-21T00:15:46.707784+0000","last_fullsized":"2024-09-21T00:15:46.707784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:13:59.843124+0000","last_clean_scrub_stamp":"2024-09-21T00:13:59.843124+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:07.478481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1130496,"data_stored":822566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1130496,"data_stored":822566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:15:58.715 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T00:13:59.843124+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=0, tm_min=13, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=0, tm_min=15, tm_sec=51, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T00:15:58.716 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T00:16:18.716 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:16:18.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.948+0000 7fc683e00640 1 -- 172.21.15.83:0/350203433 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6840ceff0 msgr2=0x7fc68415e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:18.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.948+0000 7fc683e00640 1 --2- 172.21.15.83:0/350203433 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6840ceff0 0x7fc68415e5e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc6840d0670 tx=0x7fc67402a440 comp rx=0 tx=0).stop 2024-09-21T00:16:18.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.948+0000 7fc683e00640 1 -- 172.21.15.83:0/350203433 shutdown_connections 2024-09-21T00:16:18.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.948+0000 7fc683e00640 1 --2- 172.21.15.83:0/350203433 >> v2:172.21.15.142:3300/0 conn(0x7fc6840cfbc0 0x7fc6840b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:18.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.948+0000 7fc683e00640 1 --2- 172.21.15.83:0/350203433 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6840ceff0 0x7fc68415e5e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:18.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.948+0000 7fc683e00640 1 -- 172.21.15.83:0/350203433 >> 172.21.15.83:0/350203433 conn(0x7fc6840d4360 msgr2=0x7fc6840d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:16:18.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.948+0000 7fc683e00640 1 -- 172.21.15.83:0/350203433 shutdown_connections 2024-09-21T00:16:18.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.948+0000 7fc683e00640 1 -- 172.21.15.83:0/350203433 wait complete. 2024-09-21T00:16:18.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.950+0000 7fc683e00640 1 Processor -- start 2024-09-21T00:16:18.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.950+0000 7fc683e00640 1 -- start start 2024-09-21T00:16:18.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.951+0000 7fc683e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6840ceff0 0x7fc68415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:18.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.951+0000 7fc683e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6840d2520 0x7fc684145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:18.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.951+0000 7fc683e00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6841536e0 0x7fc684145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:18.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.951+0000 7fc683e00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc6840b8db0 con 0x7fc6841536e0 2024-09-21T00:16:18.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.951+0000 7fc683e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc6840b8c30 con 0x7fc6840ceff0 2024-09-21T00:16:18.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.951+0000 7fc683e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc6840b8f30 con 0x7fc6840d2520 2024-09-21T00:16:18.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc683400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6841536e0 0x7fc684145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:18.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc683400640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6841536e0 0x7fc684145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51894/0 (socket says 172.21.15.83:51894) 2024-09-21T00:16:18.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc683400640 1 -- 172.21.15.83:0/2250015528 learned_addr learned my addr 172.21.15.83:0/2250015528 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:16:18.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc682a00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6840ceff0 0x7fc68415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:18.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc67a000640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6840d2520 0x7fc684145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:18.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc683400640 1 -- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6840d2520 msgr2=0x7fc684145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:18.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc683400640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6840d2520 0x7fc684145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:18.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc683400640 1 -- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6840ceff0 msgr2=0x7fc68415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:18.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc683400640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6840ceff0 0x7fc68415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:18.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc683400640 1 -- 172.21.15.83:0/2250015528 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc684144870 con 0x7fc6841536e0 2024-09-21T00:16:18.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.952+0000 7fc682a00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6840ceff0 0x7fc68415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:16:18.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.953+0000 7fc683400640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6841536e0 0x7fc684145e50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00ba10 tx=0x7fc67c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:16:18.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.953+0000 7fc67be00640 1 -- 172.21.15.83:0/2250015528 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c019070 con 0x7fc6841536e0 2024-09-21T00:16:18.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.953+0000 7fc67be00640 1 -- 172.21.15.83:0/2250015528 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc67c00cc50 con 0x7fc6841536e0 2024-09-21T00:16:18.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.953+0000 7fc683e00640 1 -- 172.21.15.83:0/2250015528 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc684144b50 con 0x7fc6841536e0 2024-09-21T00:16:18.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.953+0000 7fc67be00640 1 -- 172.21.15.83:0/2250015528 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0146a0 con 0x7fc6841536e0 2024-09-21T00:16:18.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.953+0000 7fc683e00640 1 -- 172.21.15.83:0/2250015528 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc684145110 con 0x7fc6841536e0 2024-09-21T00:16:18.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.954+0000 7fc683e00640 1 -- 172.21.15.83:0/2250015528 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6840b9540 con 0x7fc6841536e0 2024-09-21T00:16:18.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.955+0000 7fc67be00640 1 -- 172.21.15.83:0/2250015528 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc67c01c070 con 0x7fc6841536e0 2024-09-21T00:16:18.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.956+0000 7fc67be00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc660078b90 0x7fc66007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:18.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.956+0000 7fc67be00640 1 -- 172.21.15.83:0/2250015528 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7fc67c09a9f0 con 0x7fc6841536e0 2024-09-21T00:16:18.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.957+0000 7fc682a00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc660078b90 0x7fc66007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:18.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.958+0000 7fc682a00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc660078b90 0x7fc66007b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc674033000 tx=0x7fc674004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:16:18.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:18.961+0000 7fc67be00640 1 -- 172.21.15.83:0/2250015528 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc67c062860 con 0x7fc6841536e0 2024-09-21T00:16:19.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.145+0000 7fc683e00640 1 -- 172.21.15.83:0/2250015528 --> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc68415a920 con 0x7fc660078b90 2024-09-21T00:16:19.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.146+0000 7fc67be00640 1 -- 172.21.15.83:0/2250015528 <== mgr.4117 v2:172.21.15.142:6800/3113341479 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13344 (secure 0 0 0) 0x7fc68415a920 con 0x7fc660078b90 2024-09-21T00:16:19.147 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:16:19.147 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T00:16:19.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 -- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc660078b90 msgr2=0x7fc66007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:19.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc660078b90 0x7fc66007b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc674033000 tx=0x7fc674004730 comp rx=0 tx=0).stop 2024-09-21T00:16:19.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 -- 172.21.15.83:0/2250015528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6841536e0 msgr2=0x7fc684145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:19.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6841536e0 0x7fc684145e50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00ba10 tx=0x7fc67c00bed0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 -- 172.21.15.83:0/2250015528 shutdown_connections 2024-09-21T00:16:19.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7fc660078b90 0x7fc66007b0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6841536e0 0x7fc684145e50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6840d2520 0x7fc684145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 --2- 172.21.15.83:0/2250015528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6840ceff0 0x7fc68415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 -- 172.21.15.83:0/2250015528 >> 172.21.15.83:0/2250015528 conn(0x7fc6840d4360 msgr2=0x7fc6840cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:16:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 -- 172.21.15.83:0/2250015528 shutdown_connections 2024-09-21T00:16:19.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.149+0000 7fc683e00640 1 -- 172.21.15.83:0/2250015528 wait complete. 2024-09-21T00:16:19.172 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-09-21T00:16:18.882705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221576,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753144,"statfs":{"total":773094113280,"available":772867219456,"internally_reserved":0,"allocated":5480448,"data_stored":3038320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002830"},"pg_stats":[{"pgid":"1.0","version":"46'74","reported_seq":165,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-21T00:15:54.178584+0000","last_change":"2024-09-21T00:15:54.178533+0000","last_active":"2024-09-21T00:15:54.178584+0000","last_peered":"2024-09-21T00:15:54.178584+0000","last_clean":"2024-09-21T00:15:54.178584+0000","last_became_active":"2024-09-21T00:14:01.145484+0000","last_became_peered":"2024-09-21T00:14:01.145484+0000","last_unstale":"2024-09-21T00:15:54.178584+0000","last_undegraded":"2024-09-21T00:15:54.178584+0000","last_fullsized":"2024-09-21T00:15:54.178584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'74","last_scrub_stamp":"2024-09-21T00:15:54.178455+0000","last_deep_scrub":"46'74","last_deep_scrub_stamp":"2024-09-21T00:15:54.178455+0000","last_clean_scrub_stamp":"2024-09-21T00:15:54.178455+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.550421+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1130496,"data_stored":822566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":232198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1130496,"data_stored":822566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:16:19.173 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T00:16:19.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.395+0000 7f2773200640 1 -- 172.21.15.83:0/2281753048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2758003a00 msgr2=0x7f2758003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:19.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.395+0000 7f2773200640 1 --2- 172.21.15.83:0/2281753048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2758003a00 0x7f2758003e70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f276400c2e0 tx=0x7f2758005830 comp rx=0 tx=0).stop 2024-09-21T00:16:19.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.395+0000 7f2772800640 1 -- 172.21.15.83:0/2281753048 reap_dead start 2024-09-21T00:16:19.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.395+0000 7f2773200640 1 -- 172.21.15.83:0/2281753048 shutdown_connections 2024-09-21T00:16:19.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.395+0000 7f2773200640 1 -- 172.21.15.83:0/2281753048 >> 172.21.15.83:0/2281753048 conn(0x7f277406f920 msgr2=0x7f27740b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:16:19.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.395+0000 7f2773200640 1 -- 172.21.15.83:0/2281753048 shutdown_connections 2024-09-21T00:16:19.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.395+0000 7f2773200640 1 -- 172.21.15.83:0/2281753048 wait complete. 2024-09-21T00:16:19.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.398+0000 7f2773200640 1 Processor -- start 2024-09-21T00:16:19.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.398+0000 7f2773200640 1 -- start start 2024-09-21T00:16:19.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.399+0000 7f2773200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2758003a00 0x7f27741ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:19.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.399+0000 7f2773200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27741f88e0 0x7f27741f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:19.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.399+0000 7f2773200640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27740b08a0 0x7f27740b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:19.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.399+0000 7f2773200640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f277406dc50 con 0x7f27740b08a0 2024-09-21T00:16:19.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.399+0000 7f2773200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f277406dad0 con 0x7f2758003a00 2024-09-21T00:16:19.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.399+0000 7f2773200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f277406ddd0 con 0x7f27741f88e0 2024-09-21T00:16:19.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.400+0000 7f2772800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27740b08a0 0x7f27740b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:19.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.400+0000 7f2772800640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27740b08a0 0x7f27740b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51912/0 (socket says 172.21.15.83:51912) 2024-09-21T00:16:19.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.400+0000 7f2772800640 1 -- 172.21.15.83:0/1485802230 learned_addr learned my addr 172.21.15.83:0/1485802230 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:16:19.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.400+0000 7f2771e00640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2758003a00 0x7f27741ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:19.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.400+0000 7f276be00640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27741f88e0 0x7f27741f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:19.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.400+0000 7f2772800640 1 -- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27741f88e0 msgr2=0x7f27741f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:19.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.400+0000 7f2772800640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27741f88e0 0x7f27741f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.400+0000 7f2772800640 1 -- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2758003a00 msgr2=0x7f27741ef1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:19.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.400+0000 7f2772800640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2758003a00 0x7f27741ef1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.400+0000 7f2772800640 1 -- 172.21.15.83:0/1485802230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27740b11f0 con 0x7f27740b08a0 2024-09-21T00:16:19.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.401+0000 7f2772800640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27740b08a0 0x7f27740b0cb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f27740b3a00 tx=0x7f276c00e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:16:19.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.401+0000 7f276a000640 1 -- 172.21.15.83:0/1485802230 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c003970 con 0x7f27740b08a0 2024-09-21T00:16:19.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.401+0000 7f276a000640 1 -- 172.21.15.83:0/1485802230 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f276c015070 con 0x7f27740b08a0 2024-09-21T00:16:19.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.401+0000 7f276a000640 1 -- 172.21.15.83:0/1485802230 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c004030 con 0x7f27740b08a0 2024-09-21T00:16:19.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.401+0000 7f2773200640 1 -- 172.21.15.83:0/1485802230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27741ef700 con 0x7f27740b08a0 2024-09-21T00:16:19.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.401+0000 7f2773200640 1 -- 172.21.15.83:0/1485802230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2774131600 con 0x7f27740b08a0 2024-09-21T00:16:19.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.402+0000 7f2763400640 1 -- 172.21.15.83:0/1485802230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27741f93c0 con 0x7f27740b08a0 2024-09-21T00:16:19.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.404+0000 7f276a000640 1 -- 172.21.15.83:0/1485802230 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f276c0041d0 con 0x7f27740b08a0 2024-09-21T00:16:19.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.405+0000 7f276a000640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2750078bc0 0x7f275007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:19.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.405+0000 7f276a000640 1 -- 172.21.15.83:0/1485802230 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f276c09b7a0 con 0x7f27740b08a0 2024-09-21T00:16:19.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.405+0000 7f2771e00640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2750078bc0 0x7f275007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:19.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.406+0000 7f2771e00640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2750078bc0 0x7f275007b0d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2764033000 tx=0x7f2764038040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:16:19.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.409+0000 7f276a000640 1 -- 172.21.15.83:0/1485802230 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f27740b11f0 con 0x7f27740b08a0 2024-09-21T00:16:19.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.603+0000 7f2763400640 1 -- 172.21.15.83:0/1485802230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f27740ccce0 con 0x7f27740b08a0 2024-09-21T00:16:19.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.608+0000 7f276a000640 1 -- 172.21.15.83:0/1485802230 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v34)=0 v34) ==== 123+0+0 (secure 0 0 0) 0x7f276c063610 con 0x7f27740b08a0 2024-09-21T00:16:19.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.609+0000 7f276a000640 1 -- 172.21.15.83:0/1485802230 <== mon.0 v2:172.21.15.83:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f276c003e80 con 0x7f27740b08a0 2024-09-21T00:16:19.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 -- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2750078bc0 msgr2=0x7f275007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:19.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2750078bc0 0x7f275007b0d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2764033000 tx=0x7f2764038040 comp rx=0 tx=0).stop 2024-09-21T00:16:19.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 -- 172.21.15.83:0/1485802230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27740b08a0 msgr2=0x7f27740b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:19.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27740b08a0 0x7f27740b0cb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f27740b3a00 tx=0x7f276c00e350 comp rx=0 tx=0).stop 2024-09-21T00:16:19.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 -- 172.21.15.83:0/1485802230 shutdown_connections 2024-09-21T00:16:19.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f2750078bc0 0x7f275007b0d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27740b08a0 0x7f27740b0cb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27741f88e0 0x7f27741f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 --2- 172.21.15.83:0/1485802230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2758003a00 0x7f27741ef1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 -- 172.21.15.83:0/1485802230 >> 172.21.15.83:0/1485802230 conn(0x7f277406f920 msgr2=0x7f27741404c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:16:19.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 -- 172.21.15.83:0/1485802230 shutdown_connections 2024-09-21T00:16:19.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.611+0000 7f2763400640 1 -- 172.21.15.83:0/1485802230 wait complete. 2024-09-21T00:16:19.638 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T00:16:19.638 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T00:16:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.866+0000 7f22ebe00640 1 -- 172.21.15.83:0/787741622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec0ccfe0 msgr2=0x7f22ec06e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.866+0000 7f22ebe00640 1 --2- 172.21.15.83:0/787741622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec0ccfe0 0x7f22ec06e570 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0b2c60 tx=0x7f22e402a970 comp rx=0 tx=0).stop 2024-09-21T00:16:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.866+0000 7f22ebe00640 1 -- 172.21.15.83:0/787741622 shutdown_connections 2024-09-21T00:16:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.866+0000 7f22ebe00640 1 --2- 172.21.15.83:0/787741622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec0ccfe0 0x7f22ec06e570 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.866+0000 7f22ebe00640 1 --2- 172.21.15.83:0/787741622 >> v2:172.21.15.142:3300/0 conn(0x7f22ec15dfe0 0x7f22ec160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.866+0000 7f22ebe00640 1 -- 172.21.15.83:0/787741622 >> 172.21.15.83:0/787741622 conn(0x7f22ec06f940 msgr2=0x7f22ec0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:16:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.867+0000 7f22ebe00640 1 -- 172.21.15.83:0/787741622 shutdown_connections 2024-09-21T00:16:19.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.867+0000 7f22ebe00640 1 -- 172.21.15.83:0/787741622 wait complete. 2024-09-21T00:16:19.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.869+0000 7f22ebe00640 1 Processor -- start 2024-09-21T00:16:19.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.869+0000 7f22ebe00640 1 -- start start 2024-09-21T00:16:19.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.870+0000 7f22ebe00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec06e160 0x7f22ec1e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:19.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.870+0000 7f22ebe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec15dfe0 0x7f22ec144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:19.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22ebe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec15b8b0 0x7f22ec1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22ebe00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec0b4c20 con 0x7f22ec06e160 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22ebe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec0b4aa0 con 0x7f22ec15dfe0 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22ebe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f22ec0b4da0 con 0x7f22ec15b8b0 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22eaa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec06e160 0x7f22ec1e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22eaa00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec06e160 0x7f22ec1e6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51930/0 (socket says 172.21.15.83:51930) 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22eaa00640 1 -- 172.21.15.83:0/3697214944 learned_addr learned my addr 172.21.15.83:0/3697214944 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22eb400640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec15b8b0 0x7f22ec1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22e3e00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec15dfe0 0x7f22ec144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22eaa00640 1 -- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec15b8b0 msgr2=0x7f22ec1570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22eaa00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec15b8b0 0x7f22ec1570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22eaa00640 1 -- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec15dfe0 msgr2=0x7f22ec144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22eaa00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec15dfe0 0x7f22ec144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:19.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22eaa00640 1 -- 172.21.15.83:0/3697214944 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec1e73f0 con 0x7f22ec06e160 2024-09-21T00:16:19.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.871+0000 7f22e3e00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec15dfe0 0x7f22ec144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:16:19.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.872+0000 7f22eaa00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec06e160 0x7f22ec1e6eb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00d740 tx=0x7f22dc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:16:19.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.872+0000 7f22e3400640 1 -- 172.21.15.83:0/3697214944 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc017070 con 0x7f22ec06e160 2024-09-21T00:16:19.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.872+0000 7f22e3400640 1 -- 172.21.15.83:0/3697214944 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f22dc009d40 con 0x7f22ec06e160 2024-09-21T00:16:19.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.872+0000 7f22e3400640 1 -- 172.21.15.83:0/3697214944 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc0106c0 con 0x7f22ec06e160 2024-09-21T00:16:19.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.872+0000 7f22ebe00640 1 -- 172.21.15.83:0/3697214944 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec157db0 con 0x7f22ec06e160 2024-09-21T00:16:19.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.872+0000 7f22ebe00640 1 -- 172.21.15.83:0/3697214944 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec15add0 con 0x7f22ec06e160 2024-09-21T00:16:19.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.873+0000 7f22ebe00640 1 -- 172.21.15.83:0/3697214944 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ec06e570 con 0x7f22ec06e160 2024-09-21T00:16:19.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.874+0000 7f22e3400640 1 -- 172.21.15.83:0/3697214944 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f22dc01a070 con 0x7f22ec06e160 2024-09-21T00:16:19.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.875+0000 7f22e3400640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f22c8078b90 0x7f22c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:16:19.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.875+0000 7f22e3400640 1 -- 172.21.15.83:0/3697214944 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5421+0+0 (secure 0 0 0) 0x7f22dc09aeb0 con 0x7f22ec06e160 2024-09-21T00:16:19.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.876+0000 7f22e3e00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f22c8078b90 0x7f22c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:16:19.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.876+0000 7f22e3e00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f22c8078b90 0x7f22c807b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f22ec1e8b10 tx=0x7f22d4008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:16:19.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:19.880+0000 7f22e3400640 1 -- 172.21.15.83:0/3697214944 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f22dc063370 con 0x7f22ec06e160 2024-09-21T00:16:20.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.106+0000 7f22ebe00640 1 -- 172.21.15.83:0/3697214944 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22ec15f130 con 0x7f22ec06e160 2024-09-21T00:16:20.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.106+0000 7f22e3400640 1 -- 172.21.15.83:0/3697214944 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+3908 (secure 0 0 0) 0x7f22dc062c70 con 0x7f22ec06e160 2024-09-21T00:16:20.108 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T00:16:20.108 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":28,"btime":"2024-09-21T00:15:44:325099+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2168701718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2168701718},{"type":"v1","addr":"172.21.15.142:6836","nonce":2168701718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/399437337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":399437337},{"type":"v1","addr":"172.21.15.83:6835","nonce":399437337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4915,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/683491362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":683491362},{"type":"v1","addr":"172.21.15.83:6834","nonce":683491362}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/158705711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":158705711},{"type":"v1","addr":"172.21.15.142:6837","nonce":158705711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[]} 2024-09-21T00:16:20.108 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 28 2024-09-21T00:16:20.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 -- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f22c8078b90 msgr2=0x7f22c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:20.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f22c8078b90 0x7f22c807b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f22ec1e8b10 tx=0x7f22d4008040 comp rx=0 tx=0).stop 2024-09-21T00:16:20.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 -- 172.21.15.83:0/3697214944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec06e160 msgr2=0x7f22ec1e6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:16:20.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec06e160 0x7f22ec1e6eb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00d740 tx=0x7f22dc00dc00 comp rx=0 tx=0).stop 2024-09-21T00:16:20.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 -- 172.21.15.83:0/3697214944 shutdown_connections 2024-09-21T00:16:20.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:6800/3113341479,v1:172.21.15.142:6801/3113341479] conn(0x7f22c8078b90 0x7f22c807b0a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:20.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec15b8b0 0x7f22ec1570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:20.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec15dfe0 0x7f22ec144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:20.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 --2- 172.21.15.83:0/3697214944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec06e160 0x7f22ec1e6eb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:16:20.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 -- 172.21.15.83:0/3697214944 >> 172.21.15.83:0/3697214944 conn(0x7f22ec06f940 msgr2=0x7f22ec0d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:16:20.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 -- 172.21.15.83:0/3697214944 shutdown_connections 2024-09-21T00:16:20.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T00:16:20.109+0000 7f22ebe00640 1 -- 172.21.15.83:0/3697214944 wait complete. 2024-09-21T00:16:20.133 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-21T00:16:20.133 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T00:16:20.133 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T00:16:20.133 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.165 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T00:16:20.166 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T00:16:20.166 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.233 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T00:16:20.234 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T00:16:20.234 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.259 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T00:16:20.259 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T00:16:20.259 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.324 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T00:16:20.324 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T00:16:20.325 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T00:16:20.325 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.381 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T00:16:20.381 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T00:16:20.381 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.437 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T00:16:20.438 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T00:16:20.438 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.498 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T00:16:20.498 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T00:16:20.498 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.547 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T00:16:20.547 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T00:16:20.548 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.601 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T00:16:20.602 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T00:16:20.602 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.647 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T00:16:20.647 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T00:16:20.647 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.707 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T00:16:20.708 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T00:16:20.708 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.757 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T00:16:20.757 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T00:16:20.758 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T00:16:20.758 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.831 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T00:16:20.832 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T00:16:20.832 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.906 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T00:16:20.907 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T00:16:20.907 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T00:16:20.907 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.935 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T00:16:20.935 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T00:16:20.935 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:20.960 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T00:16:20.960 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T00:16:20.960 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T00:16:21.027 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T00:16:21.028 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T00:16:21.028 DEBUG:teuthology.orchestra.run.smithi083:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T00:16:21.105 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:16:21.106 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T00:16:21.305 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:16:21.306 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T00:16:21.415 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:16:21.416 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T00:16:21.525 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:16:21.525 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T00:16:21.632 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:16:21.632 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T00:16:21.878 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:16:21.879 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T00:16:21.978 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:16:21.978 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T00:16:22.078 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:16:22.078 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T00:16:22.205 INFO:tasks.ceph:Archiving mon data... 2024-09-21T00:16:22.205 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313/data/mon.a.tgz 2024-09-21T00:16:22.206 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-09-21T00:16:22.242 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.BLcZXyzFwe 2024-09-21T00:16:22.242 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BLcZXyzFwe 2024-09-21T00:16:22.430 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.BLcZXyzFwe 2024-09-21T00:16:22.524 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.BLcZXyzFwe is 330KB 2024-09-21T00:16:22.612 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.BLcZXyzFwe 2024-09-21T00:16:22.647 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313/data/mon.b.tgz 2024-09-21T00:16:22.647 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-09-21T00:16:22.682 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.2ZUDKyCaih 2024-09-21T00:16:22.682 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2ZUDKyCaih 2024-09-21T00:16:22.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.2ZUDKyCaih 2024-09-21T00:16:22.967 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.2ZUDKyCaih is 436KB 2024-09-21T00:16:23.056 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.2ZUDKyCaih 2024-09-21T00:16:23.090 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313/data/mon.c.tgz 2024-09-21T00:16:23.090 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-09-21T00:16:23.165 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.mRk8gPazJ8 2024-09-21T00:16:23.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.mRk8gPazJ8 2024-09-21T00:16:23.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.mRk8gPazJ8 2024-09-21T00:16:23.438 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.mRk8gPazJ8 is 436KB 2024-09-21T00:16:23.527 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.mRk8gPazJ8 2024-09-21T00:16:23.562 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T00:16:23.562 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T00:16:23.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T00:16:23.692 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T00:16:23.727 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T00:16:23.727 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T00:16:23.728 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313/remote/smithi083/crash 2024-09-21T00:16:23.729 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T00:16:23.804 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313/remote/smithi142/crash 2024-09-21T00:16:23.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T00:16:23.859 INFO:tasks.ceph:Shutting down logrotate 2024-09-21T00:16:23.859 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:16:23.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T00:16:23.949 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T00:16:24.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T00:16:24.058 INFO:tasks.ceph:Compressing logs... 2024-09-21T00:16:24.059 DEBUG:teuthology.orchestra.run.smithi083:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T00:16:24.062 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T00:16:24.112 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T00:16:24.113 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44466.log 2024-09-21T00:16:24.113 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35669.log 2024-09-21T00:16:24.114 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49842.log 2024-09-21T00:16:24.114 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44466.log.gz 2024-09-21T00:16:24.115 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35669.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.35669.log.gz /var/log/ceph/ceph-client.admin.46638.log 2024-09-21T00:16:24.115 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-21T00:16:24.116 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41772.log 2024-09-21T00:16:24.117 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47390.log 2024-09-21T00:16:24.117 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49842.log.gz 2024-09-21T00:16:24.117 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45002.log 2024-09-21T00:16:24.117 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46638.log.gz 2024-09-21T00:16:24.119 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36025.log 2024-09-21T00:16:24.119 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.3.41772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41772.log.gz 2024-09-21T00:16:24.120 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T00:16:24.120 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.36025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41377.log 2024-09-21T00:16:24.120 INFO:teuthology.orchestra.run.smithi142.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36025.log.gz 2024-09-21T00:16:24.120 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-21T00:16:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50495.log 2024-09-21T00:16:24.120 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47390.log.gz 2024-09-21T00:16:24.121 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45296.log 2024-09-21T00:16:24.121 INFO:teuthology.orchestra.run.smithi083.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45002.log.gz 2024-09-21T00:16:24.121 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47619.log 2024-09-21T00:16:24.121 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50495.log.gz 2024-09-21T00:16:24.121 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49402.log 2024-09-21T00:16:24.121 INFO:teuthology.orchestra.run.smithi083.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45296.log.gz 2024-09-21T00:16:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36117.log 2024-09-21T00:16:24.125 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47619.log.gz 2024-09-21T00:16:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36062.log 2024-09-21T00:16:24.125 INFO:teuthology.orchestra.run.smithi083.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49402.log.gz 2024-09-21T00:16:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51311.log 2024-09-21T00:16:24.125 INFO:teuthology.orchestra.run.smithi083.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36117.log.gz 2024-09-21T00:16:24.125 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51397.log 2024-09-21T00:16:24.125 INFO:teuthology.orchestra.run.smithi083.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36062.log.gz 2024-09-21T00:16:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51311.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51311.log.gz 2024-09-21T00:16:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51125.log 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.41377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41377.log.gz 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35985.log 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.4.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35905.log 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.35985.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.35985.log.gz 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.35905.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.35905.log.gz 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35785.log 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35945.log 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.35785.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35785.log.gz 2024-09-21T00:16:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T00:16:24.128 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T00:16:24.128 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.35945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41776.log 2024-09-21T00:16:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42172.log 2024-09-21T00:16:24.129 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51397.log.gz 2024-09-21T00:16:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43111.log 2024-09-21T00:16:24.130 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51125.log.gz 2024-09-21T00:16:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42607.log 2024-09-21T00:16:24.130 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42172.log.gz 2024-09-21T00:16:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44134.log 2024-09-21T00:16:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50663.log 2024-09-21T00:16:24.130 INFO:teuthology.orchestra.run.smithi083.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.43111.log.gz 2024-09-21T00:16:24.130 INFO:teuthology.orchestra.run.smithi083.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42607.log.gz 2024-09-21T00:16:24.133 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.c.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35945.log.gz 2024-09-21T00:16:24.133 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41358.log 2024-09-21T00:16:24.133 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.3.41776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41776.log.gz 2024-09-21T00:16:24.133 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-21T00:16:24.133 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.41358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41358.log.gz 2024-09-21T00:16:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-21T00:16:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T00:16:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35865.log 2024-09-21T00:16:24.134 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35926.log 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44134.log.gz 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49276.log 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50663.log.gz 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44806.log 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35926.log.gz 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49276.log.gz 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46722.log 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44806.log.gz 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43556.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2024-09-21T00:16:24.135 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T00:16:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43952.log 2024-09-21T00:16:24.137 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46722.log.gz 2024-09-21T00:16:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50831.log 2024-09-21T00:16:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43598.log 2024-09-21T00:16:24.138 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43952.log.gz 2024-09-21T00:16:24.138 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36145.log 2024-09-21T00:16:24.138 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.35865.log: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T00:16:24.138 INFO:teuthology.orchestra.run.smithi142.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35865.log.gz 2024-09-21T00:16:24.138 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.36145.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-21T00:16:24.138 INFO:teuthology.orchestra.run.smithi142.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36145.log.gz 2024-09-21T00:16:24.138 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T00:16:24.139 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T00:16:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50831.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50831.log.gz 2024-09-21T00:16:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48763.log 2024-09-21T00:16:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2024-09-21T00:16:24.140 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43598.log.gz 2024-09-21T00:16:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48763.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48763.log.gz 2024-09-21T00:16:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35964.log 2024-09-21T00:16:24.141 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51083.log 2024-09-21T00:16:24.141 INFO:teuthology.orchestra.run.smithi083.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2024-09-21T00:16:24.142 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35825.log 2024-09-21T00:16:24.142 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35964.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35964.log.gz 2024-09-21T00:16:24.142 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48553.log 2024-09-21T00:16:24.143 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51083.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.51083.log.gz 2024-09-21T00:16:24.143 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46428.log 2024-09-21T00:16:24.144 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36258.log 2024-09-21T00:16:24.144 INFO:teuthology.orchestra.run.smithi083.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48553.log.gz 2024-09-21T00:16:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46428.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46428.log.gz 2024-09-21T00:16:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42128.log 2024-09-21T00:16:24.146 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44121.log 2024-09-21T00:16:24.146 INFO:teuthology.orchestra.run.smithi083.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.36258.log.gz 2024-09-21T00:16:24.148 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42128.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42128.log.gz 2024-09-21T00:16:24.148 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44734.log 2024-09-21T00:16:24.149 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43724.log 2024-09-21T00:16:24.149 INFO:teuthology.orchestra.run.smithi083.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44121.log.gz 2024-09-21T00:16:24.149 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44734.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.49968.log -- replaced with /var/log/ceph/ceph-client.admin.44734.log.gz 2024-09-21T00:16:24.149 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-21T00:16:24.150 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.35825.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.35825.log.gz 2024-09-21T00:16:24.150 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42523.log 2024-09-21T00:16:24.150 INFO:teuthology.orchestra.run.smithi083.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43724.log.gz 2024-09-21T00:16:24.151 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49968.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49968.log.gz 2024-09-21T00:16:24.151 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42355.log 2024-09-21T00:16:24.151 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49800.log 2024-09-21T00:16:24.151 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42523.log.gz 2024-09-21T00:16:24.152 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42355.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42355.log.gz 2024-09-21T00:16:24.152 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43514.log 2024-09-21T00:16:24.153 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50094.log 2024-09-21T00:16:24.153 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49800.log.gz 2024-09-21T00:16:24.154 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43514.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.43514.log.gz 2024-09-21T00:16:24.154 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.49119.log 2024-09-21T00:16:24.155 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46512.log 2024-09-21T00:16:24.155 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50094.log.gz 2024-09-21T00:16:24.156 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.49119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49119.log.gz 2024-09-21T00:16:24.156 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47061.log 2024-09-21T00:16:24.157 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47138.log 2024-09-21T00:16:24.157 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46512.log.gz 2024-09-21T00:16:24.158 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46554.log 2024-09-21T00:16:24.158 INFO:teuthology.orchestra.run.smithi083.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47061.log.gz 2024-09-21T00:16:24.159 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2024-09-21T00:16:24.159 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47138.log.gz 2024-09-21T00:16:24.159 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46554.log: gzip -5 87.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.46554.log.gz 2024-09-21T00:16:24.159 INFO:teuthology.orchestra.run.smithi083.stderr: -- /var/log/ceph/ceph-client.admin.44124.log 2024-09-21T00:16:24.160 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47535.log 2024-09-21T00:16:24.160 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2024-09-21T00:16:24.161 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44465.log 2024-09-21T00:16:24.161 INFO:teuthology.orchestra.run.smithi083.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.44124.log.gz 2024-09-21T00:16:24.163 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47991.log 2024-09-21T00:16:24.163 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47535.log.gz 2024-09-21T00:16:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44465.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44465.log.gz 2024-09-21T00:16:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29623.log 2024-09-21T00:16:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44470.log 2024-09-21T00:16:24.164 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47991.log.gz 2024-09-21T00:16:24.165 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.tmp-client.admin.29623.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29623.log.gz 2024-09-21T00:16:24.165 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41822.log 2024-09-21T00:16:24.166 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44470.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T00:16:24.166 INFO:teuthology.orchestra.run.smithi083.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44470.log.gz 2024-09-21T00:16:24.167 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48931.log 2024-09-21T00:16:24.167 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41822.log.gz 2024-09-21T00:16:24.168 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48343.log 2024-09-21T00:16:24.169 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48931.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T00:16:24.169 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47348.log 87.8% 2024-09-21T00:16:24.169 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48931.log.gz 2024-09-21T00:16:24.170 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48126.log 2024-09-21T00:16:24.170 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48343.log.gz 2024-09-21T00:16:24.171 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43336.log 2024-09-21T00:16:24.171 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47348.log.gz 2024-09-21T00:16:24.172 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48126.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48126.log.gzgzip 2024-09-21T00:16:24.172 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45128.log 2024-09-21T00:16:24.173 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49664.log 2024-09-21T00:16:24.173 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43336.log.gz 2024-09-21T00:16:24.173 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45128.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45128.log.gz 2024-09-21T00:16:24.174 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44784.log 2024-09-21T00:16:24.174 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48076.log 2024-09-21T00:16:24.175 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49664.log.gz 2024-09-21T00:16:24.175 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44784.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.48301.log -- replaced with /var/log/ceph/ceph-client.admin.44784.log.gz 2024-09-21T00:16:24.175 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-21T00:16:24.176 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48427.log 2024-09-21T00:16:24.176 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48076.log.gz 2024-09-21T00:16:24.177 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48301.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48301.log.gz 2024-09-21T00:16:24.177 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35827.log 2024-09-21T00:16:24.178 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48721.log 2024-09-21T00:16:24.178 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48427.log.gz 2024-09-21T00:16:24.179 INFO:teuthology.orchestra.run.smithi142.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-21T00:16:24.179 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35827.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.35827.log.gz 2024-09-21T00:16:24.180 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49884.log 2024-09-21T00:16:24.180 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46596.log 2024-09-21T00:16:24.180 INFO:teuthology.orchestra.run.smithi083.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.48721.log.gz 2024-09-21T00:16:24.181 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49884.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49884.log.gz 2024-09-21T00:16:24.181 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44441.log 2024-09-21T00:16:24.182 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42481.log 2024-09-21T00:16:24.182 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46596.log.gz 2024-09-21T00:16:24.183 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44441.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44441.log.gz 2024-09-21T00:16:24.183 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42042.log 2024-09-21T00:16:24.184 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35859.log 2024-09-21T00:16:24.184 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42481.log.gz 2024-09-21T00:16:24.185 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36652.log 2024-09-21T00:16:24.185 INFO:teuthology.orchestra.run.smithi083.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42042.log.gz 2024-09-21T00:16:24.186 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44736.log 2024-09-21T00:16:24.186 INFO:teuthology.orchestra.run.smithi083.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35859.log.gz 2024-09-21T00:16:24.187 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36652.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36652.log.gz 2024-09-21T00:16:24.187 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42313.log 2024-09-21T00:16:24.187 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36944.log 2024-09-21T00:16:24.188 INFO:teuthology.orchestra.run.smithi083.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44736.log.gz 2024-09-21T00:16:24.188 INFO:teuthology.orchestra.run.smithi142.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T00:16:24.189 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36612.log 87.6% 2024-09-21T00:16:24.189 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42313.log.gz 2024-09-21T00:16:24.189 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47474.log 2024-09-21T00:16:24.189 INFO:teuthology.orchestra.run.smithi083.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36944.log.gz 2024-09-21T00:16:24.190 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48385.log 2024-09-21T00:16:24.190 INFO:teuthology.orchestra.run.smithi083.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36612.log.gz 2024-09-21T00:16:24.191 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44130.log 2024-09-21T00:16:24.191 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47474.log.gz 2024-09-21T00:16:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43682.log 2024-09-21T00:16:24.192 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48385.log.gz 2024-09-21T00:16:24.193 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2024-09-21T00:16:24.193 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44130.log.gz 2024-09-21T00:16:24.194 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42565.log 2024-09-21T00:16:24.194 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43682.log.gz 2024-09-21T00:16:24.195 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50537.log 2024-09-21T00:16:24.195 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2024-09-21T00:16:24.196 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42565.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42565.log.gz 2024-09-21T00:16:24.196 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44117.log 2024-09-21T00:16:24.197 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50579.log 2024-09-21T00:16:24.197 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50537.log.gz 2024-09-21T00:16:24.198 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36259.log 2024-09-21T00:16:24.198 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44117.log.gz 2024-09-21T00:16:24.198 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41918.log 2024-09-21T00:16:24.199 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50579.log.gz 2024-09-21T00:16:24.199 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36259.log: 86.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36259.log.gz 2024-09-21T00:16:24.199 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49528.log 2024-09-21T00:16:24.200 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50178.log 2024-09-21T00:16:24.201 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41918.log.gz 2024-09-21T00:16:24.201 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36304.log 2024-09-21T00:16:24.201 INFO:teuthology.orchestra.run.smithi083.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49528.log.gz 2024-09-21T00:16:24.202 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50178.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50178.log.gz 2024-09-21T00:16:24.202 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44426.log 2024-09-21T00:16:24.203 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36304.log: gzip 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36304.log.gz -5 2024-09-21T00:16:24.203 INFO:teuthology.orchestra.run.smithi083.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48217.log 2024-09-21T00:16:24.204 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36176.log 2024-09-21T00:16:24.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44426.log.gz 2024-09-21T00:16:24.205 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48217.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48217.log.gz 2024-09-21T00:16:24.205 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48595.log 2024-09-21T00:16:24.206 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36176.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-21T00:16:24.206 INFO:teuthology.orchestra.run.smithi083.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36176.log.gz 2024-09-21T00:16:24.207 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47865.log 2024-09-21T00:16:24.207 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48595.log.gz 2024-09-21T00:16:24.208 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43826.log 2024-09-21T00:16:24.209 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47865.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47865.log.gz -5 2024-09-21T00:16:24.209 INFO:teuthology.orchestra.run.smithi083.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50052.log 2024-09-21T00:16:24.210 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43826.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43826.log.gz 2024-09-21T00:16:24.210 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44805.log 2024-09-21T00:16:24.211 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36321.log 2024-09-21T00:16:24.212 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50052.log.gz 2024-09-21T00:16:24.212 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44805.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44805.log.gz 2024-09-21T00:16:24.212 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47222.log 2024-09-21T00:16:24.213 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36321.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36321.log.gz 2024-09-21T00:16:24.213 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36257.log 2024-09-21T00:16:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47264.log 2024-09-21T00:16:24.215 INFO:teuthology.orchestra.run.smithi083.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47222.log.gz 2024-09-21T00:16:24.216 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45170.log 2024-09-21T00:16:24.216 INFO:teuthology.orchestra.run.smithi083.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.36257.log.gz 2024-09-21T00:16:24.217 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47264.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47264.log.gz 2024-09-21T00:16:24.217 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43472.log 2024-09-21T00:16:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47821.log 2024-09-21T00:16:24.218 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45170.log.gz 2024-09-21T00:16:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49234.log 2024-09-21T00:16:24.219 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43472.log.gz 2024-09-21T00:16:24.220 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50220.log 2024-09-21T00:16:24.220 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47821.log.gz 2024-09-21T00:16:24.221 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49234.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49234.log.gz 2024-09-21T00:16:24.221 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48173.log 2024-09-21T00:16:24.222 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35728.log 2024-09-21T00:16:24.223 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50220.log.gz 2024-09-21T00:16:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48173.log: gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48173.log.gz 2024-09-21T00:16:24.223 INFO:teuthology.orchestra.run.smithi083.stderr: /var/log/ceph/ceph-client.admin.47699.log 2024-09-21T00:16:24.224 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35728.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.35728.log.gz 2024-09-21T00:16:24.225 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48637.log 2024-09-21T00:16:24.226 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50010.log 2024-09-21T00:16:24.226 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47699.log.gz 2024-09-21T00:16:24.227 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48637.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48637.log.gz /var/log/ceph/ceph-client.admin.45461.log 2024-09-21T00:16:24.227 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-21T00:16:24.228 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50957.log 2024-09-21T00:16:24.228 INFO:teuthology.orchestra.run.smithi083.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50010.log.gz 2024-09-21T00:16:24.229 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45461.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45461.log.gz 2024-09-21T00:16:24.229 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49123.log 2024-09-21T00:16:24.230 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50957.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T00:16:24.230 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50957.log.gz 2024-09-21T00:16:24.231 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.49123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49123.log.gz 2024-09-21T00:16:24.231 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48259.log 2024-09-21T00:16:24.233 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45933.log 2024-09-21T00:16:24.234 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43640.log 2024-09-21T00:16:24.234 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48259.log.gz 2024-09-21T00:16:24.235 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44684.log 2024-09-21T00:16:24.235 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45933.log.gz 2024-09-21T00:16:24.236 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46680.log 2024-09-21T00:16:24.236 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43640.log.gz 2024-09-21T00:16:24.237 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35689.log 2024-09-21T00:16:24.238 INFO:teuthology.orchestra.run.smithi083.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44684.log.gz 2024-09-21T00:16:24.239 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46680.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T00:16:24.239 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46680.log.gz 2024-09-21T00:16:24.239 INFO:teuthology.orchestra.run.smithi142.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T00:16:24.240 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45254.log 2024-09-21T00:16:24.240 INFO:teuthology.orchestra.run.smithi083.stderr: 75.5% -- replaced with /var/log/ceph/ceph-client.admin.35689.log.gz 2024-09-21T00:16:24.241 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46470.log 2024-09-21T00:16:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36315.log 2024-09-21T00:16:24.242 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45254.log.gz 2024-09-21T00:16:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46470.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-21T00:16:24.243 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46470.log.gz 2024-09-21T00:16:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41576.log 2024-09-21T00:16:24.245 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50453.log 2024-09-21T00:16:24.245 INFO:teuthology.orchestra.run.smithi083.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36315.log.gz 2024-09-21T00:16:24.246 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41576.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41576.log.gz 2024-09-21T00:16:24.246 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36319.log 2024-09-21T00:16:24.247 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47577.log 2024-09-21T00:16:24.247 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50453.log.gz 2024-09-21T00:16:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35999.log 2024-09-21T00:16:24.248 INFO:teuthology.orchestra.run.smithi083.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36319.log.gz 2024-09-21T00:16:24.249 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47577.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47577.log.gz 2024-09-21T00:16:24.249 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36099.log 2024-09-21T00:16:24.250 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35999.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T00:16:24.250 INFO:teuthology.orchestra.run.smithi083.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.35999.log.gz 2024-09-21T00:16:24.251 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T00:16:24.251 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36099.log: gzip -5 --verbose -- 85.8% /var/log/ceph/ceph-client.admin.44125.log 2024-09-21T00:16:24.251 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36099.log.gz 2024-09-21T00:16:24.252 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48511.log 2024-09-21T00:16:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46971.log 2024-09-21T00:16:24.254 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44125.log.gz 2024-09-21T00:16:24.255 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42269.log 2024-09-21T00:16:24.255 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48511.log.gz 2024-09-21T00:16:24.256 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46971.log: 92.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-21T00:16:24.256 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48847.log 2024-09-21T00:16:24.257 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46971.log.gz 2024-09-21T00:16:24.257 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42269.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T00:16:24.257 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42269.log.gz 2024-09-21T00:16:24.258 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46252.log 2024-09-21T00:16:24.259 INFO:teuthology.orchestra.run.smithi083.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48847.log.gz 2024-09-21T00:16:24.259 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47432.log 2024-09-21T00:16:24.260 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.2.46252.log: 84.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T00:16:24.260 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46252.log.gz 2024-09-21T00:16:24.260 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35710.log 2024-09-21T00:16:24.261 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46893.log 2024-09-21T00:16:24.262 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47432.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47432.log.gz 2024-09-21T00:16:24.262 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35710.log: 75.5% -- replaced with /var/log/ceph/ceph-client.admin.35710.log.gz 2024-09-21T00:16:24.262 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50621.log 2024-09-21T00:16:24.264 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49360.log 2024-09-21T00:16:24.264 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46893.log.gz 2024-09-21T00:16:24.265 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42000.log 2024-09-21T00:16:24.265 INFO:teuthology.orchestra.run.smithi083.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50621.log.gz 2024-09-21T00:16:24.266 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49360.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49360.log.gz 2024-09-21T00:16:24.266 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42223.log 2024-09-21T00:16:24.267 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45781.log 2024-09-21T00:16:24.267 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42000.log.gz 2024-09-21T00:16:24.268 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42223.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42223.log.gz 2024-09-21T00:16:24.268 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43784.log 2024-09-21T00:16:24.269 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.45781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43394.log 2024-09-21T00:16:24.269 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45781.log.gz 2024-09-21T00:16:24.270 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43784.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43784.log.gz 2024-09-21T00:16:24.270 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50136.log 2024-09-21T00:16:24.271 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44132.log 2024-09-21T00:16:24.272 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43394.log.gz 2024-09-21T00:16:24.272 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50136.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50136.log.gz 2024-09-21T00:16:24.272 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47949.log 2024-09-21T00:16:24.273 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 2024-09-21T00:16:24.274 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44132.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44132.log.gz 2024-09-21T00:16:24.274 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47949.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47949.log.gz 2024-09-21T00:16:24.274 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44733.log 2024-09-21T00:16:24.275 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45212.log 2024-09-21T00:16:24.275 INFO:teuthology.orchestra.run.smithi083.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2024-09-21T00:16:24.277 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46386.log 2024-09-21T00:16:24.277 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44733.log.gz 2024-09-21T00:16:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45212.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45212.log.gz 2024-09-21T00:16:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43868.log 2024-09-21T00:16:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50999.log 2024-09-21T00:16:24.279 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46386.log.gz 2024-09-21T00:16:24.280 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42397.log 2024-09-21T00:16:24.280 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43868.log.gz 2024-09-21T00:16:24.281 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50999.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50999.log.gz 2024-09-21T00:16:24.281 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50789.log 2024-09-21T00:16:24.282 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51251.log 2024-09-21T00:16:24.282 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42397.log.gz 2024-09-21T00:16:24.283 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50789.log: gzip -5 --verbose 87.3% -- -- replaced with /var/log/ceph/ceph-client.admin.50789.log.gz /var/log/ceph/ceph-client.admin.48469.log 2024-09-21T00:16:24.283 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-21T00:16:24.284 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44443.log 2024-09-21T00:16:24.284 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51251.log.gz 2024-09-21T00:16:24.285 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48469.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48469.log.gz 2024-09-21T00:16:24.285 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50873.log 2024-09-21T00:16:24.286 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49486.log 2024-09-21T00:16:24.286 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44443.log.gz 2024-09-21T00:16:24.287 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36854.log 2024-09-21T00:16:24.287 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50873.log.gz 2024-09-21T00:16:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47306.log 2024-09-21T00:16:24.288 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49486.log.gz 2024-09-21T00:16:24.290 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44453.log 2024-09-21T00:16:24.290 INFO:teuthology.orchestra.run.smithi083.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36854.log.gz 2024-09-21T00:16:24.290 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47306.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47306.log.gz 2024-09-21T00:16:24.291 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43910.log 2024-09-21T00:16:24.292 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44129.log 2024-09-21T00:16:24.292 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44453.log.gz 2024-09-21T00:16:24.293 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43910.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43910.log.gz 2024-09-21T00:16:24.293 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49926.log 2024-09-21T00:16:24.295 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36313.log 2024-09-21T00:16:24.295 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44129.log.gz 2024-09-21T00:16:24.296 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45800.log 2024-09-21T00:16:24.296 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49926.log.gz 2024-09-21T00:16:24.296 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50411.log 2024-09-21T00:16:24.297 INFO:teuthology.orchestra.run.smithi083.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36313.log.gz 2024-09-21T00:16:24.297 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.45800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45800.log.gz 2024-09-21T00:16:24.297 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47779.log 2024-09-21T00:16:24.299 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48805.log 2024-09-21T00:16:24.299 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50411.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50411.log.gz 2024-09-21T00:16:24.300 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47779.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47779.log.gz 2024-09-21T00:16:24.300 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46248.log 2024-09-21T00:16:24.301 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45044.log 2024-09-21T00:16:24.301 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48805.log.gz 2024-09-21T00:16:24.302 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.2.46248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46248.log.gz 2024-09-21T00:16:24.302 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49318.log 2024-09-21T00:16:24.303 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45044.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45044.log.gz 2024-09-21T00:16:24.303 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42673.log 2024-09-21T00:16:24.304 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50705.log 2024-09-21T00:16:24.304 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49318.log.gz 2024-09-21T00:16:24.305 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42673.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48679.log 2024-09-21T00:16:24.305 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42673.log.gz 2024-09-21T00:16:24.306 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50705.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50705.log.gz 2024-09-21T00:16:24.306 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51352.log 2024-09-21T00:16:24.307 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47180.log 2024-09-21T00:16:24.308 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48679.log.gz 2024-09-21T00:16:24.309 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35806.log 2024-09-21T00:16:24.309 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51352.log.gz 2024-09-21T00:16:24.310 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47180.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47180.log.gz 2024-09-21T00:16:24.310 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50915.log 2024-09-21T00:16:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.35806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51041.log 2024-09-21T00:16:24.311 INFO:teuthology.orchestra.run.smithi083.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.35806.log.gz 2024-09-21T00:16:24.312 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50915.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T00:16:24.312 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50915.log.gz 2024-09-21T00:16:24.313 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51041.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51041.log.gz 2024-09-21T00:16:24.313 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44789.log 2024-09-21T00:16:24.314 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50747.log 2024-09-21T00:16:24.315 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.44789.log: 86.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42439.log 2024-09-21T00:16:24.315 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44789.log.gz 2024-09-21T00:16:24.316 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50747.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.50747.log.gz 2024-09-21T00:16:24.316 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49444.log 2024-09-21T00:16:24.317 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42439.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-21T00:16:24.318 INFO:teuthology.orchestra.run.smithi083.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42439.log.gz 2024-09-21T00:16:24.319 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46764.log 2024-09-21T00:16:24.319 INFO:teuthology.orchestra.run.smithi083.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49444.log.gz 2024-09-21T00:16:24.321 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mds.c.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-21T00:16:24.321 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42084.log 2024-09-21T00:16:24.321 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46764.log.gz 2024-09-21T00:16:24.322 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51209.log 2024-09-21T00:16:24.323 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42084.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42084.log.gz 2024-09-21T00:16:24.323 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45086.log 2024-09-21T00:16:24.324 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51167.log 2024-09-21T00:16:24.324 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51209.log.gz 2024-09-21T00:16:24.325 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45086.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45086.log.gz 2024-09-21T00:16:24.326 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51167.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51167.log.gz 2024-09-21T00:16:24.500 INFO:teuthology.orchestra.run.smithi083.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T00:16:24.824 INFO:teuthology.orchestra.run.smithi142.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T00:16:24.831 INFO:teuthology.orchestra.run.smithi142.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T00:16:24.863 INFO:teuthology.orchestra.run.smithi142.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T00:16:24.866 INFO:teuthology.orchestra.run.smithi083.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T00:16:24.870 INFO:teuthology.orchestra.run.smithi083.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T00:16:24.897 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T00:16:24.900 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-21T00:16:24.900 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m0.806s 2024-09-21T00:16:24.900 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m3.008s 2024-09-21T00:16:24.901 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.312s 2024-09-21T00:16:25.007 INFO:teuthology.orchestra.run.smithi083.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T00:16:25.052 INFO:teuthology.orchestra.run.smithi083.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T00:16:25.055 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-21T00:16:25.055 INFO:teuthology.orchestra.run.smithi083.stderr:real 0m0.965s 2024-09-21T00:16:25.055 INFO:teuthology.orchestra.run.smithi083.stderr:user 0m3.090s 2024-09-21T00:16:25.056 INFO:teuthology.orchestra.run.smithi083.stderr:sys 0m0.763s 2024-09-21T00:16:25.056 INFO:tasks.ceph:Archiving logs... 2024-09-21T00:16:25.057 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313/remote/smithi083/log 2024-09-21T00:16:25.057 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T00:16:25.748 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313/remote/smithi142/log 2024-09-21T00:16:25.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T00:16:26.234 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T00:16:26.243 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T00:16:26.243 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T00:16:26.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T00:16:26.360 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T00:16:26.368 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T00:16:26.369 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:16:26.373 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:16:26.403 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:16:26.406 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:16:26.410 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:16:26.411 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-09-21T00:16:26.411 INFO:teuthology.orchestra.run.smithi083.stdout:^* hv01.front.sepia.ceph.com 3 6 377 56 +253us[ +255us] +/- 30ms 2024-09-21T00:16:26.411 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -1220us[-1220us] +/- 59ms 2024-09-21T00:16:26.411 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 +979us[ +979us] +/- 59ms 2024-09-21T00:16:26.411 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:16:26.413 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:16:26.413 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-21T00:16:26.413 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv01.front.sepia.ceph.com 3 6 377 56 +224us[ +274us] +/- 30ms 2024-09-21T00:16:26.414 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -1261us[-1211us] +/- 59ms 2024-09-21T00:16:26.414 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 +940us[ +991us] +/- 59ms 2024-09-21T00:16:26.414 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:16:26.415 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T00:16:26.424 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T00:16:26.425 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T00:16:26.483 DEBUG:teuthology.orchestra.run.smithi083:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T00:16:26.604 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T00:16:26.716 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T00:16:26.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:16:26.776 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T00:16:26.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:16:26.836 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T00:16:26.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T00:16:26.933 INFO:teuthology.task.internal:Duration was 606.477046 seconds 2024-09-21T00:16:26.934 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T00:16:26.999 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T00:16:26.999 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T00:16:27.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T00:16:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:16:27.091 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:16:27.427 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T00:16:27.427 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T00:16:27.427 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T00:16:27.477 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T00:16:27.477 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T00:16:27.527 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T00:16:27.527 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T00:16:27.532 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T00:16:27.590 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T00:16:27.591 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T00:16:27.594 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T00:16:27.736 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T00:16:27.850 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T00:16:27.850 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T00:16:27.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T00:16:27.962 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T00:16:27.987 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T00:16:27.991 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T00:16:28.057 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2024-09-21T00:16:28.062 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-09-21T00:16:28.092 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T00:16:28.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:16:28.125 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T00:16:28.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:16:28.158 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T00:16:28.197 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T00:16:28.198 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313/remote/smithi083 2024-09-21T00:16:28.198 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T00:16:28.261 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913313/remote/smithi142 2024-09-21T00:16:28.261 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T00:16:28.323 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T00:16:28.323 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T00:16:28.327 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T00:16:28.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T00:16:28.373 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T00:16:28.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T00:16:28.405 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T00:16:28.405 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T00:16:28.410 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T00:16:28.441 INFO:teuthology.orchestra.run.smithi083.stdout: 393253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 00:16 /home/ubuntu/cephtest 2024-09-21T00:16:28.444 INFO:teuthology.orchestra.run.smithi142.stdout: 393731 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 00:16 /home/ubuntu/cephtest 2024-09-21T00:16:28.447 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T00:16:28.456 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T00:16:28.530 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/recovery-fs} duration: 606.4770460128784 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T00:16:28.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T00:16:28.633 INFO:teuthology.run:pass